2024-09-12T05:06:11.184 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T05:06:11.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T05:06:11.292 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301 branch: wip-dis-testing description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} email: idryomov@gmail.com first_in_suite: false job_id: '7902301' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-dis-testing ceph: conf: client: rbd cache: true rbd cache policy: writearound global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-dis-testing sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 owner: scheduled_dis@teuthology priority: 70 repo: https://github.com/ceph/ceph-ci roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1680 sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 sleep_before_teardown: 0 subset: 42/100 suite: rbd suite_branch: wip-dis-testing suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d61b08865d4d98738f45ff2e4806d7fb6d03eca1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci suite_sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI15C9rcdBKndy1oKRHNY6at15za/v7NstVFdQAFr7DUuyS0QVVAyNPPwo63cV7Epn26o8/oH7144vPWF5tTO7g= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCpn/7RJqo1gAv/mI0wd/gl9bgN1Kp9qRbA3AMM5PEFFTlZcHB1ky/0hOyKp37GJKqVddK3wjR9Wk/CEMn1Zvfo= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_04:46:10 tube: smithi user: dis verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T05:06:11.292 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d61b08865d4d98738f45ff2e4806d7fb6d03eca1/qa; will attempt to use it 2024-09-12T05:06:11.293 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d61b08865d4d98738f45ff2e4806d7fb6d03eca1/qa/tasks 2024-09-12T05:06:11.293 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T05:06:11.294 INFO:teuthology.task.internal:Checking packages... 2024-09-12T05:06:11.315 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1' 2024-09-12T05:06:11.315 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T05:06:11.315 INFO:teuthology.packaging:ref: None 2024-09-12T05:06:11.315 INFO:teuthology.packaging:tag: None 2024-09-12T05:06:11.315 INFO:teuthology.packaging:branch: wip-dis-testing 2024-09-12T05:06:11.315 INFO:teuthology.packaging:sha1: d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T05:06:11.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-dis-testing 2024-09-12T05:06:11.489 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:06:11.491 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T05:06:11.497 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T05:06:11.497 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T05:06:11.549 INFO:teuthology.task.internal:Saving configuration 2024-09-12T05:06:11.562 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T05:06:11.576 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T05:06:11.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 05:00:36.130888', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA/2OqfwJ71pMgXW49LdSDwZrMvtrEQb5bEw3E6zgFmi'} 2024-09-12T05:06:11.639 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 05:00:36.132730', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINTfPopStaWrlA0RmsQPoJYWn12Iq35TAXZoJbjnup/R'} 2024-09-12T05:06:11.639 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T05:06:11.649 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T05:06:11.650 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T05:06:11.650 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T05:06:11.777 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f067eb63ac0>, signals=[15]) 2024-09-12T05:06:11.777 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T05:06:11.785 INFO:teuthology.task.internal:Opening connections... 2024-09-12T05:06:11.786 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:06:11.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:06:11.878 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:06:11.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:06:11.966 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T05:06:11.975 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-09-12T05:06:11.980 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-09-12T05:06:11.980 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-09-12T05:06:12.026 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T05:06:12.026 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2024-09-12T05:06:12.026 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="22.04" 2024-09-12T05:06:12.026 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T05:06:12.026 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=jammy 2024-09-12T05:06:12.026 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2024-09-12T05:06:12.026 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2024-09-12T05:06:12.026 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T05:06:12.027 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T05:06:12.027 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T05:06:12.027 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T05:06:12.027 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=jammy 2024-09-12T05:06:12.027 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-09-12T05:06:12.060 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-12T05:06:12.064 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-12T05:06:12.065 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-12T05:06:12.110 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T05:06:12.110 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="22.04" 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=jammy 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T05:06:12.111 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=jammy 2024-09-12T05:06:12.111 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-12T05:06:12.143 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T05:06:12.151 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T05:06:12.177 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T05:06:12.178 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-09-12T05:06:12.180 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-12T05:06:12.185 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T05:06:12.209 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T05:06:12.210 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-09-12T05:06:12.227 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-12T05:06:12.242 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T05:06:12.321 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T05:06:12.334 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T05:06:12.334 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T05:06:12.335 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T05:06:12.335 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T05:06:12.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:06:12.340 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-09-12T05:06:12.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:06:12.341 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-12T05:06:12.386 INFO:teuthology.orchestra.run.smithi059.stdout:5.15.0-56-generic 2024-09-12T05:06:12.386 INFO:teuthology.task.kernel:Running kernel on smithi059: 5.15.0-56-generic 2024-09-12T05:06:12.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get clean 2024-09-12T05:06:12.387 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-56-generic 2024-09-12T05:06:12.387 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.15.0-56-generic 2024-09-12T05:06:12.388 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get clean 2024-09-12T05:06:12.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2024-09-12T05:06:12.523 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-12T05:06:12.634 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T05:06:12.660 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T05:06:12.724 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T05:06:12.729 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T05:06:12.781 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T05:06:12.832 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T05:06:12.849 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T05:06:12.902 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T05:06:12.942 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T05:06:12.973 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T05:06:13.010 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T05:06:13.013 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T05:06:13.013 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T05:06:13.030 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T05:06:13.031 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T05:06:13.034 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T05:06:13.034 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T05:06:13.040 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T05:06:13.044 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T05:06:13.047 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T05:06:13.048 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T05:06:13.049 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T05:06:13.051 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T05:06:13.052 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T05:06:13.053 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T05:06:13.076 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T05:06:13.077 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T05:06:13.077 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T05:06:13.078 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T05:06:13.078 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T05:06:13.078 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T05:06:13.079 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T05:06:13.079 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T05:06:13.081 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T05:06:13.089 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T05:06:13.092 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T05:06:13.098 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T05:06:13.099 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T05:06:13.099 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T05:06:13.099 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T05:06:13.099 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T05:06:13.106 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T05:06:13.109 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T05:06:13.111 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T05:06:13.113 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T05:06:13.116 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T05:06:13.213 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T05:06:13.221 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T05:06:13.272 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T05:06:13.366 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T05:06:13.698 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T05:06:13.714 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T05:06:13.723 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T05:06:13.723 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T05:06:13.764 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T05:06:13.783 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T05:06:13.792 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T05:06:13.793 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T05:06:13.819 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T05:06:13.820 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T05:06:13.831 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T05:06:13.832 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T05:06:13.848 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T05:06:13.877 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T05:06:13.880 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T05:06:13.882 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T05:06:13.883 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T05:06:13.883 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T05:06:13.884 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T05:06:13.895 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T05:06:13.895 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T05:06:13.912 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T05:06:13.952 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T05:06:13.958 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T05:06:13.959 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T05:06:13.960 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T05:06:13.963 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T05:06:13.963 INFO:teuthology.orchestra.run.smithi059.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T05:06:14.032 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T05:06:14.032 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T05:06:14.032 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T05:06:14.034 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T05:06:14.035 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T05:06:14.113 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T05:06:14.113 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T05:06:14.114 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T05:06:14.114 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T05:06:14.115 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T05:06:19.238 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 15.8 MB in 2s (7,263 kB/s) 2024-09-12T05:06:19.711 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 15.8 MB in 2s (7,194 kB/s) 2024-09-12T05:06:20.546 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T05:06:20.561 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T05:06:20.616 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T05:06:20.802 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-12T05:06:20.803 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-12T05:06:20.970 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T05:06:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T05:06:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T05:06:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T05:06:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T05:06:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: python2.7-minimal 2024-09-12T05:06:20.970 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T05:06:20.972 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-09-12T05:06:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T05:06:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T05:06:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T05:06:20.974 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-09-12T05:06:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T05:06:20.974 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-09-12T05:06:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: thermald 2024-09-12T05:06:21.021 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-09-12T05:06:21.022 INFO:teuthology.orchestra.run.smithi194.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T05:06:21.022 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T05:06:21.022 INFO:teuthology.orchestra.run.smithi194.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T05:06:21.023 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages will be upgraded: 2024-09-12T05:06:21.024 INFO:teuthology.orchestra.run.smithi194.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T05:06:21.076 INFO:teuthology.orchestra.run.smithi194.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T05:06:21.076 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 113 MB of archives. 2024-09-12T05:06:21.077 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T05:06:21.077 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T05:06:21.144 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-09-12T05:06:21.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T05:06:21.232 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-09-12T05:06:21.446 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-09-12T05:06:21.447 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-09-12T05:06:21.500 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T05:06:21.601 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T05:06:21.642 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T05:06:21.642 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T05:06:21.642 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T05:06:21.642 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T05:06:21.643 INFO:teuthology.orchestra.run.smithi059.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T05:06:21.643 INFO:teuthology.orchestra.run.smithi059.stdout: python2.7-minimal 2024-09-12T05:06:21.643 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T05:06:21.644 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2024-09-12T05:06:21.644 INFO:teuthology.orchestra.run.smithi059.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T05:06:21.644 INFO:teuthology.orchestra.run.smithi059.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T05:06:21.645 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T05:06:21.646 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2024-09-12T05:06:21.646 INFO:teuthology.orchestra.run.smithi059.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T05:06:21.646 INFO:teuthology.orchestra.run.smithi059.stdout:Recommended packages: 2024-09-12T05:06:21.646 INFO:teuthology.orchestra.run.smithi059.stdout: thermald 2024-09-12T05:06:21.694 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2024-09-12T05:06:21.695 INFO:teuthology.orchestra.run.smithi059.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T05:06:21.695 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T05:06:21.695 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T05:06:21.697 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages will be upgraded: 2024-09-12T05:06:21.697 INFO:teuthology.orchestra.run.smithi059.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T05:06:21.878 INFO:teuthology.orchestra.run.smithi059.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T05:06:21.878 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 113 MB of archives. 2024-09-12T05:06:21.878 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T05:06:21.878 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T05:06:22.370 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T05:06:22.370 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T05:06:22.370 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T05:06:22.489 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T05:06:22.581 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T05:06:22.927 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 113 MB in 2s (73.1 MB/s) 2024-09-12T05:06:23.126 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T05:06:23.296 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T05:06:23.653 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T05:06:25.079 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T05:06:25.083 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T05:06:25.289 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:25.938 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T05:06:25.939 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T05:06:25.939 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T05:06:26.405 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T05:06:26.515 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T05:06:26.905 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 113 MB in 5s (23.6 MB/s) 2024-09-12T05:06:27.075 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T05:06:27.398 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T05:06:27.420 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T05:06:27.516 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:27.984 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T05:06:28.005 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T05:06:28.042 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:29.034 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T05:06:29.038 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T05:06:29.113 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:31.297 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T05:06:31.318 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T05:06:31.407 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:31.866 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T05:06:31.887 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T05:06:31.925 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:34.650 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T05:06:34.776 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T05:06:35.108 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T05:06:35.229 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T05:06:35.524 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T05:06:35.546 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T05:06:35.590 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T05:06:38.707 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T05:06:38.817 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T05:06:39.125 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T05:06:39.253 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T05:06:39.548 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T05:06:39.571 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T05:06:39.606 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T05:06:41.268 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T05:06:41.306 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T05:06:41.705 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:44.368 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T05:06:44.490 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T05:06:44.831 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T05:06:44.937 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:45.062 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T05:06:45.208 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:45.473 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T05:06:45.510 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T05:06:45.547 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:46.516 INFO:teuthology.orchestra.run.smithi194.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T05:06:46.516 INFO:teuthology.orchestra.run.smithi194.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T05:06:46.516 INFO:teuthology.orchestra.run.smithi194.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T05:06:46.516 INFO:teuthology.orchestra.run.smithi194.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T05:06:46.717 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:48.134 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:48.907 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T05:06:49.207 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T05:06:49.557 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T05:06:49.661 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:49.762 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T05:06:49.899 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:50.454 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T05:06:50.579 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T05:06:50.722 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:50.786 INFO:teuthology.orchestra.run.smithi194.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T05:06:50.786 INFO:teuthology.orchestra.run.smithi194.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T05:06:51.213 INFO:teuthology.orchestra.run.smithi059.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T05:06:51.213 INFO:teuthology.orchestra.run.smithi059.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T05:06:51.213 INFO:teuthology.orchestra.run.smithi059.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T05:06:51.213 INFO:teuthology.orchestra.run.smithi059.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T05:06:51.375 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:52.793 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:54.920 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T05:06:55.020 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T05:06:55.138 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T05:06:55.204 INFO:teuthology.orchestra.run.smithi059.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T05:06:55.204 INFO:teuthology.orchestra.run.smithi059.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T05:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T05:07:05.269 INFO:teuthology.orchestra.run.smithi194.stdout:Sourcing file `/etc/default/grub' 2024-09-12T05:07:05.284 INFO:teuthology.orchestra.run.smithi194.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T05:07:05.304 INFO:teuthology.orchestra.run.smithi194.stdout:Generating grub configuration file ... 2024-09-12T05:07:05.571 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T05:07:05.590 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T05:07:05.865 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T05:07:05.871 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T05:07:05.937 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T05:07:05.998 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T05:07:06.093 INFO:teuthology.orchestra.run.smithi194.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T05:07:06.093 INFO:teuthology.orchestra.run.smithi194.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T05:07:06.093 INFO:teuthology.orchestra.run.smithi194.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T05:07:06.127 INFO:teuthology.orchestra.run.smithi194.stdout:done 2024-09-12T05:07:06.632 DEBUG:teuthology.orchestra.run.smithi194:> dpkg -s linux-image-generic 2024-09-12T05:07:06.657 INFO:teuthology.orchestra.run.smithi194.stdout:Package: linux-image-generic 2024-09-12T05:07:06.657 INFO:teuthology.orchestra.run.smithi194.stdout:Status: install ok installed 2024-09-12T05:07:06.657 INFO:teuthology.orchestra.run.smithi194.stdout:Priority: optional 2024-09-12T05:07:06.657 INFO:teuthology.orchestra.run.smithi194.stdout:Section: kernel 2024-09-12T05:07:06.657 INFO:teuthology.orchestra.run.smithi194.stdout:Installed-Size: 21 2024-09-12T05:07:06.657 INFO:teuthology.orchestra.run.smithi194.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: amd64 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:Source: linux-meta 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:Version: 5.15.0.119.119 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:Recommends: thermald 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:Description: Generic Linux kernel image 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout: This package will always depend on the latest generic kernel image 2024-09-12T05:07:06.658 INFO:teuthology.orchestra.run.smithi194.stdout: available. 2024-09-12T05:07:06.658 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T05:07:06.658 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T05:07:06.659 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T05:07:06.659 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T05:07:06.659 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T05:07:06.659 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get clean 2024-09-12T05:07:06.835 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-12T05:07:06.941 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T05:07:06.951 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T05:07:06.968 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T05:07:07.063 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T05:07:07.550 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 129 kB in 1s (235 kB/s) 2024-09-12T05:07:08.555 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T05:07:08.572 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T05:07:08.637 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T05:07:08.846 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-12T05:07:08.847 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-12T05:07:09.037 INFO:teuthology.orchestra.run.smithi194.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T05:07:09.037 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T05:07:09.037 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T05:07:09.038 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T05:07:09.038 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T05:07:09.038 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T05:07:09.038 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T05:07:09.038 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T05:07:09.079 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T05:07:09.081 DEBUG:teuthology.orchestra.run.smithi194:> dpkg -s linux-image-generic 2024-09-12T05:07:09.096 INFO:teuthology.orchestra.run.smithi194.stdout:Package: linux-image-generic 2024-09-12T05:07:09.096 INFO:teuthology.orchestra.run.smithi194.stdout:Status: install ok installed 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Priority: optional 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Section: kernel 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Installed-Size: 21 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: amd64 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Source: linux-meta 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Version: 5.15.0.119.119 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T05:07:09.097 INFO:teuthology.orchestra.run.smithi194.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T05:07:09.098 INFO:teuthology.orchestra.run.smithi194.stdout:Recommends: thermald 2024-09-12T05:07:09.098 INFO:teuthology.orchestra.run.smithi194.stdout:Description: Generic Linux kernel image 2024-09-12T05:07:09.098 INFO:teuthology.orchestra.run.smithi194.stdout: This package will always depend on the latest generic kernel image 2024-09-12T05:07:09.098 INFO:teuthology.orchestra.run.smithi194.stdout: available. 2024-09-12T05:07:09.098 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-12T05:07:09.142 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.unHnRxxyeh 2024-09-12T05:07:09.143 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub/grub.cfg /tmp/tmp.unHnRxxyeh 2024-09-12T05:07:09.198 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.unHnRxxyeh 2024-09-12T05:07:09.321 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.unHnRxxyeh is 10KB 2024-09-12T05:07:09.334 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.unHnRxxyeh 2024-09-12T05:07:09.339 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T05:07:09.394 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:07:09.394 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T05:07:09.394 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T05:07:09.460 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T05:07:09.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo update-grub 2024-09-12T05:07:09.572 INFO:teuthology.orchestra.run.smithi059.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T05:07:09.572 INFO:teuthology.orchestra.run.smithi059.stdout:Sourcing file `/etc/default/grub' 2024-09-12T05:07:09.588 INFO:teuthology.orchestra.run.smithi059.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T05:07:09.610 INFO:teuthology.orchestra.run.smithi059.stdout:Generating grub configuration file ... 2024-09-12T05:07:09.916 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T05:07:09.939 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T05:07:10.239 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T05:07:10.245 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T05:07:10.316 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T05:07:10.324 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T05:07:10.475 INFO:teuthology.orchestra.run.smithi059.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T05:07:10.476 INFO:teuthology.orchestra.run.smithi059.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T05:07:10.476 INFO:teuthology.orchestra.run.smithi059.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T05:07:10.507 INFO:teuthology.orchestra.run.smithi059.stdout:done 2024-09-12T05:07:10.814 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub' 2024-09-12T05:07:10.815 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T05:07:10.818 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-09-12T05:07:10.991 DEBUG:teuthology.orchestra.run.smithi059:> dpkg -s linux-image-generic 2024-09-12T05:07:10.995 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T05:07:11.001 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T05:07:11.011 INFO:teuthology.orchestra.run.smithi059.stdout:Package: linux-image-generic 2024-09-12T05:07:11.011 INFO:teuthology.orchestra.run.smithi059.stdout:Status: install ok installed 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Priority: optional 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Section: kernel 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Installed-Size: 21 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: amd64 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Source: linux-meta 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Version: 5.15.0.119.119 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Recommends: thermald 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:Description: Generic Linux kernel image 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout: This package will always depend on the latest generic kernel image 2024-09-12T05:07:11.012 INFO:teuthology.orchestra.run.smithi059.stdout: available. 2024-09-12T05:07:11.013 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T05:07:11.013 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T05:07:11.013 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T05:07:11.013 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T05:07:11.013 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T05:07:11.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get clean 2024-09-12T05:07:11.180 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2024-09-12T05:07:11.236 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T05:07:11.241 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T05:07:11.282 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T05:07:11.288 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T05:07:11.424 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T05:07:11.424 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T05:07:11.425 INFO:teuthology.orchestra.run.smithi194.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T05:07:11.425 INFO:teuthology.orchestra.run.smithi194.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T05:07:11.434 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T05:07:11.447 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-09-12T05:07:11.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-09-12T05:07:11.506 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T05:07:11.861 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T05:07:12.075 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 257 kB in 1s (352 kB/s) 2024-09-12T05:07:13.121 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-09-12T05:07:13.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T05:07:13.208 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-09-12T05:07:13.422 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-09-12T05:07:13.427 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-09-12T05:07:13.626 INFO:teuthology.orchestra.run.smithi059.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T05:07:13.626 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T05:07:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T05:07:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T05:07:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T05:07:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T05:07:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T05:07:13.627 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T05:07:13.671 INFO:teuthology.orchestra.run.smithi059.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T05:07:13.673 DEBUG:teuthology.orchestra.run.smithi059:> dpkg -s linux-image-generic 2024-09-12T05:07:13.689 INFO:teuthology.orchestra.run.smithi059.stdout:Package: linux-image-generic 2024-09-12T05:07:13.689 INFO:teuthology.orchestra.run.smithi059.stdout:Status: install ok installed 2024-09-12T05:07:13.690 INFO:teuthology.orchestra.run.smithi059.stdout:Priority: optional 2024-09-12T05:07:13.690 INFO:teuthology.orchestra.run.smithi059.stdout:Section: kernel 2024-09-12T05:07:13.690 INFO:teuthology.orchestra.run.smithi059.stdout:Installed-Size: 21 2024-09-12T05:07:13.690 INFO:teuthology.orchestra.run.smithi059.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T05:07:13.690 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: amd64 2024-09-12T05:07:13.691 INFO:teuthology.orchestra.run.smithi059.stdout:Source: linux-meta 2024-09-12T05:07:13.691 INFO:teuthology.orchestra.run.smithi059.stdout:Version: 5.15.0.119.119 2024-09-12T05:07:13.691 INFO:teuthology.orchestra.run.smithi059.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T05:07:13.691 INFO:teuthology.orchestra.run.smithi059.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T05:07:13.691 INFO:teuthology.orchestra.run.smithi059.stdout:Recommends: thermald 2024-09-12T05:07:13.691 INFO:teuthology.orchestra.run.smithi059.stdout:Description: Generic Linux kernel image 2024-09-12T05:07:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: This package will always depend on the latest generic kernel image 2024-09-12T05:07:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: available. 2024-09-12T05:07:13.692 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-09-12T05:07:13.737 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.5CUuWaS88P 2024-09-12T05:07:13.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5CUuWaS88P 2024-09-12T05:07:13.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.5CUuWaS88P 2024-09-12T05:07:13.910 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.5CUuWaS88P is 10KB 2024-09-12T05:07:13.923 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.5CUuWaS88P 2024-09-12T05:07:13.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T05:07:13.982 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:07:13.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T05:07:13.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T05:07:14.049 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T05:07:14.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo update-grub 2024-09-12T05:07:15.290 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub' 2024-09-12T05:07:15.291 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T05:07:15.293 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-09-12T05:07:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T05:07:15.515 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T05:07:15.753 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T05:07:15.758 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T05:07:15.797 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T05:07:15.802 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T05:07:15.959 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T05:07:15.959 INFO:teuthology.orchestra.run.smithi059.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T05:07:15.959 INFO:teuthology.orchestra.run.smithi059.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T05:07:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-09-12T05:07:15.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2024-09-12T05:07:41.489 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T05:07:41.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T05:07:41.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:07:45.995 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T05:07:45.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-12T05:07:45.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:07:59.937 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-12T05:08:04.541 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-09-12T05:08:08.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T05:08:08.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:08:12.029 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-12T05:08:13.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-12T05:08:13.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:08:24.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T05:08:24.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:08:55.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-12T05:09:10.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T05:09:10.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:09:10.813 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-12T05:09:11.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T05:09:11.408 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T05:09:11.408 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-12T05:09:11.454 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-119-generic 2024-09-12T05:09:11.454 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T05:09:11.454 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T05:09:11.454 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T05:09:12.455 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T05:09:12.455 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T05:09:12.529 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-09-12T05:09:12.559 DEBUG:teuthology.parallel:result is None 2024-09-12T05:09:13.556 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T05:09:25.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-12T05:09:25.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:09:25.789 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-12T05:09:26.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-12T05:09:26.556 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T05:09:26.556 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-09-12T05:09:26.602 INFO:teuthology.orchestra.run.smithi059.stdout:5.15.0-119-generic 2024-09-12T05:09:26.602 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T05:09:26.602 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T05:09:26.602 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T05:09:27.603 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T05:09:27.604 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T05:09:27.672 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2024-09-12T05:09:27.695 DEBUG:teuthology.parallel:result is None 2024-09-12T05:09:27.695 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T05:09:27.702 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T05:09:27.703 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T05:09:27.705 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T05:09:27.712 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T05:09:27.741 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T05:09:27.778 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T05:09:27.778 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T05:09:27.781 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T05:09:27.808 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T05:09:27.813 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T05:09:27.814 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T05:09:27.835 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T05:09:27.850 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T05:09:27.859 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T05:09:27.863 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T05:09:27.871 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T05:09:27.872 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T05:09:27.879 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T05:09:27.879 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T05:09:27.910 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T05:09:27.925 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T05:09:27.935 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T05:09:27.936 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T05:09:27.967 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T05:09:27.974 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T05:09:28.018 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T05:09:28.070 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:09:28.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T05:09:28.129 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T05:09:28.135 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T05:09:28.182 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:09:28.182 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T05:09:28.244 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-09-12T05:09:28.246 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-12T05:09:28.321 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T05:09:28.330 INFO:teuthology.task.internal:Starting timer... 2024-09-12T05:09:28.330 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T05:09:28.371 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T05:09:28.403 DEBUG:teuthology.task.selinux:Excluding smithi059: OS 'ubuntu' does not support SELinux 2024-09-12T05:09:28.403 DEBUG:teuthology.task.selinux:Excluding smithi194: OS 'ubuntu' does not support SELinux 2024-09-12T05:09:28.403 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T05:09:28.403 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T05:09:28.403 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T05:09:28.403 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T05:09:28.436 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T05:09:28.439 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T05:09:28.563 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T05:09:28.576 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T05:09:28.578 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T05:17:04.979 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-12T05:17:04.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-12T05:17:04.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:17:05.075 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-12T05:17:05.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-12T05:17:05.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T05:17:05.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T05:17:05.247 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-12T05:17:05.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T05:17:05.325 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T05:17:05.339 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T05:17:05.339 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T05:17:05.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T05:17:05.342 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T05:17:05.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Command line: ntpd -gq 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: ---------------------------------------------------- 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: corporation. Support and training for ntp-4 are 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: available at https://www.nwtime.org/support 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: ---------------------------------------------------- 2024-09-12T05:17:05.370 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: proto: precision = 0.046 usec (-24) 2024-09-12T05:17:05.371 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: basedate set to 2022-02-04 2024-09-12T05:17:05.371 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: gps base set to 2022-02-06 (week 2196) 2024-09-12T05:17:05.371 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T05:17:05.371 INFO:teuthology.orchestra.run.smithi059.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T05:17:05.371 INFO:teuthology.orchestra.run.smithi059.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T05:17:05.372 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T05:17:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T05:17:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T05:17:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T05:17:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Listen normally on 3 ens1f0 172.21.15.59:123 2024-09-12T05:17:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Listen normally on 4 lo [::1]:123 2024-09-12T05:17:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:192a%4]:123 2024-09-12T05:17:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:05 ntpd[18394]: Listening on routing socket on fd #22 for interface updates 2024-09-12T05:17:05.402 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T05:17:05.402 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Command line: ntpd -gq 2024-09-12T05:17:05.402 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: ---------------------------------------------------- 2024-09-12T05:17:05.402 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T05:17:05.402 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T05:17:05.402 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: corporation. Support and training for ntp-4 are 2024-09-12T05:17:05.402 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: available at https://www.nwtime.org/support 2024-09-12T05:17:05.403 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: ---------------------------------------------------- 2024-09-12T05:17:05.403 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: proto: precision = 0.061 usec (-24) 2024-09-12T05:17:05.403 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: basedate set to 2022-02-04 2024-09-12T05:17:05.403 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: gps base set to 2022-02-06 (week 2196) 2024-09-12T05:17:05.404 INFO:teuthology.orchestra.run.smithi194.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T05:17:05.404 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T05:17:05.404 INFO:teuthology.orchestra.run.smithi194.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T05:17:05.405 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T05:17:05.405 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T05:17:05.405 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T05:17:05.405 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T05:17:05.406 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Listen normally on 3 enp3s0f1 172.21.15.194:123 2024-09-12T05:17:05.406 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Listen normally on 4 lo [::1]:123 2024-09-12T05:17:05.406 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea5%5]:123 2024-09-12T05:17:05.406 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:05 ntpd[18477]: Listening on routing socket on fd #22 for interface updates 2024-09-12T05:17:06.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:06 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:06.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:06 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:06.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:06 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:06.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:06 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:06.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:06 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:06.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:06 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:06.402 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:06 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:06.402 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:06 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:07 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:07 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:07 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:07 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:07 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:07 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:07 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:07 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:08.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:08.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:08.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:08.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:08 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:08.403 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:08 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:08.403 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:08 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:08.403 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:08 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:08.403 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:08 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:08.403 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:08 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:08.403 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:08 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:09 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:09.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:09 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:09 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:09 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:09 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:09.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:09 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:10 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:10.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:10.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:10.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:10.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:10.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:10.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:10.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:10 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:11 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:11 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:11 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:11.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:11 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:11.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:11 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:11.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:11 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stdout:12 Sep 05:17:12 ntpd[18394]: ntpd: time slew +0.001414 s 2024-09-12T05:17:12.371 INFO:teuthology.orchestra.run.smithi059.stdout:ntpd: time slew +0.001414s 2024-09-12T05:17:12.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T05:17:12.372 INFO:teuthology.orchestra.run.smithi059.stderr:12 Sep 05:17:12 ntpd[18394]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:12.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:12.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:12.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:12.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:12.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:12 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T05:17:12.429 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2024-09-12T05:17:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:17:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:17:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:17:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:17:14.403 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:14.403 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 05:17:14 ntpd[18477]: ntpd: time slew -0.003000 s 2024-09-12T05:17:14.404 INFO:teuthology.orchestra.run.smithi194.stdout:ntpd: time slew -0.003000s 2024-09-12T05:17:14.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T05:17:14.405 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 05:17:14 ntpd[18477]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T05:17:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T05:17:14.456 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-09-12T05:17:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:17:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:17:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:17:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:17:14.456 INFO:teuthology.run_tasks:Running task install... 2024-09-12T05:17:14.472 DEBUG:teuthology.task.install:project ceph 2024-09-12T05:17:14.472 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}} 2024-09-12T05:17:14.472 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'} 2024-09-12T05:17:14.472 INFO:teuthology.task.install:Using flavor: default 2024-09-12T05:17:14.478 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T05:17:14.478 INFO:teuthology.task.install:extra packages: [] 2024-09-12T05:17:14.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-key list | grep Ceph 2024-09-12T05:17:14.479 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-key list | grep Ceph 2024-09-12T05:17:14.545 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T05:17:14.556 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T05:17:14.576 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T05:17:14.576 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T05:17:14.577 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T05:17:14.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T05:17:14.591 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T05:17:14.591 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T05:17:14.591 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T05:17:14.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T05:17:14.731 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default/ 2024-09-12T05:17:14.731 INFO:teuthology.task.install.deb:Package version is 19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:17:14.750 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default/ 2024-09-12T05:17:14.750 INFO:teuthology.task.install.deb:Package version is 19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:17:14.859 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:17:14.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T05:17:14.868 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:17:14.869 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T05:17:14.874 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2024-09-12T05:17:14.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-12T05:17:15.063 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T05:17:15.072 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T05:17:15.090 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T05:17:15.098 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T05:17:15.102 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T05:17:15.120 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T05:17:15.124 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T05:17:15.141 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T05:17:15.147 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T05:17:15.163 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T05:17:15.169 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,424 B] 2024-09-12T05:17:15.169 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T05:17:15.187 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T05:17:15.187 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T05:17:15.193 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,424 B] 2024-09-12T05:17:15.208 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T05:17:15.267 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T05:17:15.346 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T05:17:15.426 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 29.3 kB in 0s (79.3 kB/s) 2024-09-12T05:17:15.545 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 29.3 kB in 0s (60.1 kB/s) 2024-09-12T05:17:16.483 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-09-12T05:17:16.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4883-gd61b0886-1jammy cephadm=19.3.0-4883-gd61b0886-1jammy ceph-mds=19.3.0-4883-gd61b0886-1jammy ceph-mgr=19.3.0-4883-gd61b0886-1jammy ceph-common=19.3.0-4883-gd61b0886-1jammy ceph-fuse=19.3.0-4883-gd61b0886-1jammy ceph-test=19.3.0-4883-gd61b0886-1jammy ceph-volume=19.3.0-4883-gd61b0886-1jammy radosgw=19.3.0-4883-gd61b0886-1jammy python3-rados=19.3.0-4883-gd61b0886-1jammy python3-rgw=19.3.0-4883-gd61b0886-1jammy python3-cephfs=19.3.0-4883-gd61b0886-1jammy python3-rbd=19.3.0-4883-gd61b0886-1jammy libcephfs2=19.3.0-4883-gd61b0886-1jammy libcephfs-dev=19.3.0-4883-gd61b0886-1jammy librados2=19.3.0-4883-gd61b0886-1jammy librbd1=19.3.0-4883-gd61b0886-1jammy rbd-fuse=19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:17:16.515 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T05:17:16.531 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4883-gd61b0886-1jammy cephadm=19.3.0-4883-gd61b0886-1jammy ceph-mds=19.3.0-4883-gd61b0886-1jammy ceph-mgr=19.3.0-4883-gd61b0886-1jammy ceph-common=19.3.0-4883-gd61b0886-1jammy ceph-fuse=19.3.0-4883-gd61b0886-1jammy ceph-test=19.3.0-4883-gd61b0886-1jammy ceph-volume=19.3.0-4883-gd61b0886-1jammy radosgw=19.3.0-4883-gd61b0886-1jammy python3-rados=19.3.0-4883-gd61b0886-1jammy python3-rgw=19.3.0-4883-gd61b0886-1jammy python3-cephfs=19.3.0-4883-gd61b0886-1jammy python3-rbd=19.3.0-4883-gd61b0886-1jammy libcephfs2=19.3.0-4883-gd61b0886-1jammy libcephfs-dev=19.3.0-4883-gd61b0886-1jammy librados2=19.3.0-4883-gd61b0886-1jammy librbd1=19.3.0-4883-gd61b0886-1jammy rbd-fuse=19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:17:16.558 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-09-12T05:17:16.594 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T05:17:16.747 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-09-12T05:17:16.747 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-09-12T05:17:16.803 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-12T05:17:16.804 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-12T05:17:16.938 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T05:17:16.939 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T05:17:16.939 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T05:17:16.939 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T05:17:16.939 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T05:17:16.939 INFO:teuthology.orchestra.run.smithi059.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T05:17:16.940 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T05:17:16.940 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2024-09-12T05:17:16.940 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T05:17:16.940 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T05:17:16.941 INFO:teuthology.orchestra.run.smithi059.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T05:17:16.941 INFO:teuthology.orchestra.run.smithi059.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T05:17:16.941 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T05:17:16.942 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet zip 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T05:17:16.943 INFO:teuthology.orchestra.run.smithi059.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T05:17:16.944 INFO:teuthology.orchestra.run.smithi059.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T05:17:16.944 INFO:teuthology.orchestra.run.smithi059.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T05:17:16.944 INFO:teuthology.orchestra.run.smithi059.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T05:17:16.944 INFO:teuthology.orchestra.run.smithi059.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T05:17:16.944 INFO:teuthology.orchestra.run.smithi059.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T05:17:16.944 INFO:teuthology.orchestra.run.smithi059.stdout:Recommended packages: 2024-09-12T05:17:16.944 INFO:teuthology.orchestra.run.smithi059.stdout: btrfs-tools 2024-09-12T05:17:17.000 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T05:17:17.000 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T05:17:17.001 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T05:17:17.001 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T05:17:17.005 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T05:17:17.005 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T05:17:17.005 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T05:17:17.005 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-09-12T05:17:17.005 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T05:17:17.005 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T05:17:17.006 INFO:teuthology.orchestra.run.smithi194.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T05:17:17.006 INFO:teuthology.orchestra.run.smithi194.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T05:17:17.006 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T05:17:17.006 INFO:teuthology.orchestra.run.smithi194.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T05:17:17.006 INFO:teuthology.orchestra.run.smithi194.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T05:17:17.006 INFO:teuthology.orchestra.run.smithi194.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T05:17:17.007 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T05:17:17.007 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T05:17:17.007 INFO:teuthology.orchestra.run.smithi194.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T05:17:17.007 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T05:17:17.007 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T05:17:17.008 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T05:17:17.008 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T05:17:17.008 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T05:17:17.008 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T05:17:17.008 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T05:17:17.008 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T05:17:17.009 INFO:teuthology.orchestra.run.smithi194.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T05:17:17.009 INFO:teuthology.orchestra.run.smithi194.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T05:17:17.009 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T05:17:17.009 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T05:17:17.009 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet zip 2024-09-12T05:17:17.010 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-09-12T05:17:17.010 INFO:teuthology.orchestra.run.smithi194.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T05:17:17.010 INFO:teuthology.orchestra.run.smithi194.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T05:17:17.010 INFO:teuthology.orchestra.run.smithi194.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T05:17:17.010 INFO:teuthology.orchestra.run.smithi194.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T05:17:17.010 INFO:teuthology.orchestra.run.smithi194.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T05:17:17.011 INFO:teuthology.orchestra.run.smithi194.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T05:17:17.011 INFO:teuthology.orchestra.run.smithi194.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T05:17:17.011 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-09-12T05:17:17.011 INFO:teuthology.orchestra.run.smithi194.stdout: btrfs-tools 2024-09-12T05:17:17.052 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2024-09-12T05:17:17.053 INFO:teuthology.orchestra.run.smithi059.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T05:17:17.053 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T05:17:17.053 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T05:17:17.053 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T05:17:17.053 INFO:teuthology.orchestra.run.smithi059.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T05:17:17.053 INFO:teuthology.orchestra.run.smithi059.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T05:17:17.053 INFO:teuthology.orchestra.run.smithi059.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T05:17:17.054 INFO:teuthology.orchestra.run.smithi059.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T05:17:17.054 INFO:teuthology.orchestra.run.smithi059.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T05:17:17.054 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T05:17:17.054 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T05:17:17.054 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T05:17:17.054 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T05:17:17.054 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T05:17:17.055 INFO:teuthology.orchestra.run.smithi059.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T05:17:17.108 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-09-12T05:17:17.108 INFO:teuthology.orchestra.run.smithi194.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T05:17:17.109 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T05:17:17.109 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T05:17:17.109 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T05:17:17.109 INFO:teuthology.orchestra.run.smithi194.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T05:17:17.109 INFO:teuthology.orchestra.run.smithi194.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T05:17:17.110 INFO:teuthology.orchestra.run.smithi194.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T05:17:17.110 INFO:teuthology.orchestra.run.smithi194.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T05:17:17.110 INFO:teuthology.orchestra.run.smithi194.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T05:17:17.110 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T05:17:17.110 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T05:17:17.110 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T05:17:17.110 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T05:17:17.110 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T05:17:17.111 INFO:teuthology.orchestra.run.smithi194.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T05:17:17.197 INFO:teuthology.orchestra.run.smithi059.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T05:17:17.197 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 251 MB of archives. 2024-09-12T05:17:17.197 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T05:17:17.197 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4883-gd61b0886-1jammy [3,634 kB] 2024-09-12T05:17:17.241 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T05:17:17.252 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T05:17:17.252 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 251 MB of archives. 2024-09-12T05:17:17.252 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T05:17:17.252 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4883-gd61b0886-1jammy [3,634 kB] 2024-09-12T05:17:17.298 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T05:17:17.393 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4883-gd61b0886-1jammy [3,336 kB] 2024-09-12T05:17:17.462 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4883-gd61b0886-1jammy [722 kB] 2024-09-12T05:17:17.462 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4883-gd61b0886-1jammy [3,336 kB] 2024-09-12T05:17:17.487 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4883-gd61b0886-1jammy [356 kB] 2024-09-12T05:17:17.494 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4883-gd61b0886-1jammy [32.8 kB] 2024-09-12T05:17:17.496 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4883-gd61b0886-1jammy [180 kB] 2024-09-12T05:17:17.499 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4883-gd61b0886-1jammy [71.3 kB] 2024-09-12T05:17:17.501 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4883-gd61b0886-1jammy [340 kB] 2024-09-12T05:17:17.521 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4883-gd61b0886-1jammy [7,987 kB] 2024-09-12T05:17:17.577 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4883-gd61b0886-1jammy [722 kB] 2024-09-12T05:17:17.591 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4883-gd61b0886-1jammy [356 kB] 2024-09-12T05:17:17.599 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4883-gd61b0886-1jammy [32.8 kB] 2024-09-12T05:17:17.600 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4883-gd61b0886-1jammy [180 kB] 2024-09-12T05:17:17.621 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4883-gd61b0886-1jammy [71.3 kB] 2024-09-12T05:17:17.623 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4883-gd61b0886-1jammy [340 kB] 2024-09-12T05:17:17.630 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4883-gd61b0886-1jammy [7,987 kB] 2024-09-12T05:17:17.664 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T05:17:17.676 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T05:17:17.718 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T05:17:17.730 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T05:17:17.757 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T05:17:17.763 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4883-gd61b0886-1jammy [112 kB] 2024-09-12T05:17:17.765 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4883-gd61b0886-1jammy [473 kB] 2024-09-12T05:17:17.783 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4883-gd61b0886-1jammy [28.3 MB] 2024-09-12T05:17:17.812 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T05:17:17.901 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4883-gd61b0886-1jammy [112 kB] 2024-09-12T05:17:17.924 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4883-gd61b0886-1jammy [473 kB] 2024-09-12T05:17:17.935 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4883-gd61b0886-1jammy [28.3 MB] 2024-09-12T05:17:17.988 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T05:17:17.996 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T05:17:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T05:17:18.035 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T05:17:18.037 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T05:17:18.038 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T05:17:18.039 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T05:17:18.040 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T05:17:18.051 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T05:17:18.057 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T05:17:18.061 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T05:17:18.067 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T05:17:18.081 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T05:17:18.089 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T05:17:18.092 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T05:17:18.093 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T05:17:18.094 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T05:17:18.111 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T05:17:18.116 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T05:17:18.122 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T05:17:18.147 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T05:17:18.148 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T05:17:18.152 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T05:17:18.157 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T05:17:18.161 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T05:17:18.163 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T05:17:18.163 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T05:17:18.165 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T05:17:18.166 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T05:17:18.202 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T05:17:18.203 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T05:17:18.207 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T05:17:18.211 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T05:17:18.215 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T05:17:18.216 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T05:17:18.216 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T05:17:18.218 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T05:17:18.219 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T05:17:18.230 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T05:17:18.248 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T05:17:18.249 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T05:17:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T05:17:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T05:17:18.256 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T05:17:18.285 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T05:17:18.301 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T05:17:18.302 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T05:17:18.303 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T05:17:18.304 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T05:17:18.309 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T05:17:18.310 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T05:17:18.311 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T05:17:18.312 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T05:17:18.313 INFO:teuthology.orchestra.run.smithi059.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T05:17:18.315 INFO:teuthology.orchestra.run.smithi059.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T05:17:18.367 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T05:17:18.367 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T05:17:18.369 INFO:teuthology.orchestra.run.smithi194.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T05:17:18.392 INFO:teuthology.orchestra.run.smithi059.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T05:17:18.393 INFO:teuthology.orchestra.run.smithi059.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T05:17:18.395 INFO:teuthology.orchestra.run.smithi059.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T05:17:18.397 INFO:teuthology.orchestra.run.smithi059.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T05:17:18.398 INFO:teuthology.orchestra.run.smithi059.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T05:17:18.448 INFO:teuthology.orchestra.run.smithi194.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T05:17:18.448 INFO:teuthology.orchestra.run.smithi194.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T05:17:18.451 INFO:teuthology.orchestra.run.smithi194.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T05:17:18.453 INFO:teuthology.orchestra.run.smithi194.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T05:17:18.453 INFO:teuthology.orchestra.run.smithi194.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T05:17:18.465 INFO:teuthology.orchestra.run.smithi194.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T05:17:18.474 INFO:teuthology.orchestra.run.smithi059.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T05:17:18.474 INFO:teuthology.orchestra.run.smithi059.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T05:17:18.475 INFO:teuthology.orchestra.run.smithi059.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T05:17:18.477 INFO:teuthology.orchestra.run.smithi059.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T05:17:18.479 INFO:teuthology.orchestra.run.smithi059.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T05:17:18.529 INFO:teuthology.orchestra.run.smithi194.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T05:17:18.530 INFO:teuthology.orchestra.run.smithi194.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T05:17:18.531 INFO:teuthology.orchestra.run.smithi194.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T05:17:18.534 INFO:teuthology.orchestra.run.smithi194.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T05:17:18.555 INFO:teuthology.orchestra.run.smithi059.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T05:17:18.557 INFO:teuthology.orchestra.run.smithi059.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T05:17:18.560 INFO:teuthology.orchestra.run.smithi059.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T05:17:18.562 INFO:teuthology.orchestra.run.smithi059.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T05:17:18.567 INFO:teuthology.orchestra.run.smithi059.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T05:17:18.611 INFO:teuthology.orchestra.run.smithi194.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T05:17:18.613 INFO:teuthology.orchestra.run.smithi194.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T05:17:18.616 INFO:teuthology.orchestra.run.smithi194.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T05:17:18.617 INFO:teuthology.orchestra.run.smithi194.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T05:17:18.622 INFO:teuthology.orchestra.run.smithi194.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T05:17:18.623 INFO:teuthology.orchestra.run.smithi194.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T05:17:18.637 INFO:teuthology.orchestra.run.smithi059.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T05:17:18.638 INFO:teuthology.orchestra.run.smithi059.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T05:17:18.643 INFO:teuthology.orchestra.run.smithi059.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T05:17:18.693 INFO:teuthology.orchestra.run.smithi194.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T05:17:18.697 INFO:teuthology.orchestra.run.smithi194.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T05:17:18.804 INFO:teuthology.orchestra.run.smithi059.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4883-gd61b0886-1jammy [5,207 kB] 2024-09-12T05:17:18.805 INFO:teuthology.orchestra.run.smithi059.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T05:17:18.808 INFO:teuthology.orchestra.run.smithi059.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T05:17:18.811 INFO:teuthology.orchestra.run.smithi059.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T05:17:18.811 INFO:teuthology.orchestra.run.smithi059.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T05:17:18.814 INFO:teuthology.orchestra.run.smithi059.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T05:17:18.851 INFO:teuthology.orchestra.run.smithi059.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T05:17:18.854 INFO:teuthology.orchestra.run.smithi059.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T05:17:18.855 INFO:teuthology.orchestra.run.smithi059.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T05:17:18.887 INFO:teuthology.orchestra.run.smithi059.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4883-gd61b0886-1jammy [251 kB] 2024-09-12T05:17:18.890 INFO:teuthology.orchestra.run.smithi059.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4883-gd61b0886-1jammy [124 kB] 2024-09-12T05:17:18.891 INFO:teuthology.orchestra.run.smithi059.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4883-gd61b0886-1jammy [1,562 kB] 2024-09-12T05:17:18.914 INFO:teuthology.orchestra.run.smithi059.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T05:17:18.915 INFO:teuthology.orchestra.run.smithi059.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T05:17:18.930 INFO:teuthology.orchestra.run.smithi059.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4883-gd61b0886-1jammy [6,309 kB] 2024-09-12T05:17:18.964 INFO:teuthology.orchestra.run.smithi194.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T05:17:18.965 INFO:teuthology.orchestra.run.smithi194.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4883-gd61b0886-1jammy [5,207 kB] 2024-09-12T05:17:18.972 INFO:teuthology.orchestra.run.smithi059.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T05:17:18.973 INFO:teuthology.orchestra.run.smithi059.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T05:17:18.974 INFO:teuthology.orchestra.run.smithi059.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T05:17:18.975 INFO:teuthology.orchestra.run.smithi059.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T05:17:18.976 INFO:teuthology.orchestra.run.smithi059.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T05:17:18.977 INFO:teuthology.orchestra.run.smithi059.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T05:17:18.985 INFO:teuthology.orchestra.run.smithi059.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T05:17:19.035 INFO:teuthology.orchestra.run.smithi194.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T05:17:19.038 INFO:teuthology.orchestra.run.smithi194.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T05:17:19.039 INFO:teuthology.orchestra.run.smithi194.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T05:17:19.041 INFO:teuthology.orchestra.run.smithi194.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T05:17:19.053 INFO:teuthology.orchestra.run.smithi059.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T05:17:19.057 INFO:teuthology.orchestra.run.smithi059.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T05:17:19.058 INFO:teuthology.orchestra.run.smithi059.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T05:17:19.078 INFO:teuthology.orchestra.run.smithi194.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4883-gd61b0886-1jammy [251 kB] 2024-09-12T05:17:19.084 INFO:teuthology.orchestra.run.smithi194.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4883-gd61b0886-1jammy [124 kB] 2024-09-12T05:17:19.086 INFO:teuthology.orchestra.run.smithi194.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T05:17:19.089 INFO:teuthology.orchestra.run.smithi194.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4883-gd61b0886-1jammy [1,562 kB] 2024-09-12T05:17:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T05:17:19.091 INFO:teuthology.orchestra.run.smithi194.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T05:17:19.104 INFO:teuthology.orchestra.run.smithi059.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4883-gd61b0886-1jammy [23.1 MB] 2024-09-12T05:17:19.131 INFO:teuthology.orchestra.run.smithi194.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T05:17:19.132 INFO:teuthology.orchestra.run.smithi194.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T05:17:19.135 INFO:teuthology.orchestra.run.smithi059.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T05:17:19.140 INFO:teuthology.orchestra.run.smithi194.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4883-gd61b0886-1jammy [6,309 kB] 2024-09-12T05:17:19.141 INFO:teuthology.orchestra.run.smithi059.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T05:17:19.143 INFO:teuthology.orchestra.run.smithi059.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T05:17:19.145 INFO:teuthology.orchestra.run.smithi059.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T05:17:19.156 INFO:teuthology.orchestra.run.smithi059.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T05:17:19.157 INFO:teuthology.orchestra.run.smithi059.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T05:17:19.165 INFO:teuthology.orchestra.run.smithi059.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T05:17:19.200 INFO:teuthology.orchestra.run.smithi194.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T05:17:19.201 INFO:teuthology.orchestra.run.smithi194.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T05:17:19.202 INFO:teuthology.orchestra.run.smithi194.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T05:17:19.203 INFO:teuthology.orchestra.run.smithi194.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T05:17:19.204 INFO:teuthology.orchestra.run.smithi194.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T05:17:19.205 INFO:teuthology.orchestra.run.smithi194.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T05:17:19.212 INFO:teuthology.orchestra.run.smithi194.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T05:17:19.216 INFO:teuthology.orchestra.run.smithi059.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T05:17:19.217 INFO:teuthology.orchestra.run.smithi059.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T05:17:19.218 INFO:teuthology.orchestra.run.smithi059.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T05:17:19.281 INFO:teuthology.orchestra.run.smithi194.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T05:17:19.285 INFO:teuthology.orchestra.run.smithi194.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T05:17:19.286 INFO:teuthology.orchestra.run.smithi194.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T05:17:19.297 INFO:teuthology.orchestra.run.smithi059.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T05:17:19.299 INFO:teuthology.orchestra.run.smithi059.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T05:17:19.316 INFO:teuthology.orchestra.run.smithi059.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T05:17:19.317 INFO:teuthology.orchestra.run.smithi059.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T05:17:19.318 INFO:teuthology.orchestra.run.smithi059.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T05:17:19.323 INFO:teuthology.orchestra.run.smithi059.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T05:17:19.325 INFO:teuthology.orchestra.run.smithi059.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T05:17:19.362 INFO:teuthology.orchestra.run.smithi194.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T05:17:19.368 INFO:teuthology.orchestra.run.smithi194.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4883-gd61b0886-1jammy [23.1 MB] 2024-09-12T05:17:19.369 INFO:teuthology.orchestra.run.smithi194.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T05:17:19.372 INFO:teuthology.orchestra.run.smithi194.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T05:17:19.373 INFO:teuthology.orchestra.run.smithi194.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T05:17:19.384 INFO:teuthology.orchestra.run.smithi194.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T05:17:19.386 INFO:teuthology.orchestra.run.smithi194.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T05:17:19.393 INFO:teuthology.orchestra.run.smithi194.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T05:17:19.444 INFO:teuthology.orchestra.run.smithi194.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T05:17:19.445 INFO:teuthology.orchestra.run.smithi194.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T05:17:19.446 INFO:teuthology.orchestra.run.smithi194.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T05:17:19.525 INFO:teuthology.orchestra.run.smithi194.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T05:17:19.528 INFO:teuthology.orchestra.run.smithi194.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T05:17:19.547 INFO:teuthology.orchestra.run.smithi194.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T05:17:19.548 INFO:teuthology.orchestra.run.smithi194.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T05:17:19.548 INFO:teuthology.orchestra.run.smithi194.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T05:17:19.554 INFO:teuthology.orchestra.run.smithi194.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T05:17:19.556 INFO:teuthology.orchestra.run.smithi194.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T05:17:19.884 INFO:teuthology.orchestra.run.smithi059.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4883-gd61b0886-1jammy [14.1 kB] 2024-09-12T05:17:19.885 INFO:teuthology.orchestra.run.smithi059.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4883-gd61b0886-1jammy [880 kB] 2024-09-12T05:17:19.902 INFO:teuthology.orchestra.run.smithi059.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4883-gd61b0886-1jammy [2,454 kB] 2024-09-12T05:17:19.944 INFO:teuthology.orchestra.run.smithi059.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4883-gd61b0886-1jammy [814 kB] 2024-09-12T05:17:19.954 INFO:teuthology.orchestra.run.smithi059.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4883-gd61b0886-1jammy [160 kB] 2024-09-12T05:17:19.956 INFO:teuthology.orchestra.run.smithi059.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4883-gd61b0886-1jammy [61.5 MB] 2024-09-12T05:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4883-gd61b0886-1jammy [14.1 kB] 2024-09-12T05:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4883-gd61b0886-1jammy [880 kB] 2024-09-12T05:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4883-gd61b0886-1jammy [2,454 kB] 2024-09-12T05:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4883-gd61b0886-1jammy [814 kB] 2024-09-12T05:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4883-gd61b0886-1jammy [160 kB] 2024-09-12T05:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4883-gd61b0886-1jammy [61.5 MB] 2024-09-12T05:17:22.071 INFO:teuthology.orchestra.run.smithi059.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4883-gd61b0886-1jammy [8,625 kB] 2024-09-12T05:17:22.261 INFO:teuthology.orchestra.run.smithi059.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4883-gd61b0886-1jammy [14.2 kB] 2024-09-12T05:17:22.262 INFO:teuthology.orchestra.run.smithi059.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4883-gd61b0886-1jammy [55.8 MB] 2024-09-12T05:17:22.553 INFO:teuthology.orchestra.run.smithi194.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4883-gd61b0886-1jammy [8,625 kB] 2024-09-12T05:17:22.757 INFO:teuthology.orchestra.run.smithi194.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4883-gd61b0886-1jammy [14.2 kB] 2024-09-12T05:17:22.757 INFO:teuthology.orchestra.run.smithi194.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4883-gd61b0886-1jammy [55.8 MB] 2024-09-12T05:17:24.125 INFO:teuthology.orchestra.run.smithi059.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4883-gd61b0886-1jammy [130 kB] 2024-09-12T05:17:24.128 INFO:teuthology.orchestra.run.smithi059.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4883-gd61b0886-1jammy [39.0 kB] 2024-09-12T05:17:24.129 INFO:teuthology.orchestra.run.smithi059.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4883-gd61b0886-1jammy [15.9 MB] 2024-09-12T05:17:24.629 INFO:teuthology.orchestra.run.smithi059.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4883-gd61b0886-1jammy [91.2 kB] 2024-09-12T05:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4883-gd61b0886-1jammy [130 kB] 2024-09-12T05:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4883-gd61b0886-1jammy [39.0 kB] 2024-09-12T05:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4883-gd61b0886-1jammy [15.9 MB] 2024-09-12T05:17:25.026 INFO:teuthology.orchestra.run.smithi194.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/d61b08865d4d98738f45ff2e4806d7fb6d03eca1/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4883-gd61b0886-1jammy [91.2 kB] 2024-09-12T05:17:25.224 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 251 MB in 8s (33.2 MB/s) 2024-09-12T05:17:25.379 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T05:17:25.481 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T05:17:25.487 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T05:17:25.569 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T05:17:25.614 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 251 MB in 8s (31.8 MB/s) 2024-09-12T05:17:25.752 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T05:17:25.851 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T05:17:25.857 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T05:17:25.906 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T05:17:25.933 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T05:17:25.942 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T05:17:25.973 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T05:17:26.258 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T05:17:26.276 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T05:17:26.279 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T05:17:26.302 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T05:17:26.320 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T05:17:26.342 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T05:17:26.648 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T05:17:26.674 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T05:17:26.714 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T05:17:26.779 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T05:17:26.806 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T05:17:26.854 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:17:27.151 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T05:17:27.177 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T05:17:27.207 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T05:17:27.226 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:17:27.234 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T05:17:27.293 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:17:27.579 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T05:17:27.605 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T05:17:27.635 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T05:17:27.637 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:17:27.662 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T05:17:27.702 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:17:27.974 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T05:17:28.000 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T05:17:28.040 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:17:28.046 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T05:17:28.073 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T05:17:28.113 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T05:17:28.450 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librados2. 2024-09-12T05:17:28.476 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../007-librados2_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:28.516 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librados2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:28.577 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T05:17:28.603 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T05:17:28.643 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T05:17:28.944 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libnbd0. 2024-09-12T05:17:28.955 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librados2. 2024-09-12T05:17:28.971 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T05:17:28.981 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../007-librados2_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:29.010 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T05:17:29.020 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librados2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:29.313 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librbd1. 2024-09-12T05:17:29.340 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../009-librbd1_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:29.380 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librbd1 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:29.492 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libnbd0. 2024-09-12T05:17:29.519 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T05:17:29.559 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T05:17:29.824 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T05:17:29.851 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:29.861 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librbd1. 2024-09-12T05:17:29.888 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../009-librbd1_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:29.899 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:29.928 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librbd1 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:30.177 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rados. 2024-09-12T05:17:30.204 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:30.244 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rados (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:30.347 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T05:17:30.370 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:30.405 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:30.571 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T05:17:30.598 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:17:30.638 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-argparse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:30.658 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rados. 2024-09-12T05:17:30.677 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:30.716 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rados (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:30.891 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T05:17:30.917 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:30.957 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cephfs (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:31.036 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T05:17:31.062 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:17:31.102 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-argparse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:31.235 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T05:17:31.251 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:17:31.293 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-common (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:31.354 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T05:17:31.381 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:31.421 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cephfs (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:31.613 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T05:17:31.640 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T05:17:31.679 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T05:17:31.707 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T05:17:31.733 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:17:31.784 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-common (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:32.032 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T05:17:32.059 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T05:17:32.077 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T05:17:32.100 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T05:17:32.103 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T05:17:32.135 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T05:17:32.351 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T05:17:32.367 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:32.401 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rbd (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:32.437 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T05:17:32.464 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T05:17:32.504 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T05:17:32.713 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T05:17:32.740 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T05:17:32.756 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T05:17:32.779 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T05:17:32.782 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:32.823 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rbd (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:33.048 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T05:17:33.064 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T05:17:33.107 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T05:17:33.168 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T05:17:33.194 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T05:17:33.234 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T05:17:33.451 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T05:17:33.468 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T05:17:33.470 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T05:17:33.485 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T05:17:33.510 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T05:17:33.519 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T05:17:33.988 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua5.1. 2024-09-12T05:17:34.004 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T05:17:34.038 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T05:17:34.256 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T05:17:34.283 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T05:17:34.322 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T05:17:34.341 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-any. 2024-09-12T05:17:34.357 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T05:17:34.399 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T05:17:34.635 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package zip. 2024-09-12T05:17:34.651 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua5.1. 2024-09-12T05:17:34.651 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T05:17:34.677 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T05:17:34.693 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T05:17:34.717 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T05:17:34.980 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package unzip. 2024-09-12T05:17:35.007 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T05:17:35.012 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-any. 2024-09-12T05:17:35.027 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T05:17:35.047 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T05:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T05:17:35.322 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package zip. 2024-09-12T05:17:35.338 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T05:17:35.381 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T05:17:35.417 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package luarocks. 2024-09-12T05:17:35.444 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T05:17:35.484 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T05:17:35.684 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package unzip. 2024-09-12T05:17:35.710 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T05:17:35.742 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T05:17:35.875 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librgw2. 2024-09-12T05:17:35.902 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../026-librgw2_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:35.941 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librgw2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:36.129 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package luarocks. 2024-09-12T05:17:36.155 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T05:17:36.197 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T05:17:36.552 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T05:17:36.570 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librgw2. 2024-09-12T05:17:36.579 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:36.596 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../026-librgw2_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:36.618 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rgw (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:36.636 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librgw2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:36.905 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T05:17:36.932 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T05:17:36.971 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T05:17:37.230 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T05:17:37.256 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:37.257 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T05:17:37.285 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:37.296 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rgw (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:37.324 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libradosstriper1 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:37.608 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T05:17:37.634 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T05:17:37.666 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T05:17:37.761 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-common. 2024-09-12T05:17:37.788 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:37.827 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-common (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:37.968 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T05:17:37.995 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:38.035 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libradosstriper1 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:38.471 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-common. 2024-09-12T05:17:38.498 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:38.538 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-common (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:39.374 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-base. 2024-09-12T05:17:39.402 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:39.442 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-base (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:40.010 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-base. 2024-09-12T05:17:40.036 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:40.037 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T05:17:40.065 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T05:17:40.085 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-base (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:40.103 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T05:17:40.393 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T05:17:40.417 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T05:17:40.481 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T05:17:40.639 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T05:17:40.665 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T05:17:40.705 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T05:17:40.809 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T05:17:40.837 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T05:17:40.876 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T05:17:41.008 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T05:17:41.034 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T05:17:41.074 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T05:17:41.145 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T05:17:41.173 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T05:17:41.203 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T05:17:41.419 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T05:17:41.446 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T05:17:41.486 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T05:17:41.490 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T05:17:41.517 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T05:17:41.556 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T05:17:41.738 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T05:17:41.754 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T05:17:41.796 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T05:17:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T05:17:41.895 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T05:17:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T05:17:42.091 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T05:17:42.117 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T05:17:42.157 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T05:17:42.237 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-portend. 2024-09-12T05:17:42.264 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T05:17:42.304 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T05:17:42.460 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T05:17:42.487 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T05:17:42.527 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T05:17:42.540 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T05:17:42.556 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T05:17:42.598 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T05:17:42.804 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-portend. 2024-09-12T05:17:42.831 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T05:17:42.887 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T05:17:42.901 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T05:17:42.928 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T05:17:42.968 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T05:17:43.157 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T05:17:43.183 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T05:17:43.223 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T05:17:43.279 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T05:17:43.307 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T05:17:43.338 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T05:17:43.526 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T05:17:43.553 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T05:17:43.593 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T05:17:43.632 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T05:17:43.659 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T05:17:43.699 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T05:17:43.938 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T05:17:43.965 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T05:17:44.002 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T05:17:44.004 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T05:17:44.029 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T05:17:44.068 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T05:17:44.282 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T05:17:44.309 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T05:17:44.357 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T05:17:44.421 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-mako. 2024-09-12T05:17:44.449 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T05:17:44.488 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T05:17:44.660 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T05:17:44.687 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T05:17:44.726 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T05:17:44.818 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T05:17:44.845 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T05:17:44.884 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T05:17:45.171 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-mako. 2024-09-12T05:17:45.177 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T05:17:45.197 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T05:17:45.204 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T05:17:45.237 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T05:17:45.243 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T05:17:45.546 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webob. 2024-09-12T05:17:45.565 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T05:17:45.574 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T05:17:45.592 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T05:17:45.613 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T05:17:45.641 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T05:17:45.910 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T05:17:45.925 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T05:17:45.958 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T05:17:45.960 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T05:17:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T05:17:46.028 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T05:17:46.254 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webob. 2024-09-12T05:17:46.281 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T05:17:46.320 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T05:17:46.321 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T05:17:46.346 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T05:17:46.411 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T05:17:46.673 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T05:17:46.700 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T05:17:46.713 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-paste. 2024-09-12T05:17:46.740 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T05:17:46.743 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T05:17:46.780 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T05:17:47.058 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T05:17:47.060 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T05:17:47.074 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T05:17:47.086 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T05:17:47.116 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T05:17:47.126 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T05:17:47.419 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T05:17:47.446 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T05:17:47.454 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-paste. 2024-09-12T05:17:47.481 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T05:17:47.486 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T05:17:47.520 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T05:17:47.797 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T05:17:47.824 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T05:17:47.849 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T05:17:47.863 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T05:17:47.875 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T05:17:47.915 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T05:17:48.142 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T05:17:48.169 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T05:17:48.200 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T05:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T05:17:48.253 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T05:17:48.293 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T05:17:48.562 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T05:17:48.589 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T05:17:48.620 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T05:17:48.915 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T05:17:48.941 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T05:17:48.981 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T05:17:49.303 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T05:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T05:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T05:17:49.497 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T05:17:49.525 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T05:17:49.563 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T05:17:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-idna. 2024-09-12T05:17:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T05:17:49.738 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T05:17:49.883 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-idna. 2024-09-12T05:17:49.910 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T05:17:49.949 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T05:17:50.067 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T05:17:50.093 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T05:17:50.133 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T05:17:50.219 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T05:17:50.235 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T05:17:50.277 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T05:17:50.564 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests. 2024-09-12T05:17:50.580 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T05:17:50.622 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T05:17:50.933 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T05:17:50.961 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T05:17:51.000 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T05:17:51.303 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T05:17:51.311 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests. 2024-09-12T05:17:51.330 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:17:51.338 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T05:17:51.369 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:51.377 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T05:17:51.680 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T05:17:51.707 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T05:17:51.747 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T05:17:51.749 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T05:17:51.777 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:51.816 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:52.033 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T05:17:52.060 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:17:52.085 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T05:17:52.099 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:52.113 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T05:17:52.152 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T05:17:52.455 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T05:17:52.479 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T05:17:52.482 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T05:17:52.506 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:52.521 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T05:17:52.545 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:52.848 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T05:17:52.849 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T05:17:52.875 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T05:17:52.877 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:52.915 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T05:17:52.915 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:53.218 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T05:17:53.244 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T05:17:53.269 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T05:17:53.284 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T05:17:53.297 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:53.327 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mon (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:53.587 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T05:17:53.614 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:53.653 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:53.939 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T05:17:53.967 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:54.005 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-osd (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:54.023 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T05:17:54.050 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:54.089 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mon (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:54.752 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T05:17:54.778 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:54.818 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-osd (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:55.092 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph. 2024-09-12T05:17:55.108 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../067-ceph_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:55.150 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:55.413 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T05:17:55.429 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:55.463 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-fuse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:55.825 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T05:17:55.846 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph. 2024-09-12T05:17:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:55.861 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../067-ceph_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:55.891 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mds (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:55.904 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:56.190 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T05:17:56.217 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:56.248 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-fuse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:56.294 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephadm. 2024-09-12T05:17:56.321 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../070-cephadm_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:56.360 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephadm (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:56.601 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T05:17:56.628 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:56.667 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mds (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:56.671 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T05:17:56.699 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T05:17:56.729 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T05:17:57.057 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T05:17:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T05:17:57.087 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package cephadm. 2024-09-12T05:17:57.114 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../070-cephadm_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:17:57.115 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T05:17:57.153 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking cephadm (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:57.464 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T05:17:57.492 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T05:17:57.531 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T05:17:57.842 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T05:17:57.858 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T05:17:57.900 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T05:17:58.145 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-babel. 2024-09-12T05:17:58.173 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T05:17:58.220 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T05:17:58.540 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T05:17:58.568 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T05:17:58.606 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T05:17:58.913 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-babel. 2024-09-12T05:17:58.941 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T05:17:58.959 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T05:17:58.979 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T05:17:58.987 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:17:59.030 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:17:59.299 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T05:17:59.321 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T05:17:59.326 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T05:17:59.338 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T05:17:59.365 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T05:17:59.379 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T05:17:59.690 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-routes. 2024-09-12T05:17:59.710 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T05:17:59.718 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T05:17:59.726 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:17:59.757 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T05:17:59.768 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:00.077 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T05:18:00.105 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:18:00.138 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T05:18:00.143 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:00.151 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T05:18:00.196 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T05:18:00.499 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-routes. 2024-09-12T05:18:00.526 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T05:18:00.565 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T05:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T05:18:00.929 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:18:00.968 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:02.990 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T05:18:03.008 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T05:18:03.048 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T05:18:03.551 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T05:18:03.579 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T05:18:03.618 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T05:18:03.681 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T05:18:03.699 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T05:18:03.739 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T05:18:03.980 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T05:18:04.008 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T05:18:04.046 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T05:18:04.268 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T05:18:04.295 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T05:18:04.334 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T05:18:04.349 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T05:18:04.377 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T05:18:04.501 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T05:18:04.696 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T05:18:04.724 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T05:18:04.762 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T05:18:05.048 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T05:18:05.075 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T05:18:05.192 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T05:18:05.410 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T05:18:05.439 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:18:05.477 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:06.162 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T05:18:06.190 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:18:06.227 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:06.464 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T05:18:06.492 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T05:18:06.530 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T05:18:06.825 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T05:18:06.853 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T05:18:06.883 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T05:18:07.128 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T05:18:07.156 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T05:18:07.164 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T05:18:07.192 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T05:18:07.194 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T05:18:07.230 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T05:18:07.475 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T05:18:07.491 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T05:18:07.497 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T05:18:07.524 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T05:18:07.525 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T05:18:07.564 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T05:18:07.853 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T05:18:07.881 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T05:18:07.901 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T05:18:07.919 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T05:18:07.929 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T05:18:07.967 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T05:18:08.231 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T05:18:08.258 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T05:18:08.270 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T05:18:08.297 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T05:18:08.298 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T05:18:08.337 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T05:18:08.590 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T05:18:08.600 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T05:18:08.618 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T05:18:08.628 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T05:18:08.656 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T05:18:08.658 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T05:18:08.954 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T05:18:08.976 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T05:18:08.982 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T05:18:09.004 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T05:18:09.020 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T05:18:09.043 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T05:18:09.348 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T05:18:09.376 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T05:18:09.414 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T05:18:09.673 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T05:18:09.690 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:18:09.726 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T05:18:09.731 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:09.754 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T05:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T05:18:10.060 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T05:18:10.088 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T05:18:10.126 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T05:18:10.387 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T05:18:10.405 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T05:18:10.431 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T05:18:10.437 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T05:18:10.448 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:18:10.489 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:10.690 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package jq. 2024-09-12T05:18:10.718 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T05:18:10.756 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T05:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T05:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T05:18:10.883 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T05:18:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package socat. 2024-09-12T05:18:11.042 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T05:18:11.083 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T05:18:11.178 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T05:18:11.206 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T05:18:11.236 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T05:18:11.387 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T05:18:11.403 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T05:18:11.445 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T05:18:11.497 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package jq. 2024-09-12T05:18:11.525 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T05:18:11.563 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T05:18:11.808 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-test. 2024-09-12T05:18:11.816 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package socat. 2024-09-12T05:18:11.836 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:18:11.844 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T05:18:11.874 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-test (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:11.882 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T05:18:12.194 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T05:18:12.210 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T05:18:12.252 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T05:18:12.598 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-test. 2024-09-12T05:18:12.626 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:18:12.664 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-test (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:14.345 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T05:18:14.373 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:18:14.411 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-volume (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:14.691 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T05:18:14.708 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:18:14.749 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs-dev (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:15.068 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T05:18:15.097 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T05:18:15.102 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T05:18:15.130 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4883-gd61b0886-1jammy_all.deb ... 2024-09-12T05:18:15.134 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T05:18:15.168 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-volume (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:15.464 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T05:18:15.481 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T05:18:15.505 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T05:18:15.522 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:18:15.522 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T05:18:15.563 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs-dev (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:15.876 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T05:18:15.883 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T05:18:15.905 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T05:18:15.910 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T05:18:15.943 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T05:18:15.949 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T05:18:16.271 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T05:18:16.298 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T05:18:16.337 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T05:18:16.348 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package pkg-config. 2024-09-12T05:18:16.377 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T05:18:16.414 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T05:18:16.649 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T05:18:16.651 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T05:18:16.669 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T05:18:16.677 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T05:18:16.707 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T05:18:16.709 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T05:18:17.087 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package pkg-config. 2024-09-12T05:18:17.116 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T05:18:17.120 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T05:18:17.149 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T05:18:17.153 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T05:18:17.187 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T05:18:17.398 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T05:18:17.414 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T05:18:17.456 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T05:18:17.490 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T05:18:17.518 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T05:18:17.556 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T05:18:17.834 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T05:18:17.842 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T05:18:17.851 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T05:18:17.859 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T05:18:17.884 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T05:18:17.892 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T05:18:18.187 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T05:18:18.187 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T05:18:18.215 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T05:18:18.216 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T05:18:18.253 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T05:18:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T05:18:18.598 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T05:18:18.599 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-py. 2024-09-12T05:18:18.627 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T05:18:18.627 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T05:18:18.665 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T05:18:18.665 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T05:18:18.985 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T05:18:18.992 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T05:18:19.014 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T05:18:19.020 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T05:18:19.051 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T05:18:19.058 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T05:18:19.412 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-py. 2024-09-12T05:18:19.440 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T05:18:19.486 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T05:18:19.488 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T05:18:19.517 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T05:18:19.555 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T05:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T05:18:19.834 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T05:18:19.850 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-toml. 2024-09-12T05:18:19.873 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T05:18:19.878 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T05:18:19.916 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T05:18:20.144 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T05:18:20.172 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T05:18:20.202 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T05:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T05:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T05:18:20.393 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T05:18:20.547 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T05:18:20.576 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T05:18:20.622 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T05:18:20.687 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-toml. 2024-09-12T05:18:20.715 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T05:18:20.754 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T05:18:20.874 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T05:18:20.891 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T05:18:20.933 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T05:18:21.040 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T05:18:21.068 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T05:18:21.106 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T05:18:21.687 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package radosgw. 2024-09-12T05:18:21.716 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../117-radosgw_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:18:21.753 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking radosgw (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:21.768 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T05:18:21.796 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T05:18:21.834 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T05:18:22.095 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T05:18:22.124 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T05:18:22.162 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T05:18:22.706 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T05:18:22.723 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:18:22.756 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking rbd-fuse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:22.865 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package radosgw. 2024-09-12T05:18:22.894 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../117-radosgw_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:18:22.932 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking radosgw (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:23.045 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T05:18:23.303 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T05:18:23.404 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T05:18:23.653 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T05:18:23.809 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T05:18:23.826 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4883-gd61b0886-1jammy_amd64.deb ... 2024-09-12T05:18:23.868 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking rbd-fuse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:23.995 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T05:18:24.156 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T05:18:24.389 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T05:18:24.393 INFO:teuthology.orchestra.run.smithi059.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T05:18:24.473 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephadm (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:24.515 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T05:18:24.776 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T05:18:25.014 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user cephadm....done 2024-09-12T05:18:25.120 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T05:18:25.170 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T05:18:25.472 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T05:18:25.529 INFO:teuthology.orchestra.run.smithi194.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T05:18:25.600 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up cephadm (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:25.732 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T05:18:25.858 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T05:18:26.117 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T05:18:26.133 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user cephadm....done 2024-09-12T05:18:26.264 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T05:18:26.393 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T05:18:26.515 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T05:18:26.519 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T05:18:26.812 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T05:18:27.008 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T05:18:27.134 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T05:18:27.173 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T05:18:27.402 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T05:18:27.433 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T05:18:27.661 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T05:18:27.742 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T05:18:27.779 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T05:18:27.993 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T05:18:28.106 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T05:18:28.253 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T05:18:28.466 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T05:18:28.546 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T05:18:28.717 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T05:18:28.797 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-argparse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:28.985 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T05:18:29.065 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T05:18:29.191 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T05:18:29.278 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T05:18:29.317 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T05:18:29.443 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T05:18:29.521 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T05:18:29.569 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T05:18:29.755 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T05:18:29.845 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T05:18:29.989 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-argparse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T05:18:30.266 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T05:18:30.293 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T05:18:30.373 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T05:18:30.391 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T05:18:30.500 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T05:18:30.520 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T05:18:30.652 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T05:18:30.786 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T05:18:30.867 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T05:18:30.993 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T05:18:31.037 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T05:18:31.261 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T05:18:31.483 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T05:18:31.510 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T05:18:31.529 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T05:18:31.573 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T05:18:31.699 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T05:18:31.847 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T05:18:31.981 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T05:18:32.083 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T05:18:32.209 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T05:18:32.486 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T05:18:32.708 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T05:18:32.745 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T05:18:32.976 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T05:18:33.038 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T05:18:33.085 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T05:18:33.139 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T05:18:33.211 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T05:18:33.513 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T05:18:33.799 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T05:18:33.889 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T05:18:34.058 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T05:18:34.148 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T05:18:34.184 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T05:18:34.318 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T05:18:34.542 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T05:18:34.612 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T05:18:34.818 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T05:18:34.987 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T05:18:35.178 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T05:18:35.221 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T05:18:35.537 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T05:18:35.663 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-common (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:35.823 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T05:18:36.107 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T05:18:36.157 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T05:18:36.451 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T05:18:36.491 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T05:18:36.701 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T05:18:36.828 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-common (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:37.112 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T05:18:37.405 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T05:18:37.722 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T05:18:37.974 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:18:38.108 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T05:18:38.376 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T05:18:38.477 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T05:18:38.561 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T05:18:38.603 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T05:18:38.804 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:18:38.904 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T05:18:38.921 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T05:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T05:18:39.166 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T05:18:39.290 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T05:18:39.416 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T05:18:39.425 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:18:39.551 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T05:18:39.709 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T05:18:39.869 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T05:18:39.985 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T05:18:40.120 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T05:18:40.236 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:18:40.353 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T05:18:40.363 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T05:18:40.622 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T05:18:40.646 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T05:18:40.881 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T05:18:40.882 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T05:18:41.140 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T05:18:41.175 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T05:18:41.284 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T05:18:41.408 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T05:18:41.552 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T05:18:41.667 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T05:18:41.670 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T05:18:41.952 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T05:18:41.979 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T05:18:42.077 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T05:18:42.289 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T05:18:42.389 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T05:18:42.496 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T05:18:42.548 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T05:18:42.674 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T05:18:42.764 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T05:18:42.800 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T05:18:42.889 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T05:18:43.057 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T05:18:43.127 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T05:18:43.253 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T05:18:43.316 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T05:18:43.442 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T05:18:43.576 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T05:18:43.663 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T05:18:43.666 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T05:18:43.920 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T05:18:43.922 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T05:18:44.021 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T05:18:44.048 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T05:18:44.316 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:18:44.389 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T05:18:44.434 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T05:18:44.665 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T05:18:44.760 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T05:18:44.790 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T05:18:45.066 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T05:18:45.078 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T05:18:45.192 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T05:18:45.362 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T05:18:45.496 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T05:18:45.510 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T05:18:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T05:18:45.811 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T05:18:46.071 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T05:18:46.143 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T05:18:46.180 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T05:18:46.402 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T05:18:46.473 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T05:18:46.787 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T05:18:46.817 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T05:18:47.088 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T05:18:47.102 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T05:18:47.424 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T05:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T05:18:47.558 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librados2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:47.684 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:47.771 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T05:18:47.810 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T05:18:48.104 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:48.107 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T05:18:48.222 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libradosstriper1 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:48.233 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librados2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:48.348 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T05:18:48.359 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T05:18:48.641 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librbd1 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:48.750 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-modules-core (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:48.830 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:48.860 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-fuse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:48.939 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libradosstriper1 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:49.040 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T05:18:49.063 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T05:18:49.063 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T05:18:49.308 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librbd1 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:49.460 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-modules-core (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:49.527 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs-dev (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:49.594 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-fuse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:49.654 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rados (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:49.779 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librgw2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:49.807 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T05:18:49.807 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T05:18:49.906 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T05:18:50.286 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs-dev (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:50.404 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rados (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:50.505 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librgw2 (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:50.631 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T05:18:51.118 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rbd (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:51.219 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up rbd-fuse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:51.345 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rgw (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:51.471 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cephfs (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:51.597 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-common (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:51.886 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rbd (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:52.012 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up rbd-fuse (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:52.130 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rgw (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:52.140 INFO:teuthology.orchestra.run.smithi059.stdout:Adding group ceph....done 2024-09-12T05:18:52.247 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cephfs (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:52.357 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-common (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:52.500 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user ceph....done 2024-09-12T05:18:52.660 INFO:teuthology.orchestra.run.smithi059.stdout:Setting system user ceph properties....done 2024-09-12T05:18:52.680 INFO:teuthology.orchestra.run.smithi059.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T05:18:52.828 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T05:18:52.933 INFO:teuthology.orchestra.run.smithi194.stdout:Adding group ceph....done 2024-09-12T05:18:53.203 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T05:18:53.242 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user ceph....done 2024-09-12T05:18:53.360 INFO:teuthology.orchestra.run.smithi194.stdout:Setting system user ceph properties....done 2024-09-12T05:18:53.380 INFO:teuthology.orchestra.run.smithi194.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T05:18:53.532 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T05:18:53.855 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T05:18:53.882 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-test (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:54.017 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up radosgw (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:54.307 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-test (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:54.433 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up radosgw (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:54.496 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T05:18:54.496 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T05:18:54.870 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T05:18:54.871 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T05:18:54.977 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-base (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:55.311 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T05:18:55.318 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-base (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:55.685 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T05:18:55.753 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mds (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:55.963 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T05:18:55.963 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T05:18:56.112 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mds (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:56.337 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T05:18:56.337 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T05:18:56.455 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:56.772 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:56.983 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T05:18:56.983 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T05:18:57.137 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T05:18:57.137 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T05:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-osd (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:57.585 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-osd (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:57.878 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T05:18:57.879 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T05:18:57.983 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T05:18:57.983 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T05:18:58.378 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:58.466 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:58.487 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:58.609 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:58.638 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mon (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:58.760 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mon (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:58.864 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T05:18:58.864 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T05:18:58.982 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T05:18:58.983 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T05:18:59.339 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-cephadm (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:59.445 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-cephadm (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:59.490 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:59.596 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:59.625 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-dashboard (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:59.738 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-dashboard (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:59.776 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-volume (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-volume (19.3.0-4883-gd61b0886-1jammy) ... 2024-09-12T05:19:00.137 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T05:19:00.209 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T05:19:00.238 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T05:19:00.318 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T05:19:00.382 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T05:19:00.470 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T05:19:01.515 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T05:19:01.620 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T05:19:02.195 INFO:teuthology.orchestra.run.smithi059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T05:19:02.201 DEBUG:teuthology.parallel:result is None 2024-09-12T05:19:02.246 INFO:teuthology.orchestra.run.smithi194.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T05:19:02.251 DEBUG:teuthology.parallel:result is None 2024-09-12T05:19:02.251 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T05:19:02.419 DEBUG:teuthology.orchestra.run.smithi059:> dpkg-query -W -f '${Version}' ceph 2024-09-12T05:19:02.439 INFO:teuthology.orchestra.run.smithi059.stdout:19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:19:02.439 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:19:02.439 INFO:teuthology.task.install:The correct ceph version 19.3.0-4883-gd61b0886-1jammy is installed. 2024-09-12T05:19:02.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d61b08865d4d98738f45ff2e4806d7fb6d03eca1 2024-09-12T05:19:02.591 DEBUG:teuthology.orchestra.run.smithi194:> dpkg-query -W -f '${Version}' ceph 2024-09-12T05:19:02.610 INFO:teuthology.orchestra.run.smithi194.stdout:19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:19:02.610 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4883-gd61b0886-1jammy 2024-09-12T05:19:02.610 INFO:teuthology.task.install:The correct ceph version 19.3.0-4883-gd61b0886-1jammy is installed. 2024-09-12T05:19:02.612 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T05:19:02.612 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:02.612 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T05:19:02.628 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:02.628 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T05:19:02.666 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T05:19:02.666 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:02.666 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T05:19:02.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T05:19:02.739 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:02.739 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T05:19:02.753 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T05:19:02.809 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T05:19:02.810 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:02.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T05:19:02.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T05:19:02.880 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:02.880 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T05:19:02.895 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T05:19:02.949 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T05:19:02.950 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:02.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T05:19:02.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T05:19:03.020 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:03.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T05:19:03.032 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T05:19:03.088 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T05:19:03.170 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T05:19:03.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2024-09-12T05:19:03.173 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-09-12T05:19:03.186 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T05:19:03.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T05:19:03.229 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T05:19:03.241 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T05:19:03.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T05:19:03.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T05:19:03.307 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T05:19:03.307 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T05:19:03.308 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301', 'branch': 'wip-dis-testing', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound}', 'email': 'idryomov@gmail.com', 'first_in_suite': False, 'job_id': '7902301', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-dis-testing'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-dis-testing', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}}, 'owner': 'scheduled_dis@teuthology', 'priority': 70, 'repo': 'https://github.com/ceph/ceph-ci', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1680, 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1', 'sleep_before_teardown': 0, 'subset': '42/100', 'suite': 'rbd', 'suite_branch': 'wip-dis-testing', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d61b08865d4d98738f45ff2e4806d7fb6d03eca1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci', 'suite_sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1', 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI15C9rcdBKndy1oKRHNY6at15za/v7NstVFdQAFr7DUuyS0QVVAyNPPwo63cV7Epn26o8/oH7144vPWF5tTO7g=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCpn/7RJqo1gAv/mI0wd/gl9bgN1Kp9qRbA3AMM5PEFFTlZcHB1ky/0hOyKp37GJKqVddK3wjR9Wk/CEMn1Zvfo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_04:46:10', 'tube': 'smithi', 'user': 'dis', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T05:19:03.308 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T05:19:03.341 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T05:19:03.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T05:19:03.389 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T05:19:03.403 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:03.403 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T05:19:03.448 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T05:19:03.448 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-09-12T05:19:03.496 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T05:19:03.496 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T05:19:03.496 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 865 Links: 1 2024-09-12T05:19:03.496 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T05:19:03.496 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-12 05:13:30.755342520 +0000 2024-09-12T05:19:03.496 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-12 05:13:30.487344913 +0000 2024-09-12T05:19:03.496 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-12 05:13:30.487344913 +0000 2024-09-12T05:19:03.496 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-09-12T05:19:03.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T05:19:03.554 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-12T05:19:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-12T05:19:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000409168 s, 1.3 MB/s 2024-09-12T05:19:03.556 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T05:19:03.605 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-09-12T05:19:03.651 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T05:19:03.652 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T05:19:03.652 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-12T05:19:03.652 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T05:19:03.652 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-12 05:13:31.239338196 +0000 2024-09-12T05:19:03.652 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-12 05:13:30.995340375 +0000 2024-09-12T05:19:03.652 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-12 05:13:30.995340375 +0000 2024-09-12T05:19:03.652 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-09-12T05:19:03.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T05:19:03.707 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-12T05:19:03.707 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-12T05:19:03.707 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000304749 s, 1.7 MB/s 2024-09-12T05:19:03.709 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T05:19:03.761 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-09-12T05:19:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T05:19:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T05:19:03.808 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-12T05:19:03.808 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T05:19:03.808 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-12 05:13:31.731333800 +0000 2024-09-12T05:19:03.808 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-12 05:13:31.495335908 +0000 2024-09-12T05:19:03.808 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-12 05:13:31.495335908 +0000 2024-09-12T05:19:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-09-12T05:19:03.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T05:19:03.862 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-12T05:19:03.862 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-12T05:19:03.862 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000431086 s, 1.2 MB/s 2024-09-12T05:19:03.863 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T05:19:03.917 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-09-12T05:19:03.964 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T05:19:03.964 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T05:19:03.964 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-12T05:19:03.964 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T05:19:03.964 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-12 05:13:32.211329514 +0000 2024-09-12T05:19:03.964 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-12 05:13:31.971331658 +0000 2024-09-12T05:19:03.964 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-12 05:13:31.971331658 +0000 2024-09-12T05:19:03.964 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-09-12T05:19:03.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T05:19:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-12T05:19:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-12T05:19:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000333126 s, 1.5 MB/s 2024-09-12T05:19:04.019 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T05:19:04.070 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:04.070 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:04.070 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T05:19:04.075 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T05:19:04.076 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-12T05:19:04.123 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T05:19:04.123 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T05:19:04.123 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 861 Links: 1 2024-09-12T05:19:04.123 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T05:19:04.123 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-12 05:13:29.001167804 +0000 2024-09-12T05:19:04.123 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-12 05:13:28.761169948 +0000 2024-09-12T05:19:04.123 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-12 05:13:28.761169948 +0000 2024-09-12T05:19:04.123 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-12T05:19:04.123 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T05:19:04.177 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-12T05:19:04.177 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-12T05:19:04.177 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000452864 s, 1.1 MB/s 2024-09-12T05:19:04.178 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T05:19:04.227 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-12T05:19:04.274 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T05:19:04.274 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T05:19:04.274 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-12T05:19:04.274 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T05:19:04.274 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-12 05:13:29.473163589 +0000 2024-09-12T05:19:04.274 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-12 05:13:29.213165911 +0000 2024-09-12T05:19:04.274 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-12 05:13:29.213165911 +0000 2024-09-12T05:19:04.275 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-12T05:19:04.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T05:19:04.328 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-12T05:19:04.328 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-12T05:19:04.328 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000410004 s, 1.2 MB/s 2024-09-12T05:19:04.329 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T05:19:04.379 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-12T05:19:04.426 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T05:19:04.426 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T05:19:04.426 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-12T05:19:04.426 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T05:19:04.426 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-12 05:13:29.981159051 +0000 2024-09-12T05:19:04.426 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-12 05:13:29.705161515 +0000 2024-09-12T05:19:04.426 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-12 05:13:29.705161515 +0000 2024-09-12T05:19:04.426 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-12T05:19:04.427 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T05:19:04.480 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-12T05:19:04.480 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-12T05:19:04.480 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000430867 s, 1.2 MB/s 2024-09-12T05:19:04.482 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T05:19:04.531 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-12T05:19:04.578 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T05:19:04.578 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T05:19:04.578 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-12T05:19:04.578 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T05:19:04.578 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-12 05:13:30.497154442 +0000 2024-09-12T05:19:04.578 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-12 05:13:30.221156907 +0000 2024-09-12T05:19:04.578 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-12 05:13:30.221156907 +0000 2024-09-12T05:19:04.578 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-12T05:19:04.578 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T05:19:04.632 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-12T05:19:04.632 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-12T05:19:04.632 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000380501 s, 1.3 MB/s 2024-09-12T05:19:04.633 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T05:19:04.683 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:04.683 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T05:19:04.683 INFO:tasks.ceph:Generating config... 2024-09-12T05:19:04.684 INFO:tasks.ceph:[client] rbd cache = True 2024-09-12T05:19:04.684 INFO:tasks.ceph:[client] rbd cache policy = writearound 2024-09-12T05:19:04.684 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T05:19:04.684 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-12T05:19:04.684 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T05:19:04.685 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T05:19:04.685 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T05:19:04.685 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T05:19:04.685 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T05:19:04.685 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T05:19:04.685 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T05:19:04.685 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T05:19:04.685 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-09-12T05:19:04.685 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T05:19:04.685 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T05:19:04.685 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T05:19:04.685 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T05:19:04.685 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T05:19:04.686 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T05:19:04.686 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T05:19:04.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T05:19:04.723 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T05:19:04.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T05:19:04.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T05:19:04.871 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.c', '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]'), ('mon.b', '172.21.15.194')] 2024-09-12T05:19:04.871 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],172.21.15.194', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache policy': 'writearound'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T05:19:04.872 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:04.872 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T05:19:04.920 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --addv c '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]' --add b 172.21.15.194 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:05.006 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:05.006 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid 68a6e7bb-cbcb-48c0-a793-81ba84559d97 2024-09-12T05:19:05.006 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = quincy 2024-09-12T05:19:05.006 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2024-09-12T05:19:05.006 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 68a6e7bb-cbcb-48c0-a793-81ba84559d97 2024-09-12T05:19:05.006 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2024-09-12T05:19:05.010085+0000 2024-09-12T05:19:05.006 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-09-12T05:19:05.010085+0000 2024-09-12T05:19:05.007 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 17 (quincy) 2024-09-12T05:19:05.007 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2024-09-12T05:19:05.007 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-12T05:19:05.007 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T05:19:05.007 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] mon.c 2024-09-12T05:19:05.007 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T05:19:05.008 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T05:19:05.055 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 68a6e7bb-cbcb-48c0-a793-81ba84559d97... 2024-09-12T05:19:05.056 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T05:19:05.105 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-09-12T05:19:05.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T05:19:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-09-12T05:19:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-09-12T05:19:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-09-12T05:19:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-09-12T05:19:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-09-12T05:19:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],172.21.15.194" 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon client directed command retry = 5 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on pool no app = False 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: ms inject socket failures = 5000 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 68a6e7bb-cbcb-48c0-a793-81ba84559d97 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-09-12T05:19:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2024-09-12T05:19:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore allocator = stupid 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 1/20 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 1/20 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 4/10 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: osd blocked scrub grace period = 3600 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: osd max markdown count = 1000 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-09-12T05:19:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: osd shutdown pgref assert = True 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-09-12T05:19:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T05:19:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: rbd cache = True 2024-09-12T05:19:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: rbd cache policy = writearound 2024-09-12T05:19:05.145 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-09-12T05:19:05.145 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-09-12T05:19:05.145 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-09-12T05:19:05.145 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-09-12T05:19:05.145 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-09-12T05:19:05.145 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-09-12T05:19:05.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T05:19:05.147 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],172.21.15.194" 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: mon client directed command retry = 5 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on pool no app = False 2024-09-12T05:19:05.148 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject socket failures = 5000 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 68a6e7bb-cbcb-48c0-a793-81ba84559d97 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-09-12T05:19:05.149 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.150 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = stupid 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-09-12T05:19:05.151 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: osd blocked scrub grace period = 3600 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: osd max markdown count = 1000 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: osd shutdown pgref assert = True 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-09-12T05:19:05.152 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T05:19:05.153 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-09-12T05:19:05.154 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T05:19:05.155 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T05:19:05.155 INFO:teuthology.orchestra.run.smithi194.stdout: rbd cache = True 2024-09-12T05:19:05.155 INFO:teuthology.orchestra.run.smithi194.stdout: rbd cache policy = writearound 2024-09-12T05:19:05.155 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-09-12T05:19:05.155 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-09-12T05:19:05.155 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-09-12T05:19:05.156 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T05:19:05.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T05:19:05.253 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T05:19:05.253 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:05.253 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T05:19:05.258 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:05.258 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T05:19:05.303 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:19:05.303 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:05.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T05:19:05.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T05:19:05.372 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:05.372 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:05.420 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:19:05.420 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:05.420 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T05:19:05.420 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T05:19:05.443 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:05.443 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:05.494 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T05:19:05.494 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T05:19:05.495 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T05:19:05.541 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T05:19:05.543 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T05:19:05.586 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T05:19:05.592 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T05:19:05.593 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T05:19:05.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T05:19:05.630 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T05:19:05.640 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T05:19:05.674 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T05:19:05.684 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T05:19:05.684 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T05:19:05.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T05:19:05.696 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:05.697 INFO:tasks.ceph:role: osd.0 2024-09-12T05:19:05.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:19:05.697 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T05:19:05.759 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T05:19:06.215 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-09-12T05:19:06.216 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-09-12T05:19:06.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T05:19:06.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T05:19:06.330 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T05:19:06.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:19:06.331 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T05:19:06.388 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:06.388 INFO:tasks.ceph:role: osd.1 2024-09-12T05:19:06.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:19:06.388 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T05:19:06.453 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T05:19:06.920 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-09-12T05:19:06.923 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-09-12T05:19:06.923 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T05:19:07.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T05:19:07.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:19:07.097 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T05:19:07.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T05:19:07.151 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:07.152 INFO:tasks.ceph:role: osd.2 2024-09-12T05:19:07.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:19:07.152 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T05:19:07.215 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T05:19:07.216 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T05:19:07.690 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-09-12T05:19:07.693 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-09-12T05:19:07.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T05:19:07.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T05:19:07.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:19:07.844 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T05:19:07.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T05:19:07.899 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:07.899 INFO:tasks.ceph:role: osd.3 2024-09-12T05:19:07.899 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:19:07.900 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T05:19:07.963 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T05:19:07.963 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T05:19:07.963 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T05:19:07.964 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T05:19:07.964 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T05:19:07.964 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-09-12T05:19:07.964 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T05:19:07.964 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T05:19:07.964 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T05:19:07.964 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T05:19:08.391 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-09-12T05:19:08.397 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-09-12T05:19:08.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T05:19:08.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T05:19:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T05:19:08.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:19:08.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:08.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:08.603+0000 7fa98c2b77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T05:19:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:08.607+0000 7fa98c2b77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T05:19:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:08.607+0000 7fa98c2b77c0 -1 bdev(0x559839007800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T05:19:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:08.607+0000 7fa98c2b77c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T05:19:11.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T05:19:11.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:11.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:11.867+0000 7f1b676cd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T05:19:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:11.867+0000 7f1b676cd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T05:19:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:11.867+0000 7f1b676cd7c0 -1 bdev(0x556b7fd03800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T05:19:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:11.867+0000 7f1b676cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T05:19:15.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T05:19:15.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:15.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:15.163+0000 7f473514f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T05:19:15.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:15.163+0000 7f473514f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T05:19:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:15.163+0000 7f473514f7c0 -1 bdev(0x55b7aa3b3800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T05:19:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:15.163+0000 7f473514f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T05:19:18.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T05:19:18.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:18.495+0000 7f8133ce17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T05:19:18.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:18.495+0000 7f8133ce17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T05:19:18.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:18.495+0000 7f8133ce17c0 -1 bdev(0x564982c2d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T05:19:18.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-12T05:19:18.495+0000 7f8133ce17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T05:19:21.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T05:19:21.700 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T05:19:21.715 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:21.715 INFO:tasks.ceph:role: osd.4 2024-09-12T05:19:21.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:19:21.715 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T05:19:21.777 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T05:19:22.232 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-12T05:19:22.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-12T05:19:22.234 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T05:19:22.331 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T05:19:22.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:19:22.342 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T05:19:22.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T05:19:22.396 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:22.396 INFO:tasks.ceph:role: osd.5 2024-09-12T05:19:22.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:19:22.396 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T05:19:22.458 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T05:19:22.934 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-12T05:19:22.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-12T05:19:22.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T05:19:23.081 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T05:19:23.091 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T05:19:23.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:19:23.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T05:19:23.149 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:23.150 INFO:tasks.ceph:role: osd.6 2024-09-12T05:19:23.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:19:23.150 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T05:19:23.212 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T05:19:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T05:19:23.688 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-12T05:19:23.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-12T05:19:23.691 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T05:19:23.827 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T05:19:23.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:19:23.839 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T05:19:23.839 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T05:19:23.893 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T05:19:23.893 INFO:tasks.ceph:role: osd.7 2024-09-12T05:19:23.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:19:23.893 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T05:19:23.957 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T05:19:23.958 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T05:19:24.386 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-12T05:19:24.388 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-12T05:19:24.388 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T05:19:24.481 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T05:19:24.492 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T05:19:24.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:19:24.493 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:24.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:24.598+0000 7f6f67ffe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T05:19:24.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:24.602+0000 7f6f67ffe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T05:19:24.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:24.602+0000 7f6f67ffe7c0 -1 bdev(0x55d15b967800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T05:19:24.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:24.602+0000 7f6f67ffe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T05:19:27.750 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T05:19:27.765 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:27.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:27.850+0000 7f129b4cd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T05:19:27.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:27.850+0000 7f129b4cd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T05:19:27.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:27.850+0000 7f129b4cd7c0 -1 bdev(0x55e432f8b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T05:19:27.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:27.850+0000 7f129b4cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T05:19:31.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T05:19:31.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:31.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:31.146+0000 7f0b8c1377c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T05:19:31.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:31.146+0000 7f0b8c1377c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T05:19:31.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:31.146+0000 7f0b8c1377c0 -1 bdev(0x5612ed4b9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T05:19:31.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:31.146+0000 7f0b8c1377c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T05:19:34.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T05:19:34.382 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:34.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:34.462+0000 7f5810be67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T05:19:34.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:34.462+0000 7f5810be67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T05:19:34.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:34.462+0000 7f5810be67c0 -1 bdev(0x562e52bd1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T05:19:34.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T05:19:34.462+0000 7f5810be67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T05:19:37.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T05:19:37.657 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T05:19:37.658 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:37.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T05:19:37.672 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:37.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T05:19:37.727 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:37.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T05:19:37.783 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:37.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T05:19:37.839 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:37.840 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T05:19:37.894 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:37.895 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T05:19:37.911 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:37.911 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T05:19:37.965 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:37.965 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T05:19:38.021 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:38.021 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T05:19:38.076 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:38.077 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T05:19:38.133 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:38.133 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T05:19:38.139 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:38.139 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T05:19:38.181 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T05:19:38.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T05:19:38.184 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T05:19:38.227 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2024-09-12T05:19:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDJeeJm3aZ2IBAAE6pCvoclznkmb7Kn8Hpwvg== 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDMeeJm5W5tJBAAVFfoGC0Y3PwPLgEOFR6hxw== 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDPeeJmqjj9MxAANInPyFPbZ6YUAidiM3AtyQ== 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDTeeJmPwXFCRAAFLQV6Z1FiBTSMZl+FpxYYw== 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDWeeJmv/+kHRAAeuPrFv5sMc/TIiR05vGXJw== 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDJeeJmuysGIxAAi6z98LOdVCfUI/KcOzMEbg== 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2024-09-12T05:19:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDceeJm4yXvIxAAlCvcfryYOPyb7vqEKhK3fA== 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDfeeJmpSTqMhAAewyZpsYMcXgW8T9mwekcoA== 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDjeeJmz3ryCBAALXgqlcxKI7Cix91DlqvtWw== 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDmeeJmJbu/GxAAxYKYRsv+yy4vx4CLFMTNuQ== 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDJeeJm1qLKJRAA3QMc6zyNbbq4z+iDm6ENMg== 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2024-09-12T05:19:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDJeeJm0ZJJKBAALtEUHXn+sQLWLtIMGwjaeA== 2024-09-12T05:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2024-09-12T05:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDJeeJm3aZ2IBAAE6pCvoclznkmb7Kn8Hpwvg== 2024-09-12T05:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-09-12T05:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDMeeJm5W5tJBAAVFfoGC0Y3PwPLgEOFR6hxw== 2024-09-12T05:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-09-12T05:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDPeeJmqjj9MxAANInPyFPbZ6YUAidiM3AtyQ== 2024-09-12T05:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-09-12T05:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDTeeJmPwXFCRAAFLQV6Z1FiBTSMZl+FpxYYw== 2024-09-12T05:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-09-12T05:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDWeeJmv/+kHRAAeuPrFv5sMc/TIiR05vGXJw== 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDJeeJmuysGIxAAi6z98LOdVCfUI/KcOzMEbg== 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDceeJm4yXvIxAAlCvcfryYOPyb7vqEKhK3fA== 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDfeeJmpSTqMhAAewyZpsYMcXgW8T9mwekcoA== 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDjeeJmz3ryCBAALXgqlcxKI7Cix91DlqvtWw== 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2024-09-12T05:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDmeeJmJbu/GxAAxYKYRsv+yy4vx4CLFMTNuQ== 2024-09-12T05:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-09-12T05:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDJeeJm1qLKJRAA3QMc6zyNbbq4z+iDm6ENMg== 2024-09-12T05:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-09-12T05:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDJeeJm0ZJJKBAALtEUHXn+sQLWLtIMGwjaeA== 2024-09-12T05:19:38.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T05:19:38.276 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T05:19:38.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.416 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.552 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T05:19:38.626 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T05:19:38.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.712 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.800 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.874 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:38.934 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T05:19:39.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T05:19:39.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T05:19:39.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T05:19:39.108 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T05:19:39.176 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T05:19:39.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T05:19:39.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T05:19:39.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T05:19:39.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T05:19:39.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T05:19:39.442 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T05:19:39.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T05:19:39.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T05:19:39.561 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T05:19:39.571 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:39.574 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T05:19:39.621 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T05:19:39.621 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T05:19:39.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T05:19:39.624 INFO:tasks.ceph.mon.a:Started 2024-09-12T05:19:39.624 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T05:19:39.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T05:19:39.626 INFO:tasks.ceph.mon.c:Started 2024-09-12T05:19:39.627 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T05:19:39.627 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T05:19:39.670 INFO:tasks.ceph.mon.b:Started 2024-09-12T05:19:39.671 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T05:19:39.671 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T05:19:39.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T05:19:39.673 INFO:tasks.ceph.mgr.y:Started 2024-09-12T05:19:39.674 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T05:19:39.674 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T05:19:39.676 INFO:tasks.ceph.mgr.x:Started 2024-09-12T05:19:39.676 DEBUG:tasks.ceph:set 0 configs 2024-09-12T05:19:39.676 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T05:19:39.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T05:19:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2024-09-12T05:19:40.129 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T05:19:40.129 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T05:19:40.129 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:40.129 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T05:19:40.140 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:40.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T05:19:40.192 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:40.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T05:19:40.246 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-12T05:19:40.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T05:19:40.298 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:40.298 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T05:19:40.312 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:40.312 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T05:19:40.365 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:40.365 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T05:19:40.420 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T05:19:40.420 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T05:19:40.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 7c94de5b-39f6-4915-ba6c-e8cccd9102af 0 2024-09-12T05:19:40.720 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-09-12T05:19:40.736 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 42bc191c-bc62-4ba4-a60c-609e883f33bb 1 2024-09-12T05:19:40.942 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-12T05:19:40.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 0ce3483f-c255-4b55-bc06-cd54783301c8 2 2024-09-12T05:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-09-12T05:19:41.246 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 0b8c307c-b876-4aa3-82a6-f5e63033e353 3 2024-09-12T05:19:41.446 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-09-12T05:19:41.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 592feb7f-d1f9-420a-9fef-7110c6ac9882 4 2024-09-12T05:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout:4 2024-09-12T05:19:41.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new fb43b395-e414-42b5-8c6c-4cd0926662c0 5 2024-09-12T05:19:41.885 INFO:teuthology.orchestra.run.smithi194.stdout:5 2024-09-12T05:19:41.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new fd8d0fb3-58c5-43dc-bdce-6505505e3491 6 2024-09-12T05:19:42.099 INFO:teuthology.orchestra.run.smithi194.stdout:6 2024-09-12T05:19:42.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new dd5da5cd-7d54-4812-b630-23ccf2c82c8e 7 2024-09-12T05:19:42.300 INFO:teuthology.orchestra.run.smithi194.stdout:7 2024-09-12T05:19:42.317 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T05:19:42.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T05:19:42.319 INFO:tasks.ceph.osd.0:Started 2024-09-12T05:19:42.320 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T05:19:42.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T05:19:42.322 INFO:tasks.ceph.osd.1:Started 2024-09-12T05:19:42.322 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T05:19:42.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T05:19:42.325 INFO:tasks.ceph.osd.2:Started 2024-09-12T05:19:42.325 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T05:19:42.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T05:19:42.327 INFO:tasks.ceph.osd.3:Started 2024-09-12T05:19:42.327 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T05:19:42.327 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T05:19:42.329 INFO:tasks.ceph.osd.4:Started 2024-09-12T05:19:42.329 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T05:19:42.329 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T05:19:42.331 INFO:tasks.ceph.osd.5:Started 2024-09-12T05:19:42.331 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T05:19:42.331 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T05:19:42.333 INFO:tasks.ceph.osd.6:Started 2024-09-12T05:19:42.333 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T05:19:42.333 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T05:19:42.335 INFO:tasks.ceph.osd.7:Started 2024-09-12T05:19:42.335 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T05:19:42.544 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:19:42.544 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:19:42.300884+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T05:19:42.300884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:19:42.560 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T05:19:42.560 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T05:19:42.941 INFO:tasks.ceph.mgr.x.smithi194.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T05:19:42.941 INFO:tasks.ceph.mgr.x.smithi194.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T05:19:42.941 INFO:tasks.ceph.mgr.x.smithi194.stderr: from numpy import show_config as show_numpy_config 2024-09-12T05:19:43.060 INFO:tasks.ceph.mgr.y.smithi059.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T05:19:43.060 INFO:tasks.ceph.mgr.y.smithi059.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T05:19:43.060 INFO:tasks.ceph.mgr.y.smithi059.stderr: from numpy import show_config as show_numpy_config 2024-09-12T05:19:43.366 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T05:19:43.450 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:19:43.450+0000 7fa3a52d07c0 -1 Falling back to public interface 2024-09-12T05:19:43.554 INFO:teuthology.misc.health.smithi059.stdout: 2024-09-12T05:19:43.555 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":10,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:19:42.300884+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T05:19:42.300884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:19:43.569 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T05:19:43.715 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:19:43.714+0000 7f560a3ea7c0 -1 Falling back to public interface 2024-09-12T05:19:43.748 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:19:43.750+0000 7fdbb38f37c0 -1 Falling back to public interface 2024-09-12T05:19:43.779 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:19:43.782+0000 7f9304b3b7c0 -1 Falling back to public interface 2024-09-12T05:19:43.941 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:19:43.942+0000 7fcad18557c0 -1 Falling back to public interface 2024-09-12T05:19:44.003 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:19:44.002+0000 7f40cfcf17c0 -1 Falling back to public interface 2024-09-12T05:19:44.012 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:19:44.014+0000 7f71c15217c0 -1 Falling back to public interface 2024-09-12T05:19:44.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:19:44.034+0000 7f0509b487c0 -1 Falling back to public interface 2024-09-12T05:19:45.904 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-12T05:19:45.902+0000 7fab66d08640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T05:19:45.905 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-12T05:19:45.902+0000 7fab66d08640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T05:19:47.471 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:19:47.470+0000 7fa3a52d07c0 -1 osd.5 0 log_to_monitors true 2024-09-12T05:19:47.740 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:19:47.742+0000 7fdbb38f37c0 -1 osd.1 0 log_to_monitors true 2024-09-12T05:19:47.920 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:19:47.922+0000 7f9304b3b7c0 -1 osd.3 0 log_to_monitors true 2024-09-12T05:19:47.989 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:19:47.986+0000 7f560a3ea7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T05:19:48.063 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:19:48.066+0000 7f71c15217c0 -1 osd.2 0 log_to_monitors true 2024-09-12T05:19:48.145 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:19:48.146+0000 7f0509b487c0 -1 osd.4 0 log_to_monitors true 2024-09-12T05:19:48.260 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:19:48.262+0000 7fcad18557c0 -1 osd.0 0 log_to_monitors true 2024-09-12T05:19:48.277 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:19:48.278+0000 7f40cfcf17c0 -1 osd.6 0 log_to_monitors true 2024-09-12T05:19:50.376 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T05:19:50.793 INFO:teuthology.misc.health.smithi059.stdout: 2024-09-12T05:19:50.794 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":13,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:19:50.031851+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T05:19:42.300884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:19:50.817 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T05:19:50.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:19:50.826+0000 7fa3a1279640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T05:19:50.864 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:19:50.862+0000 7fa3990ab640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:19:50.956 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:19:50.958+0000 7f93012f6640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T05:19:50.996 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:19:50.998+0000 7f92f8916640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:19:51.010 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:19:51.010+0000 7fdbaf89c640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T05:19:51.024 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:19:51.026+0000 7f5606393640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T05:19:51.055 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:19:51.054+0000 7f55fe1c5640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:19:51.063 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:19:51.066+0000 7fdba76ce640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:19:51.603 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:19:51.606+0000 7fcacd7fe640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T05:19:51.607 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:19:51.606+0000 7f40cc4ac640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T05:19:51.616 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:19:51.618+0000 7f71bdcdc640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T05:19:51.631 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:19:51.634+0000 7fcac5630640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:19:51.633 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:19:51.634+0000 7f40c3acc640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:19:51.643 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:19:51.646+0000 7f71b52fc640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:19:51.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:19:51.642+0000 7f0506303640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T05:19:51.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:19:51.670+0000 7f04fd923640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:19:57.625 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T05:19:57.941 INFO:teuthology.misc.health.smithi059.stdout: 2024-09-12T05:19:57.942 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":18,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:19:55.873186+0000","last_up_change":"2024-09-12T05:19:51.845158+0000","last_in_change":"2024-09-12T05:19:42.300884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T05:19:52.945109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6817","nonce":3837229352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6819","nonce":3837229352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6823","nonce":3837229352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6821","nonce":3837229352}]},"public_addr":"172.21.15.59:6817/3837229352","cluster_addr":"172.21.15.59:6819/3837229352","heartbeat_back_addr":"172.21.15.59:6823/3837229352","heartbeat_front_addr":"172.21.15.59:6821/3837229352","state":["exists","up"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6801","nonce":1576154773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6803","nonce":1576154773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6807","nonce":1576154773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6805","nonce":1576154773}]},"public_addr":"172.21.15.59:6801/1576154773","cluster_addr":"172.21.15.59:6803/1576154773","heartbeat_back_addr":"172.21.15.59:6807/1576154773","heartbeat_front_addr":"172.21.15.59:6805/1576154773","state":["exists","up"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6825","nonce":3725088694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6827","nonce":3725088694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6831","nonce":3725088694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6829","nonce":3725088694}]},"public_addr":"172.21.15.59:6825/3725088694","cluster_addr":"172.21.15.59:6827/3725088694","heartbeat_back_addr":"172.21.15.59:6831/3725088694","heartbeat_front_addr":"172.21.15.59:6829/3725088694","state":["exists","up"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6809","nonce":167605601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6811","nonce":167605601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6815","nonce":167605601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6813","nonce":167605601}]},"public_addr":"172.21.15.59:6809/167605601","cluster_addr":"172.21.15.59:6811/167605601","heartbeat_back_addr":"172.21.15.59:6815/167605601","heartbeat_front_addr":"172.21.15.59:6813/167605601","state":["exists","up"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6825","nonce":2467380900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6827","nonce":2467380900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6831","nonce":2467380900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6829","nonce":2467380900}]},"public_addr":"172.21.15.194:6825/2467380900","cluster_addr":"172.21.15.194:6827/2467380900","heartbeat_back_addr":"172.21.15.194:6831/2467380900","heartbeat_front_addr":"172.21.15.194:6829/2467380900","state":["exists","up"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6801","nonce":1911143418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6803","nonce":1911143418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6807","nonce":1911143418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6805","nonce":1911143418}]},"public_addr":"172.21.15.194:6801/1911143418","cluster_addr":"172.21.15.194:6803/1911143418","heartbeat_back_addr":"172.21.15.194:6807/1911143418","heartbeat_front_addr":"172.21.15.194:6805/1911143418","state":["exists","up"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6817","nonce":90490456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6819","nonce":90490456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6823","nonce":90490456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6821","nonce":90490456}]},"public_addr":"172.21.15.194:6817/90490456","cluster_addr":"172.21.15.194:6819/90490456","heartbeat_back_addr":"172.21.15.194:6823/90490456","heartbeat_front_addr":"172.21.15.194:6821/90490456","state":["exists","up"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6809","nonce":2109956055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6811","nonce":2109956055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6815","nonce":2109956055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6813","nonce":2109956055}]},"public_addr":"172.21.15.194:6809/2109956055","cluster_addr":"172.21.15.194:6811/2109956055","heartbeat_back_addr":"172.21.15.194:6815/2109956055","heartbeat_front_addr":"172.21.15.194:6813/2109956055","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.291372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.699928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.078333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.878139+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.129610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.515195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.266450+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.961964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:19:57.959 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T05:19:57.960 INFO:tasks.ceph:Creating RBD pool 2024-09-12T05:19:57.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T05:19:58.902 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'rbd' created 2024-09-12T05:19:58.929 DEBUG:teuthology.orchestra.run.smithi059:> rbd --cluster ceph pool init rbd 2024-09-12T05:20:02.043 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T05:20:02.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T05:20:02.044 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T05:20:02.378 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:02.397 INFO:teuthology.orchestra.run.smithi059.stdout:[{"version":9,"timestamp":"2024-09-12T05:19:51.648618+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"4120.682488"}]}] 2024-09-12T05:20:02.397 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T05:20:02.397 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T05:20:02.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T05:20:02.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T05:20:02.758 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:02.775 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1523999233},{"type":"v1","addr":"172.21.15.194:6833","nonce":1523999233}]},"active_addr":"172.21.15.194:6833/1523999233","active_change":"2024-09-12T05:19:44.884805+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":1343274195}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":2900323474}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3321618738}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":4241337024}]}]} 2024-09-12T05:20:02.779 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T05:20:02.780 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T05:20:02.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T05:20:03.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:03.087 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:20:01.929471+0000","last_up_change":"2024-09-12T05:19:51.845158+0000","last_in_change":"2024-09-12T05:19:42.300884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T05:19:52.945109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T05:19:58.280650+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6817","nonce":3837229352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6819","nonce":3837229352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6823","nonce":3837229352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6821","nonce":3837229352}]},"public_addr":"172.21.15.59:6817/3837229352","cluster_addr":"172.21.15.59:6819/3837229352","heartbeat_back_addr":"172.21.15.59:6823/3837229352","heartbeat_front_addr":"172.21.15.59:6821/3837229352","state":["exists","up"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6801","nonce":1576154773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6803","nonce":1576154773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6807","nonce":1576154773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6805","nonce":1576154773}]},"public_addr":"172.21.15.59:6801/1576154773","cluster_addr":"172.21.15.59:6803/1576154773","heartbeat_back_addr":"172.21.15.59:6807/1576154773","heartbeat_front_addr":"172.21.15.59:6805/1576154773","state":["exists","up"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6825","nonce":3725088694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6827","nonce":3725088694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6831","nonce":3725088694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6829","nonce":3725088694}]},"public_addr":"172.21.15.59:6825/3725088694","cluster_addr":"172.21.15.59:6827/3725088694","heartbeat_back_addr":"172.21.15.59:6831/3725088694","heartbeat_front_addr":"172.21.15.59:6829/3725088694","state":["exists","up"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6809","nonce":167605601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6811","nonce":167605601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6815","nonce":167605601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6813","nonce":167605601}]},"public_addr":"172.21.15.59:6809/167605601","cluster_addr":"172.21.15.59:6811/167605601","heartbeat_back_addr":"172.21.15.59:6815/167605601","heartbeat_front_addr":"172.21.15.59:6813/167605601","state":["exists","up"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6825","nonce":2467380900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6827","nonce":2467380900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6831","nonce":2467380900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6829","nonce":2467380900}]},"public_addr":"172.21.15.194:6825/2467380900","cluster_addr":"172.21.15.194:6827/2467380900","heartbeat_back_addr":"172.21.15.194:6831/2467380900","heartbeat_front_addr":"172.21.15.194:6829/2467380900","state":["exists","up"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6801","nonce":1911143418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6803","nonce":1911143418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6807","nonce":1911143418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6805","nonce":1911143418}]},"public_addr":"172.21.15.194:6801/1911143418","cluster_addr":"172.21.15.194:6803/1911143418","heartbeat_back_addr":"172.21.15.194:6807/1911143418","heartbeat_front_addr":"172.21.15.194:6805/1911143418","state":["exists","up"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6817","nonce":90490456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6819","nonce":90490456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6823","nonce":90490456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6821","nonce":90490456}]},"public_addr":"172.21.15.194:6817/90490456","cluster_addr":"172.21.15.194:6819/90490456","heartbeat_back_addr":"172.21.15.194:6823/90490456","heartbeat_front_addr":"172.21.15.194:6821/90490456","state":["exists","up"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6809","nonce":2109956055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6811","nonce":2109956055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6815","nonce":2109956055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6813","nonce":2109956055}]},"public_addr":"172.21.15.194:6809/2109956055","cluster_addr":"172.21.15.194:6811/2109956055","heartbeat_back_addr":"172.21.15.194:6815/2109956055","heartbeat_front_addr":"172.21.15.194:6813/2109956055","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.291372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.699928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.078333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.878139+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.129610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.515195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.266450+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.961964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:20:03.104 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T05:20:03.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T05:20:03.414 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:03.414 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:20:01.929471+0000","last_up_change":"2024-09-12T05:19:51.845158+0000","last_in_change":"2024-09-12T05:19:42.300884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T05:19:52.945109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T05:19:58.280650+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6817","nonce":3837229352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6819","nonce":3837229352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6823","nonce":3837229352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6821","nonce":3837229352}]},"public_addr":"172.21.15.59:6817/3837229352","cluster_addr":"172.21.15.59:6819/3837229352","heartbeat_back_addr":"172.21.15.59:6823/3837229352","heartbeat_front_addr":"172.21.15.59:6821/3837229352","state":["exists","up"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6801","nonce":1576154773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6803","nonce":1576154773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6807","nonce":1576154773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6805","nonce":1576154773}]},"public_addr":"172.21.15.59:6801/1576154773","cluster_addr":"172.21.15.59:6803/1576154773","heartbeat_back_addr":"172.21.15.59:6807/1576154773","heartbeat_front_addr":"172.21.15.59:6805/1576154773","state":["exists","up"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6825","nonce":3725088694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6827","nonce":3725088694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6831","nonce":3725088694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6829","nonce":3725088694}]},"public_addr":"172.21.15.59:6825/3725088694","cluster_addr":"172.21.15.59:6827/3725088694","heartbeat_back_addr":"172.21.15.59:6831/3725088694","heartbeat_front_addr":"172.21.15.59:6829/3725088694","state":["exists","up"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6809","nonce":167605601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6811","nonce":167605601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6815","nonce":167605601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":167605601},{"type":"v1","addr":"172.21.15.59:6813","nonce":167605601}]},"public_addr":"172.21.15.59:6809/167605601","cluster_addr":"172.21.15.59:6811/167605601","heartbeat_back_addr":"172.21.15.59:6815/167605601","heartbeat_front_addr":"172.21.15.59:6813/167605601","state":["exists","up"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6825","nonce":2467380900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6827","nonce":2467380900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6831","nonce":2467380900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2467380900},{"type":"v1","addr":"172.21.15.194:6829","nonce":2467380900}]},"public_addr":"172.21.15.194:6825/2467380900","cluster_addr":"172.21.15.194:6827/2467380900","heartbeat_back_addr":"172.21.15.194:6831/2467380900","heartbeat_front_addr":"172.21.15.194:6829/2467380900","state":["exists","up"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6801","nonce":1911143418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6803","nonce":1911143418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6807","nonce":1911143418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6805","nonce":1911143418}]},"public_addr":"172.21.15.194:6801/1911143418","cluster_addr":"172.21.15.194:6803/1911143418","heartbeat_back_addr":"172.21.15.194:6807/1911143418","heartbeat_front_addr":"172.21.15.194:6805/1911143418","state":["exists","up"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6817","nonce":90490456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6819","nonce":90490456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6823","nonce":90490456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6821","nonce":90490456}]},"public_addr":"172.21.15.194:6817/90490456","cluster_addr":"172.21.15.194:6819/90490456","heartbeat_back_addr":"172.21.15.194:6823/90490456","heartbeat_front_addr":"172.21.15.194:6821/90490456","state":["exists","up"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6809","nonce":2109956055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6811","nonce":2109956055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6815","nonce":2109956055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6813","nonce":2109956055}]},"public_addr":"172.21.15.194:6809/2109956055","cluster_addr":"172.21.15.194:6811/2109956055","heartbeat_back_addr":"172.21.15.194:6815/2109956055","heartbeat_front_addr":"172.21.15.194:6813/2109956055","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.291372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.699928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.078333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.878139+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.129610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.515195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.266450+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.961964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:20:03.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T05:20:03.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T05:20:03.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T05:20:03.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T05:20:03.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T05:20:03.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T05:20:03.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T05:20:03.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T05:20:03.684 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:03.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T05:20:03.692 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:03.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T05:20:03.705 INFO:teuthology.orchestra.run.smithi059.stdout:60129542150 2024-09-12T05:20:03.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T05:20:03.706 INFO:teuthology.orchestra.run.smithi059.stdout:60129542148 2024-09-12T05:20:03.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T05:20:03.709 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:03.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T05:20:03.710 INFO:teuthology.orchestra.run.smithi059.stdout:60129542150 2024-09-12T05:20:03.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T05:20:03.712 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:03.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T05:20:03.721 INFO:teuthology.orchestra.run.smithi059.stdout:60129542148 2024-09-12T05:20:03.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T05:20:04.221 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:04.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2024-09-12T05:20:04.260 INFO:teuthology.orchestra.run.smithi059.stdout:60129542148 2024-09-12T05:20:04.261 INFO:teuthology.orchestra.run.smithi059.stdout:60129542148 2024-09-12T05:20:04.262 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:04.264 INFO:teuthology.orchestra.run.smithi059.stdout:60129542148 2024-09-12T05:20:04.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-12T05:20:04.291 INFO:teuthology.orchestra.run.smithi059.stdout:60129542147 2024-09-12T05:20:04.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-09-12T05:20:04.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-12T05:20:04.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-12T05:20:04.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.3 2024-09-12T05:20:04.318 INFO:teuthology.orchestra.run.smithi059.stdout:60129542148 2024-09-12T05:20:04.324 INFO:teuthology.orchestra.run.smithi059.stdout:60129542147 2024-09-12T05:20:04.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-09-12T05:20:04.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-09-12T05:20:05.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T05:20:05.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T05:20:05.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T05:20:05.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T05:20:05.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T05:20:05.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T05:20:05.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T05:20:05.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T05:20:05.712 INFO:teuthology.orchestra.run.smithi059.stdout:60129542150 2024-09-12T05:20:05.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-12T05:20:05.736 DEBUG:teuthology.parallel:result is None 2024-09-12T05:20:05.810 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:05.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-12T05:20:05.828 DEBUG:teuthology.parallel:result is None 2024-09-12T05:20:05.853 INFO:teuthology.orchestra.run.smithi059.stdout:60129542150 2024-09-12T05:20:05.855 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:05.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-12T05:20:05.875 DEBUG:teuthology.parallel:result is None 2024-09-12T05:20:05.884 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:05.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-12T05:20:05.886 DEBUG:teuthology.parallel:result is None 2024-09-12T05:20:05.886 INFO:teuthology.orchestra.run.smithi059.stdout:60129542148 2024-09-12T05:20:05.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-12T05:20:05.906 DEBUG:teuthology.parallel:result is None 2024-09-12T05:20:05.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-09-12T05:20:05.907 DEBUG:teuthology.parallel:result is None 2024-09-12T05:20:05.914 INFO:teuthology.orchestra.run.smithi059.stdout:60129542148 2024-09-12T05:20:05.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.3 2024-09-12T05:20:05.933 DEBUG:teuthology.parallel:result is None 2024-09-12T05:20:05.940 INFO:teuthology.orchestra.run.smithi059.stdout:60129542149 2024-09-12T05:20:05.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-12T05:20:05.957 DEBUG:teuthology.parallel:result is None 2024-09-12T05:20:05.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T05:20:05.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:20:06.294 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:06.295 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:20:06.311 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T05:20:04.897415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219164,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755556,"statfs":{"total":773094113280,"available":772869689344,"internally_reserved":0,"allocated":2998272,"data_stored":1793958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.998065"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.151652+0000","last_change":"2024-09-12T05:20:02.152263+0000","last_active":"2024-09-12T05:20:02.151652+0000","last_peered":"2024-09-12T05:20:02.151652+0000","last_clean":"2024-09-12T05:20:02.151652+0000","last_became_active":"2024-09-12T05:19:59.914533+0000","last_became_peered":"2024-09-12T05:19:59.914533+0000","last_unstale":"2024-09-12T05:20:02.151652+0000","last_undegraded":"2024-09-12T05:20:02.151652+0000","last_fullsized":"2024-09-12T05:20:02.151652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:49.955001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014466349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.939349+0000","last_change":"2024-09-12T05:20:01.939349+0000","last_active":"2024-09-12T05:20:01.939349+0000","last_peered":"2024-09-12T05:20:01.939349+0000","last_clean":"2024-09-12T05:20:01.939349+0000","last_became_active":"2024-09-12T05:19:59.915716+0000","last_became_peered":"2024-09-12T05:19:59.915716+0000","last_unstale":"2024-09-12T05:20:01.939349+0000","last_undegraded":"2024-09-12T05:20:01.939349+0000","last_fullsized":"2024-09-12T05:20:01.939349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:36.844145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.152274+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:20:02.152274+0000","last_peered":"2024-09-12T05:20:02.152274+0000","last_clean":"2024-09-12T05:20:02.152274+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:20:02.152274+0000","last_undegraded":"2024-09-12T05:20:02.152274+0000","last_fullsized":"2024-09-12T05:20:02.152274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.939452+0000","last_change":"2024-09-12T05:20:01.939452+0000","last_active":"2024-09-12T05:20:01.939452+0000","last_peered":"2024-09-12T05:20:01.939452+0000","last_clean":"2024-09-12T05:20:01.939452+0000","last_became_active":"2024-09-12T05:19:59.911858+0000","last_became_peered":"2024-09-12T05:19:59.911858+0000","last_unstale":"2024-09-12T05:20:01.939452+0000","last_undegraded":"2024-09-12T05:20:01.939452+0000","last_fullsized":"2024-09-12T05:20:01.939452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:52.544225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.941066+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:20:01.941066+0000","last_peered":"2024-09-12T05:20:01.941066+0000","last_clean":"2024-09-12T05:20:01.941066+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:20:01.941066+0000","last_undegraded":"2024-09-12T05:20:01.941066+0000","last_fullsized":"2024-09-12T05:20:01.941066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.936885+0000","last_change":"2024-09-12T05:20:01.936885+0000","last_active":"2024-09-12T05:20:01.936885+0000","last_peered":"2024-09-12T05:20:01.936885+0000","last_clean":"2024-09-12T05:20:01.936885+0000","last_became_active":"2024-09-12T05:20:00.049870+0000","last_became_peered":"2024-09-12T05:20:00.049870+0000","last_unstale":"2024-09-12T05:20:01.936885+0000","last_undegraded":"2024-09-12T05:20:01.936885+0000","last_fullsized":"2024-09-12T05:20:01.936885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011022810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.152404+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:20:02.152404+0000","last_peered":"2024-09-12T05:20:02.152404+0000","last_clean":"2024-09-12T05:20:02.152404+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:20:02.152404+0000","last_undegraded":"2024-09-12T05:20:02.152404+0000","last_fullsized":"2024-09-12T05:20:02.152404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.936472+0000","last_change":"2024-09-12T05:20:01.936472+0000","last_active":"2024-09-12T05:20:01.936472+0000","last_peered":"2024-09-12T05:20:01.936472+0000","last_clean":"2024-09-12T05:20:01.936472+0000","last_became_active":"2024-09-12T05:19:59.915991+0000","last_became_peered":"2024-09-12T05:19:59.915991+0000","last_unstale":"2024-09-12T05:20:01.936472+0000","last_undegraded":"2024-09-12T05:20:01.936472+0000","last_fullsized":"2024-09-12T05:20:01.936472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:23.065491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.151643+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:20:02.151643+0000","last_peered":"2024-09-12T05:20:02.151643+0000","last_clean":"2024-09-12T05:20:02.151643+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:20:02.151643+0000","last_undegraded":"2024-09-12T05:20:02.151643+0000","last_fullsized":"2024-09-12T05:20:02.151643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:20:06.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:20:06.610 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:20:06.629 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T05:20:04.897415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219164,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755556,"statfs":{"total":773094113280,"available":772869689344,"internally_reserved":0,"allocated":2998272,"data_stored":1793958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.998065"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.151652+0000","last_change":"2024-09-12T05:20:02.152263+0000","last_active":"2024-09-12T05:20:02.151652+0000","last_peered":"2024-09-12T05:20:02.151652+0000","last_clean":"2024-09-12T05:20:02.151652+0000","last_became_active":"2024-09-12T05:19:59.914533+0000","last_became_peered":"2024-09-12T05:19:59.914533+0000","last_unstale":"2024-09-12T05:20:02.151652+0000","last_undegraded":"2024-09-12T05:20:02.151652+0000","last_fullsized":"2024-09-12T05:20:02.151652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:49.955001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014466349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.939349+0000","last_change":"2024-09-12T05:20:01.939349+0000","last_active":"2024-09-12T05:20:01.939349+0000","last_peered":"2024-09-12T05:20:01.939349+0000","last_clean":"2024-09-12T05:20:01.939349+0000","last_became_active":"2024-09-12T05:19:59.915716+0000","last_became_peered":"2024-09-12T05:19:59.915716+0000","last_unstale":"2024-09-12T05:20:01.939349+0000","last_undegraded":"2024-09-12T05:20:01.939349+0000","last_fullsized":"2024-09-12T05:20:01.939349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:36.844145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.152274+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:20:02.152274+0000","last_peered":"2024-09-12T05:20:02.152274+0000","last_clean":"2024-09-12T05:20:02.152274+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:20:02.152274+0000","last_undegraded":"2024-09-12T05:20:02.152274+0000","last_fullsized":"2024-09-12T05:20:02.152274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.939452+0000","last_change":"2024-09-12T05:20:01.939452+0000","last_active":"2024-09-12T05:20:01.939452+0000","last_peered":"2024-09-12T05:20:01.939452+0000","last_clean":"2024-09-12T05:20:01.939452+0000","last_became_active":"2024-09-12T05:19:59.911858+0000","last_became_peered":"2024-09-12T05:19:59.911858+0000","last_unstale":"2024-09-12T05:20:01.939452+0000","last_undegraded":"2024-09-12T05:20:01.939452+0000","last_fullsized":"2024-09-12T05:20:01.939452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:52.544225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.941066+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:20:01.941066+0000","last_peered":"2024-09-12T05:20:01.941066+0000","last_clean":"2024-09-12T05:20:01.941066+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:20:01.941066+0000","last_undegraded":"2024-09-12T05:20:01.941066+0000","last_fullsized":"2024-09-12T05:20:01.941066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.936885+0000","last_change":"2024-09-12T05:20:01.936885+0000","last_active":"2024-09-12T05:20:01.936885+0000","last_peered":"2024-09-12T05:20:01.936885+0000","last_clean":"2024-09-12T05:20:01.936885+0000","last_became_active":"2024-09-12T05:20:00.049870+0000","last_became_peered":"2024-09-12T05:20:00.049870+0000","last_unstale":"2024-09-12T05:20:01.936885+0000","last_undegraded":"2024-09-12T05:20:01.936885+0000","last_fullsized":"2024-09-12T05:20:01.936885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011022810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.152404+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:20:02.152404+0000","last_peered":"2024-09-12T05:20:02.152404+0000","last_clean":"2024-09-12T05:20:02.152404+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:20:02.152404+0000","last_undegraded":"2024-09-12T05:20:02.152404+0000","last_fullsized":"2024-09-12T05:20:02.152404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.936472+0000","last_change":"2024-09-12T05:20:01.936472+0000","last_active":"2024-09-12T05:20:01.936472+0000","last_peered":"2024-09-12T05:20:01.936472+0000","last_clean":"2024-09-12T05:20:01.936472+0000","last_became_active":"2024-09-12T05:19:59.915991+0000","last_became_peered":"2024-09-12T05:19:59.915991+0000","last_unstale":"2024-09-12T05:20:01.936472+0000","last_undegraded":"2024-09-12T05:20:01.936472+0000","last_fullsized":"2024-09-12T05:20:01.936472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:23.065491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.151643+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:20:02.151643+0000","last_peered":"2024-09-12T05:20:02.151643+0000","last_clean":"2024-09-12T05:20:02.151643+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:20:02.151643+0000","last_undegraded":"2024-09-12T05:20:02.151643+0000","last_fullsized":"2024-09-12T05:20:02.151643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:20:06.630 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T05:20:06.630 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T05:20:06.630 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T05:20:06.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T05:20:06.955 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:06.955 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T05:20:06.974 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T05:20:06.974 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T05:20:06.992 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T05:20:06.992 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-dis-testing'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-dis-testing', 'sha1': 'd61b08865d4d98738f45ff2e4806d7fb6d03eca1'}} 2024-09-12T05:20:06.992 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T05:20:06.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T05:20:07.308 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T05:20:07.308 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T05:20:07.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:20:07.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:20:07.612 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T05:20:06.898020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219164,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755556,"statfs":{"total":773094113280,"available":772869689344,"internally_reserved":0,"allocated":2998272,"data_stored":1793958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.996675"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.151652+0000","last_change":"2024-09-12T05:20:02.152263+0000","last_active":"2024-09-12T05:20:02.151652+0000","last_peered":"2024-09-12T05:20:02.151652+0000","last_clean":"2024-09-12T05:20:02.151652+0000","last_became_active":"2024-09-12T05:19:59.914533+0000","last_became_peered":"2024-09-12T05:19:59.914533+0000","last_unstale":"2024-09-12T05:20:02.151652+0000","last_undegraded":"2024-09-12T05:20:02.151652+0000","last_fullsized":"2024-09-12T05:20:02.151652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:49.955001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014466349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.939349+0000","last_change":"2024-09-12T05:20:01.939349+0000","last_active":"2024-09-12T05:20:01.939349+0000","last_peered":"2024-09-12T05:20:01.939349+0000","last_clean":"2024-09-12T05:20:01.939349+0000","last_became_active":"2024-09-12T05:19:59.915716+0000","last_became_peered":"2024-09-12T05:19:59.915716+0000","last_unstale":"2024-09-12T05:20:01.939349+0000","last_undegraded":"2024-09-12T05:20:01.939349+0000","last_fullsized":"2024-09-12T05:20:01.939349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:36.844145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.152274+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:20:02.152274+0000","last_peered":"2024-09-12T05:20:02.152274+0000","last_clean":"2024-09-12T05:20:02.152274+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:20:02.152274+0000","last_undegraded":"2024-09-12T05:20:02.152274+0000","last_fullsized":"2024-09-12T05:20:02.152274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.939452+0000","last_change":"2024-09-12T05:20:01.939452+0000","last_active":"2024-09-12T05:20:01.939452+0000","last_peered":"2024-09-12T05:20:01.939452+0000","last_clean":"2024-09-12T05:20:01.939452+0000","last_became_active":"2024-09-12T05:19:59.911858+0000","last_became_peered":"2024-09-12T05:19:59.911858+0000","last_unstale":"2024-09-12T05:20:01.939452+0000","last_undegraded":"2024-09-12T05:20:01.939452+0000","last_fullsized":"2024-09-12T05:20:01.939452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:52.544225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.941066+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:20:01.941066+0000","last_peered":"2024-09-12T05:20:01.941066+0000","last_clean":"2024-09-12T05:20:01.941066+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:20:01.941066+0000","last_undegraded":"2024-09-12T05:20:01.941066+0000","last_fullsized":"2024-09-12T05:20:01.941066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.936885+0000","last_change":"2024-09-12T05:20:01.936885+0000","last_active":"2024-09-12T05:20:01.936885+0000","last_peered":"2024-09-12T05:20:01.936885+0000","last_clean":"2024-09-12T05:20:01.936885+0000","last_became_active":"2024-09-12T05:20:00.049870+0000","last_became_peered":"2024-09-12T05:20:00.049870+0000","last_unstale":"2024-09-12T05:20:01.936885+0000","last_undegraded":"2024-09-12T05:20:01.936885+0000","last_fullsized":"2024-09-12T05:20:01.936885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011022810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.152404+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:20:02.152404+0000","last_peered":"2024-09-12T05:20:02.152404+0000","last_clean":"2024-09-12T05:20:02.152404+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:20:02.152404+0000","last_undegraded":"2024-09-12T05:20:02.152404+0000","last_fullsized":"2024-09-12T05:20:02.152404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.936472+0000","last_change":"2024-09-12T05:20:01.936472+0000","last_active":"2024-09-12T05:20:01.936472+0000","last_peered":"2024-09-12T05:20:01.936472+0000","last_clean":"2024-09-12T05:20:01.936472+0000","last_became_active":"2024-09-12T05:19:59.915991+0000","last_became_peered":"2024-09-12T05:19:59.915991+0000","last_unstale":"2024-09-12T05:20:01.936472+0000","last_undegraded":"2024-09-12T05:20:01.936472+0000","last_fullsized":"2024-09-12T05:20:01.936472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:23.065491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.151643+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:20:02.151643+0000","last_peered":"2024-09-12T05:20:02.151643+0000","last_clean":"2024-09-12T05:20:02.151643+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:20:02.151643+0000","last_undegraded":"2024-09-12T05:20:02.151643+0000","last_fullsized":"2024-09-12T05:20:02.151643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:20:07.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:20:07.913 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:07.913 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:20:07.931 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T05:20:06.898020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219164,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755556,"statfs":{"total":773094113280,"available":772869689344,"internally_reserved":0,"allocated":2998272,"data_stored":1793958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.996675"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.151652+0000","last_change":"2024-09-12T05:20:02.152263+0000","last_active":"2024-09-12T05:20:02.151652+0000","last_peered":"2024-09-12T05:20:02.151652+0000","last_clean":"2024-09-12T05:20:02.151652+0000","last_became_active":"2024-09-12T05:19:59.914533+0000","last_became_peered":"2024-09-12T05:19:59.914533+0000","last_unstale":"2024-09-12T05:20:02.151652+0000","last_undegraded":"2024-09-12T05:20:02.151652+0000","last_fullsized":"2024-09-12T05:20:02.151652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:49.955001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014466349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.939349+0000","last_change":"2024-09-12T05:20:01.939349+0000","last_active":"2024-09-12T05:20:01.939349+0000","last_peered":"2024-09-12T05:20:01.939349+0000","last_clean":"2024-09-12T05:20:01.939349+0000","last_became_active":"2024-09-12T05:19:59.915716+0000","last_became_peered":"2024-09-12T05:19:59.915716+0000","last_unstale":"2024-09-12T05:20:01.939349+0000","last_undegraded":"2024-09-12T05:20:01.939349+0000","last_fullsized":"2024-09-12T05:20:01.939349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:36.844145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.152274+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:20:02.152274+0000","last_peered":"2024-09-12T05:20:02.152274+0000","last_clean":"2024-09-12T05:20:02.152274+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:20:02.152274+0000","last_undegraded":"2024-09-12T05:20:02.152274+0000","last_fullsized":"2024-09-12T05:20:02.152274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.939452+0000","last_change":"2024-09-12T05:20:01.939452+0000","last_active":"2024-09-12T05:20:01.939452+0000","last_peered":"2024-09-12T05:20:01.939452+0000","last_clean":"2024-09-12T05:20:01.939452+0000","last_became_active":"2024-09-12T05:19:59.911858+0000","last_became_peered":"2024-09-12T05:19:59.911858+0000","last_unstale":"2024-09-12T05:20:01.939452+0000","last_undegraded":"2024-09-12T05:20:01.939452+0000","last_fullsized":"2024-09-12T05:20:01.939452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:52.544225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.941066+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:20:01.941066+0000","last_peered":"2024-09-12T05:20:01.941066+0000","last_clean":"2024-09-12T05:20:01.941066+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:20:01.941066+0000","last_undegraded":"2024-09-12T05:20:01.941066+0000","last_fullsized":"2024-09-12T05:20:01.941066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.936885+0000","last_change":"2024-09-12T05:20:01.936885+0000","last_active":"2024-09-12T05:20:01.936885+0000","last_peered":"2024-09-12T05:20:01.936885+0000","last_clean":"2024-09-12T05:20:01.936885+0000","last_became_active":"2024-09-12T05:20:00.049870+0000","last_became_peered":"2024-09-12T05:20:00.049870+0000","last_unstale":"2024-09-12T05:20:01.936885+0000","last_undegraded":"2024-09-12T05:20:01.936885+0000","last_fullsized":"2024-09-12T05:20:01.936885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011022810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.152404+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:20:02.152404+0000","last_peered":"2024-09-12T05:20:02.152404+0000","last_clean":"2024-09-12T05:20:02.152404+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:20:02.152404+0000","last_undegraded":"2024-09-12T05:20:02.152404+0000","last_fullsized":"2024-09-12T05:20:02.152404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:01.936472+0000","last_change":"2024-09-12T05:20:01.936472+0000","last_active":"2024-09-12T05:20:01.936472+0000","last_peered":"2024-09-12T05:20:01.936472+0000","last_clean":"2024-09-12T05:20:01.936472+0000","last_became_active":"2024-09-12T05:19:59.915991+0000","last_became_peered":"2024-09-12T05:19:59.915991+0000","last_unstale":"2024-09-12T05:20:01.936472+0000","last_undegraded":"2024-09-12T05:20:01.936472+0000","last_fullsized":"2024-09-12T05:20:01.936472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:23.065491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T05:20:02.151643+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:20:02.151643+0000","last_peered":"2024-09-12T05:20:02.151643+0000","last_clean":"2024-09-12T05:20:02.151643+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:20:02.151643+0000","last_undegraded":"2024-09-12T05:20:02.151643+0000","last_fullsized":"2024-09-12T05:20:02.151643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:20:07.932 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T05:20:07.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 22 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 68a6e7bb-cbcb-48c0-a793-81ba84559d97 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-09-12T05:19:39.984405+0000 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:modified 2024-09-12T05:20:01.929471+0000 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:crush_version 5 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:full_ratio 0.95 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:backfillfull_ratio 0.9 2024-09-12T05:20:08.227 INFO:teuthology.orchestra.run.smithi059.stdout:nearfull_ratio 0.85 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:require_min_compat_client luminous 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:min_compat_client jewel 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:require_osd_release squid 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:stretch_mode_enabled false 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout: removed_snaps_queue [2~1] 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:max_osd 8 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6816/3837229352,v1:172.21.15.59:6817/3837229352] [v2:172.21.15.59:6818/3837229352,v1:172.21.15.59:6819/3837229352] exists,up 7c94de5b-39f6-4915-ba6c-e8cccd9102af 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6800/1576154773,v1:172.21.15.59:6801/1576154773] [v2:172.21.15.59:6802/1576154773,v1:172.21.15.59:6803/1576154773] exists,up 42bc191c-bc62-4ba4-a60c-609e883f33bb 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6824/3725088694,v1:172.21.15.59:6825/3725088694] [v2:172.21.15.59:6826/3725088694,v1:172.21.15.59:6827/3725088694] exists,up 0ce3483f-c255-4b55-bc06-cd54783301c8 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6808/167605601,v1:172.21.15.59:6809/167605601] [v2:172.21.15.59:6810/167605601,v1:172.21.15.59:6811/167605601] exists,up 0b8c307c-b876-4aa3-82a6-f5e63033e353 2024-09-12T05:20:08.228 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/2467380900,v1:172.21.15.194:6825/2467380900] [v2:172.21.15.194:6826/2467380900,v1:172.21.15.194:6827/2467380900] exists,up 592feb7f-d1f9-420a-9fef-7110c6ac9882 2024-09-12T05:20:08.229 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/1911143418,v1:172.21.15.194:6801/1911143418] [v2:172.21.15.194:6802/1911143418,v1:172.21.15.194:6803/1911143418] exists,up fb43b395-e414-42b5-8c6c-4cd0926662c0 2024-09-12T05:20:08.229 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/90490456,v1:172.21.15.194:6817/90490456] [v2:172.21.15.194:6818/90490456,v1:172.21.15.194:6819/90490456] exists,up fd8d0fb3-58c5-43dc-bdce-6505505e3491 2024-09-12T05:20:08.229 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/2109956055,v1:172.21.15.194:6809/2109956055] [v2:172.21.15.194:6810/2109956055,v1:172.21.15.194:6811/2109956055] exists,up dd5da5cd-7d54-4812-b630-23ccf2c82c8e 2024-09-12T05:20:08.244 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6816/3837229352,v1:172.21.15.59:6817/3837229352] [v2:172.21.15.59:6818/3837229352,v1:172.21.15.59:6819/3837229352] exists,up 7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'osd.1 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6800/1576154773,v1:172.21.15.59:6801/1576154773] [v2:172.21.15.59:6802/1576154773,v1:172.21.15.59:6803/1576154773] exists,up 42bc191c-bc62-4ba4-a60c-609e883f33bb', 'osd.2 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6824/3725088694,v1:172.21.15.59:6825/3725088694] [v2:172.21.15.59:6826/3725088694,v1:172.21.15.59:6827/3725088694] exists,up 0ce3483f-c255-4b55-bc06-cd54783301c8', 'osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6808/167605601,v1:172.21.15.59:6809/167605601] [v2:172.21.15.59:6810/167605601,v1:172.21.15.59:6811/167605601] exists,up 0b8c307c-b876-4aa3-82a6-f5e63033e353', 'osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/2467380900,v1:172.21.15.194:6825/2467380900] [v2:172.21.15.194:6826/2467380900,v1:172.21.15.194:6827/2467380900] exists,up 592feb7f-d1f9-420a-9fef-7110c6ac9882', 'osd.5 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/1911143418,v1:172.21.15.194:6801/1911143418] [v2:172.21.15.194:6802/1911143418,v1:172.21.15.194:6803/1911143418] exists,up fb43b395-e414-42b5-8c6c-4cd0926662c0', 'osd.6 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/90490456,v1:172.21.15.194:6817/90490456] [v2:172.21.15.194:6818/90490456,v1:172.21.15.194:6819/90490456] exists,up fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'osd.7 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/2109956055,v1:172.21.15.194:6809/2109956055] [v2:172.21.15.194:6810/2109956055,v1:172.21.15.194:6811/2109956055] exists,up dd5da5cd-7d54-4812-b630-23ccf2c82c8e'] 2024-09-12T05:20:08.245 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mon.a", 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster": "ceph", 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "admin_socket_mode": "", 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_client_required": "cephx, none", 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_cluster_required": "cephx", 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_debug": "true", 2024-09-12T05:20:08.364 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T05:20:08.365 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T05:20:08.365 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_service_required": "cephx", 2024-09-12T05:20:08.365 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T05:20:08.365 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_supported": "cephx", 2024-09-12T05:20:08.365 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_aio": "true", 2024-09-12T05:20:08.365 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T05:20:08.365 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T05:20:08.365 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_aio_reap_max": "16", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_async_discard_threads": "0", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_block_size": "4096", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_debug_aio": "false", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_enable_discard": "false", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_flock_retry": "3", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_inject_crash": "0", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_ioring": "false", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_ioring_hipri": "false", 2024-09-12T05:20:08.366 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_type": "", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_allocator": "hybrid", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_buffered_io": "true", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T05:20:08.367 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_replay_recovery": "false", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T05:20:08.368 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_sync_write": "false", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_allocator": "hybrid", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_async_db_compaction": "true", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T05:20:08.369 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_create": "true", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_db_create": "false", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_db_path": "", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_db_size": "0", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_path": "", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_size": "107374182400", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_wal_create": "false", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_wal_path": "", 2024-09-12T05:20:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bluefs": "true", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_autotune": "true", 2024-09-12T05:20:08.371 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_size": "0", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_type": "2q", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_clone_cow": "true", 2024-09-12T05:20:08.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_mode": "none", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_freelist": "false", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T05:20:08.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T05:20:08.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fail_eio": "false", 2024-09-12T05:20:08.375 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T05:20:08.376 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_blob_size": "0", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T05:20:08.377 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T05:20:08.378 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_spdk_mem": "512", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T05:20:08.379 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_tracing": "false", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_write_v2": "false", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_write_v2_random": "false", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T05:20:08.380 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T05:20:08.381 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_cluster_require_version": "2", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_require_signatures": "false", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_require_version": "2", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_service_require_signatures": "false", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_service_require_version": "2", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_sign_messages": "true", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "chdir": "", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_acl_type": "", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_asio_thread_count": "2", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_cache_mid": "0.750000", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_cache_size": "16384", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_caps_release_delay": "5", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_check_pool_perm": "true", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_debug_force_sync_read": "false", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_debug_getattr_caps": "false", 2024-09-12T05:20:08.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_debug_inject_features": "", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_die_on_failed_remount": "false", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_dirsize_rbytes": "true", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_force_lazyio": "false", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_fs": "", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_inject_release_failure": "false", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_max_inline_size": "4096", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mds_namespace": "", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_metadata": "", 2024-09-12T05:20:08.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mount_gid": "-1", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mount_timeout": "300", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mount_uid": "-1", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mountpoint": "/", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_notify_timeout": "10", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc": "true", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_max_objects": "1000", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_size": "209715200", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_permissions": "true", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_quota": "true", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_quota_df": "true", 2024-09-12T05:20:08.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_readahead_max_bytes": "0", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_readahead_max_periods": "4", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_readahead_min": "131072", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_reconnect_stale": "false", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_shutdown_timeout": "30", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_snapdir": ".snap", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_tick_interval": "1", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_trace": "", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_use_faked_inos": "false", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_use_random_mds": "false", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_graylog": "false", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_graylog_port": "12201", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_monitors": "default=true", 2024-09-12T05:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_syslog": "false", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_syslog_level": "info", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "-", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_network": "", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_network_interface": "", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "compressor_zlib_isal": "false", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "compressor_zlib_level": "5", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "compressor_zstd_level": "1", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T05:20:08.386 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_location": "", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_location_hook": "", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_location_hook_timeout": "10", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "daemonize": "false", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "daos_pool": "tank", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_alienstore": "0/5", 2024-09-12T05:20:08.387 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_asok": "1/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_asok_assert_abort": "false", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_auth": "20/20", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_bdev": "1/3", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_bluefs": "1/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_bluestore": "1/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_buffer": "0/1", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_ceph_dedup": "0/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_cephsqlite": "0/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_client": "0/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_compressor": "1/5", 2024-09-12T05:20:08.388 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_context": "0/1", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_crush": "1/1", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_crypto": "1/5", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_cyanstore": "0/5", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_dpdk": "1/5", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_eventtrace": "1/5", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_filer": "0/1", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_filestore": "1/3", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_finisher": "1/1", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_fuse": "1/5", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T05:20:08.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_javaclient": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_journal": "1/3", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_journaler": "0/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_kstore": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_lockdep": "0/1", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mclock": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_balancer": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_locker": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_log": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_migrator": "1/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T05:20:08.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_memstore": "1/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mgr": "2/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mgrc": "1/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mon": "20/20", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_monc": "0/10", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_ms": "1/1", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_none": "0/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_objclass": "0/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_objectcacher": "0/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_objecter": "0/1", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_optracker": "0/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_osd": "1/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_paxos": "20/20", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_perfcounter": "1/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_prioritycache": "1/5", 2024-09-12T05:20:08.391 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rados": "0/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rbd": "0/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rbd_replay": "0/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_refs": "0/0", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_reserver": "1/1", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw": "1/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_access": "1/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_flight": "1/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_notification": "1/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_sync": "1/5", 2024-09-12T05:20:08.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rocksdb": "4/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_backref": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_cache": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_device": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_epm": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_journal": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_lba": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_odata": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_omap": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_onode": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_t": "0/5", 2024-09-12T05:20:08.393 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_tm": "0/5", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_striper": "0/1", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_test": "0/5", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_throttle": "1/1", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_timer": "0/1", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_tp": "0/5", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_trace": "1/5", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "device_failure_prediction_mode": "none", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "err_to_graylog": "false", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "err_to_journald": "false", 2024-09-12T05:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: "err_to_stderr": "true", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "err_to_syslog": "false", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event_tracing": "false", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_cert_file": "", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_http_port": "9926", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_key_file": "", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_prio_limit": "5", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_sort_metrics": "true", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_stats_period": "5", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "fake_statfs_for_testing": "0", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "fatal_signal_handlers": "true", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "filer_max_purge_ops": "10", 2024-09-12T05:20:08.395 INFO:teuthology.orchestra.run.smithi059.stdout: "filer_max_truncate_ops": "128", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_blackhole": "false", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_btrfs_snap": "true", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_caller_concurrency": "10", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_debug_omap_check": "false", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_debug_verify_split": "false", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_dump_file": "", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T05:20:08.396 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fadvise": "true", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fail_eio": "true", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fd_cache_size": "128", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fiemap": "false", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_inject_stall": "0", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_journal_parallel": "false", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_journal_trailing": "false", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_journal_writeahead": "false", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_kill_at": "0", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T05:20:08.397 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_merge_threshold": "-10", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_odsync_write": "false", 2024-09-12T05:20:08.398 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_omap_backend_path": "", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_op_threads": "2", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_punch_hole": "false", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T05:20:08.399 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_ops": "50", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_seek_data_hole": "false", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_sloppy_crc": "false", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_splice": "false", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_split_multiple": "2", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_split_rand_factor": "20", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_update_to": "1000", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T05:20:08.400 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_xfs_extsize": "false", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_zfs_snap": "false", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "fio_dir": "/tmp/fio", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_allow_other": "true", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_big_writes": "true", 2024-09-12T05:20:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_debug": "false", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_default_permissions": "false", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_disable_pagecache": "false", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_max_write": "0", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_multithreaded": "true", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_require_active_mds": "true", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_set_user_groups": "true", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_splice_move": "true", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_splice_read": "true", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_splice_write": "true", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "gss_target_name": "ceph", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_file": "", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_inject_failure": "0", 2024-09-12T05:20:08.402 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_interval": "5", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "host": "smithi059", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T05:20:08.403 INFO:teuthology.orchestra.run.smithi059.stdout: "inject_early_sigterm": "false", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "jaeger_agent_port": "6799", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "jaeger_tracing_enable": "false", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_aio": "true", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_align_min_size": "65536", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_block_align": "true", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_block_size": "4096", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_dio": "true", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_discard": "false", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_force_aio": "false", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_ignore_corruption": "false", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_max_write_entries": "100", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_replay_from": "0", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T05:20:08.404 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_write_header_frequency": "0", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_zero_on_create": "false", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "journaler_prefetch_periods": "10", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "journaler_prezero_periods": "5", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "journaler_write_head_interval": "15", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "keyfile": "", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_backend": "rocksdb", 2024-09-12T05:20:08.405 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_max_bytes": "67108864", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_max_ops": "512", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_onode_map_size": "1024", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_sync_transaction": "false", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "librados_thread_count": "2", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "lockdep": "false", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "lockdep_force_backtrace": "false", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "log_coarse_timestamps": "true", 2024-09-12T05:20:08.406 INFO:teuthology.orchestra.run.smithi059.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_flush_on_exit": "false", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_graylog_port": "12201", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_max_new": "1000", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_max_recent": "10000", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_stderr_prefix": "", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": "true", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_graylog": "false", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_journald": "false", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_stderr": "false", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_syslog": "false", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T05:20:08.407 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_action_on_write_error": "1", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_alternate_name_max": "8192", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_asio_thread_count": "2", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_export_pin": "true", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_interval": "10", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_max": "-1", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_max_until": "-1", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_merge_size": "50", 2024-09-12T05:20:08.408 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_mode": "0", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_split_bits": "3", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_split_size": "10000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T05:20:08.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_mid": "0.700000", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_trim_interval": "1", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T05:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_debug_auth_pins": "false", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_debug_frag": "false", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_debug_scatterstat": "false", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_debug_subtrees": "false", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_default_dir_hash": "2", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_defer_session_stale": "true", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T05:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dir_max_entries": "0", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dir_prefetch": "true", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_early_reply": "true", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_enable_op_tracker": "true", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_enforce_unique_name": "true", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T05:20:08.412 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T05:20:08.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_health_dummy": "false", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_join_fs": "", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_journal_format": "1", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_create_at": "0", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_dirfrag_at": "0", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_export_at": "0", 2024-09-12T05:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_import_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_journal_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_link_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_openc_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_rename_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_max_events": "-1", 2024-09-12T05:20:08.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_max_segments": "128", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_pause": "false", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_segment_size": "0", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_trim_threshold": "128", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_completed_requests": "100000", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_export_size": "20971520", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_file_recover": "32", 2024-09-12T05:20:08.416 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_purge_files": "64", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_purge_ops": "8192", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_metrics_update_interval": "2", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_min_caps_per_client": "100", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_numa_node": "-1", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_history_duration": "600", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_history_size": "20", 2024-09-12T05:20:08.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_log_threshold": "5", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_ping_grace": "15", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_ping_interval": "5", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_max_caps": "30000", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_replay_interval": "1.000000", 2024-09-12T05:20:08.418 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_root_ino_gid": "0", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_root_ino_uid": "0", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_scrub_stats_review_period": "1", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T05:20:08.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_shutdown_check": "0", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_skip_ino": "0", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_snap_min_uid": "0", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_snap_rstat": "false", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_symlink_recovery": "true", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T05:20:08.420 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_thrash_exports": "0", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_thrash_fragments": "0", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_tick_interval": "5.000000", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_valgrind_exit": "false", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_verify_backtrace": "1", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_verify_scatter": "false", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_wipe_sessions": "false", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool_debug": "false", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "memstore_page_set": "false", 2024-09-12T05:20:08.421 INFO:teuthology.orchestra.run.smithi059.stdout: "memstore_page_size": "65536", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_client_bytes": "134217728", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_client_messages": "512", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_disabled_modules": "", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_max_pg_creating": "1024", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T05:20:08.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_mds_messages": "128", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_mon_messages": "128", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_op_history_duration": "600", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_op_history_size": "20", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_op_log_threshold": "5", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_osd_messages": "8192", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_pool": "true", 2024-09-12T05:20:08.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_standby_modules": "true", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_stats_period": "5", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_stats_threshold": "5", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_tick_period": "2", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_allow_pool_delete": "true", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T05:20:08.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T05:20:08.425 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_bytes": "104857600", 2024-09-12T05:20:08.425 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_directed_command_retry": "5", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_target_rank": "-1", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T05:20:08.426 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_level": "debug", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_compact_on_start": "false", 2024-09-12T05:20:08.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_compact_on_trim": "true", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cpu_threads": "4", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_data_avail_crit": "5", 2024-09-12T05:20:08.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_data_avail_warn": "5", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_dump_json": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_extra_checks": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T05:20:08.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_down_uptime_grace": "60", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_election_default_strategy": "1", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_election_timeout": "5.000000", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_enable_op_tracker": "true", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_fake_pool_delete": "false", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_force_quorum_join": "false", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T05:20:08.430 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_log_update_period": "5", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_max_detail": "50", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_to_clog": "true", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_host": "172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],172.21.15.194", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_host_override": "", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_initial_members": "", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T05:20:08.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_lease": "5.000000", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_log_full_interval": "50", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_log_max": "10000", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_log_max_summary": "50", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_log_epochs": "500", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_osd": "10000", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T05:20:08.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_memory_autotune": "true", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_memory_target": "2147483648", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_digest_period": "5", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-12T05:20:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_complaint_time": "30", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_history_duration": "600", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_history_size": "20", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_log_threshold": "5", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T05:20:08.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_cache_size": "500", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T05:20:08.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_report_timeout": "900", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T05:20:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_reweight_max_osds": "4", 2024-09-12T05:20:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_interval": "86400", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_max_keys": "100", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_timeout": "300", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_session_timeout": "300", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_smart_report_timeout": "5", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stretch_pool_size": "4", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T05:20:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_debug": "false", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_tick_interval": "5", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T05:20:08.439 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_older_version": "true", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T05:20:08.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": "", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T05:20:08.441 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_tracing_enabled": "false", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_op_threads": "3", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_cm": "false", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_device_name": "", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T05:20:08.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_sl": "3", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_type": "ib", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_reap_threshold": "5", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_before_connect": "false", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_ipv4": "true", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_ipv6": "false", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_msgr1": "true", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_msgr2": "true", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_port_max": "7568", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_port_min": "6800", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T05:20:08.443 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_retry_count": "3", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_retry_delay": "5", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_client": "false", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_mds": "false", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_mgr": "false", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_mon": "false", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_osd": "false", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_client_mode": "crc secure", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_cluster_type": "", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_compress_secure": "false", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T05:20:08.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_crc_data": "true", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_crc_header": "true", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_bug": "true", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_old_message": "true", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T05:20:08.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_hugepages": "", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_lro": "true", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_pmd": "", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_port_id": "0", 2024-09-12T05:20:08.446 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dump_on_send": "false", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_delay_type": "", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_network_congestion": "0", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_socket_failures": "5000", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_max_accept_failures": "4", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_max_backoff": "15.000000", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T05:20:08.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_osd_compress_mode": "none", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_pq_min_cost": "65536", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_public_type": "", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_service_mode": "crc secure", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_tcp_nodelay": "true", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-12T05:20:08.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_type": "async+posix", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "no_config_file": "false", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_inflight_ops": "1024", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_timeout": "10.000000", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objectstore_blackhole": "false", 2024-09-12T05:20:08.449 INFO:teuthology.orchestra.run.smithi059.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "openssl_engine_opts": "", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_max_ops": "4", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_slop": "0.020000", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_asio_thread_count": "2", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T05:20:08.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backfill_scan_max": "512", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backfill_scan_min": "64", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backoff_on_peering": "false", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_beacon_report_interval": "300", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bench_duration": "30", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_blkin_trace_all": "false", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T05:20:08.451 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_class_update_on_start": "true", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_client_message_cap": "256", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_client_op_priority": "63", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_client_watch_timeout": "30", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_command_max_records": "256", 2024-09-12T05:20:08.452 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_compact_on_start": "false", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_crush_update_on_start": "true", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T05:20:08.453 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_op_order": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_shutdown": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_trim_objects": "false", 2024-09-12T05:20:08.454 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_default_notify_timeout": "30", 2024-09-12T05:20:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_ec_partial_reads": "true", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_enable_op_tracker": "true", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_info": "true", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_shutdown": "true", 2024-09-12T05:20:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_function_tracing": "false", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_grace": "20", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_interval": "6", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_stale": "600", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T05:20:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_journal_size": "5120", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_kill_backfill_at": "0", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_cache_size": "50", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_dedup": "true", 2024-09-12T05:20:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_message_max": "40", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_attr_name_len": "100", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_attr_size": "0", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_backfills": "1", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_markdown_count": "5", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_markdown_period": "600", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_object_name_len": "2048", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_object_size": "134217728", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T05:20:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_pgls": "1024", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_push_cost": "8388608", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_push_objects": "10", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_scrubs": "3", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_write_size": "90", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T05:20:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_profile": "balanced", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T05:20:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_base": "805306368", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_target": "4294967296", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_target_autotune": "false", 2024-09-12T05:20:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_min_recovery_priority": "0", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_report_interval": "5", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_num_cache_shards": "32", 2024-09-12T05:20:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_numa_node": "-1", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objecter_finishers": "1", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objectstore": "bluestore", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objectstore_fuse": "false", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objectstore_tracing": "false", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_history_duration": "600", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_history_size": "20", 2024-09-12T05:20:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_log_threshold": "5", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_shards": "0", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T05:20:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_thread_timeout": "15", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_open_classes_on_start": "true", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_os_flags": "0", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_peering_op_priority": "255", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_delete_priority": "5", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T05:20:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_crimson": "false", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T05:20:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flags": "0", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_min_size": "0", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_size": "2", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_type": "replicated", 2024-09-12T05:20:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_cost": "20971520", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_active": "0", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T05:20:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_op_priority": "3", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_priority": "5", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_repair_during_recovery": "false", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T05:20:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_cost": "52428800", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_end_hour": "0", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T05:20:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_priority": "5", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_retry_delay": "30", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_retry_trimming": "10", 2024-09-12T05:20:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_skip_data_digest": "false", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_smart_report_timeout": "5", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_priority": "5", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T05:20:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_target_transaction_size": "30", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T05:20:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tracing": "false", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_use_stale_snap": "false", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_kill_at": "0", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_max_join_drift": "10", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_min": "500", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_min_wait": "0.050000", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_service_trim_max": "500", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_service_trim_min": "250", 2024-09-12T05:20:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_stash_full_interval": "25", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_trim_max": "500", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_trim_min": "250", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "perf": "true", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "-", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrv": "", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "public_bind_addr": "-", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "public_network": "", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "public_network_interface": "", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T05:20:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: "qat_compressor_enabled": "false", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rados_mon_op_timeout": "0", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rados_osd_op_timeout": "0", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rados_tracing": "false", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_atime_update_interval": "60", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache": "true", 2024-09-12T05:20:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_policy": "writearound", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_size": "33554432", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_compression_hint": "none", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_clone_format": "auto", 2024-09-12T05:20:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_data_pool": "", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_features": "61", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_format": "2", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_map_options": "", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_order": "22", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_pool": "rbd", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_stripe_count": "0", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T05:20:08.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_io_scheduler": "simple", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_order": "24", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_pool": "", 2024-09-12T05:20:08.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_splay_width": "4", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T05:20:08.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T05:20:08.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_op_threads": "1", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T05:20:08.483 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_plugins": "", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T05:20:08.484 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T05:20:08.485 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_tracing": "false", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_validate_names": "true", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_validate_pool": "true", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "restapi_base_url": "", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "restapi_log_level": "", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T05:20:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_admin_entry": "admin", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_asio_assert_yielding": "false", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_backend_store": "rados", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_barbican_url": "", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_beast_enable_async": "true", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T05:20:08.487 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cache_enabled": "true", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_config_store": "rados", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_content_length_compat": "false", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cross_domain_policy": "", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T05:20:08.488 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T05:20:08.489 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T05:20:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T05:20:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T05:20:08.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_log_window": "30", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T05:20:08.493 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_disable_s3select": "false", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T05:20:08.494 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dns_name": "", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dns_s3website_name": "", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_mdsearch": "true", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_ops_log": "false", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_static_website": "false", 2024-09-12T05:20:08.495 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_usage_log": "false", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_expose_bucket": "false", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_extended_http_attrs": "", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_filter": "none", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_objs": "32", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T05:20:08.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_init_timeout": "300", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T05:20:08.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_password": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_project": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_token": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_user": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T05:20:08.498 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_url": "", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T05:20:08.499 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_max_objs": "32", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_max_worker": "3", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_uri": "", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T05:20:08.500 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_log_http_headers": "", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_attr_size": "0", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T05:20:08.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_listing_results": "5000", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_notify_retries": "10", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T05:20:08.502 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T05:20:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_num_control_oids": "8", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_numa_node": "-1", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_op_tracing": "false", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_opa_token": "", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_opa_url": "", 2024-09-12T05:20:08.504 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ops_log_rados": "false", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T05:20:08.505 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_print_continue": "true", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_rados_tracing": "false", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_realm": "", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_realm_id": "", 2024-09-12T05:20:08.506 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_region": "", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_request_uri": "", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-12T05:20:08.507 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_resolve_cname": "false", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_run_sync_thread": "true", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T05:20:08.508 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_script_uri": "", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_service_provider_name": "", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_client_id": "", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_client_secret": "", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_entry": "sts", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_key": "sts", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_auth_url": "", 2024-09-12T05:20:08.509 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_custom_header": "", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_need_stats": "true", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_tenant_name": "", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_url": "", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_lease_period": "120", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T05:20:08.510 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_thread_pool_size": "512", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_comment": "", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_createby": "", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_encoding": "", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_flag": "false", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T05:20:08.511 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_origin": "", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_tracker": "", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_usage_max_shards": "32", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_use_opa_authz": "false", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_counters_cache": "false", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T05:20:08.512 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_unique_email": "true", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_verify_ssl": "true", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zone": "", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zone_id": "", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zonegroup": "", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zonegroup_id": "", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T05:20:08.513 INFO:teuthology.orchestra.run.smithi059.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_block_size": "4096", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T05:20:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_partition_filters": "false", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_perf": "false", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "run_dir": "/var/run/ceph", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_block_create": "true", 2024-09-12T05:20:08.515 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_device_size": "53687091200", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_full_integrity_check": "false", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_main_device_type": "SSD", 2024-09-12T05:20:08.516 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_segment_size": "67108864", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "set_keepcaps": "false", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "setgroup": "", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "setuser": "", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "setuser_match_path": "", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "thp": "false", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "threadpool_default_timeout": "60", 2024-09-12T05:20:08.517 INFO:teuthology.orchestra.run.smithi059.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T05:20:08.518 INFO:teuthology.orchestra.run.smithi059.stdout: "throttler_perf_counter": "true", 2024-09-12T05:20:08.518 INFO:teuthology.orchestra.run.smithi059.stdout: "tmp_dir": "/tmp", 2024-09-12T05:20:08.518 INFO:teuthology.orchestra.run.smithi059.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-12T05:20:08.518 INFO:teuthology.orchestra.run.smithi059.stdout: "uadk_compressor_enabled": "false", 2024-09-12T05:20:08.518 INFO:teuthology.orchestra.run.smithi059.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-12T05:20:08.518 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:08.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T05:20:08.666 INFO:teuthology.orchestra.run.smithi059.stdout:mon.a: {} 2024-09-12T05:20:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T05:20:08.680 INFO:teuthology.orchestra.run.smithi059.stdout:mon.b: {} 2024-09-12T05:20:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T05:20:08.689 INFO:teuthology.orchestra.run.smithi059.stdout:mon.c: {} 2024-09-12T05:20:08.689 INFO:teuthology.orchestra.run.smithi059.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T05:20:08.706 DEBUG:teuthology.orchestra.run.smithi059:> type ceph-objectstore-tool 2024-09-12T05:20:08.710 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T05:20:08.710 DEBUG:teuthology.orchestra.run.smithi194:> type ceph-objectstore-tool 2024-09-12T05:20:08.715 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T05:20:08.716 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-12T05:20:08.726 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-12T05:20:08.727 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T05:20:08.727 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:08.727 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:08.727 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:08.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 6 2024-09-12T05:20:08.728 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T05:20:08.728 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T05:20:08.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:08.729 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T05:20:08.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:08.729 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T05:20:08.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:20:08.730 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-12T05:20:08.751 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:08.754+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:08.774 INFO:teuthology.orchestra.run.smithi059.stdout:mapped writes DISABLED 2024-09-12T05:20:08.774 INFO:teuthology.orchestra.run.smithi059.stdout:mapped reads DISABLED 2024-09-12T05:20:08.774 INFO:teuthology.orchestra.run.smithi059.stdout:Seed set to 3966 2024-09-12T05:20:08.830 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:08.830+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:08.873 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:08.873 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:08.873 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:08.873 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:08.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:08.928 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:08.930 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:08.930+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:08.958 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:08.996 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:08.996 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:09.026 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:09.026 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:09.030 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:09.034+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:09.051 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:09.051 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:09.061 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:09.062 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:09.067 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:09.083 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:09.083 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:09.104 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:09.124 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:09.125 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:09.131 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:09.130+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:09.133 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-12T05:20:09.134+0000 7f6402832640 -1 mon.a@0(leader).osd e23 definitely_dead 0 2024-09-12T05:20:09.192 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:09.192 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:09.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:09.251 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:09.254+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:09.315 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:09.315 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:09.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:09.334 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:09.334+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:09.434 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:09.434+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:09.481 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:09.482 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:09.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:09.535 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:09.534+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:09.614 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:09.614 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:09.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:09.675 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:09.678+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:09.717 INFO:teuthology.orchestra.run.smithi059.stderr:marked out osd.6. 2024-09-12T05:20:09.721 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:20:09.738 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:09.738+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:09.760 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:09.761 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:09.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:09.863 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:09.866+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:09.939 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:09.939 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:09.940 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:09.942+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:09.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:10.041 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:10.042+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:10.114 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:10.114 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:10.129 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:10.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:10.142+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:10.243 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:10.246+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:10.297 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:10.297 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:10.310 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:10.344 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:10.342+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:10.445 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:10.446+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:10.477 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:10.478 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:10.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:10.546 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:10.550+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:10.622 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:10.623 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:10.637 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:10.683 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:10.686+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:10.748 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:10.750+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:10.773 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:10.773 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:10.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:10.848 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:10.850+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:10.905 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:10.905 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:10.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:10.961 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:10.962+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:11.050 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:11.050+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:11.085 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:11.085 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:11.099 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:11.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:11.191 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:11.194+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:11.252 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:11.250+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:11.266 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:11.266 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:11.281 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:11.300 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:11.300 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:11.317 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:11.336 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:11.352 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:11.354+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:11.353 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:11.371 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:11.390 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:11.409 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:11.410 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:11.430 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:11.430 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:11.453 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:11.454+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:11.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:11.553 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:11.554+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4266.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:59.919713+0000", 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.712252695, 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065168600000000002, 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:11.631 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4266", 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1459658516", 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.919713+0000", 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.919713+0000", 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.919725+0000", 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2279999999999999e-05 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.919736+0000", 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.148e-05 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.919771+0000", 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4337e-05 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.919796+0000", 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5323000000000001e-05 2024-09-12T05:20:11.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.919979+0000", 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000182735 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.920332+0000", 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000353147 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:11.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.920686+0000", 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000354221 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.922072+0000", 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013854060000000001 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925953+0000", 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038814969999999998 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.926111+0000", 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015782200000000001 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.926229+0000", 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118612 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4266.0:1 2.3 e20/19 ondisk, result = 0)", 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:59.925684+0000", 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.706281777000001, 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056384200000000005, 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925684+0000", 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925684+0000", 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925685+0000", 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9099999999999999e-06 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925698+0000", 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2916e-05 2024-09-12T05:20:11.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925733+0000", 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5117000000000003e-05 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925756+0000", 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2103000000000002e-05 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925910+0000", 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000154919 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.925938+0000", 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7426000000000001e-05 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.926247+0000", 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030945099999999998 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.641 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4266.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:59.931797+0000", 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.700168221, 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000547092, 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4266", 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1459658516", 2024-09-12T05:20:11.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.931797+0000", 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.931797+0000", 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.931800+0000", 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8930000000000001e-06 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.931818+0000", 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8496999999999999e-05 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.931849+0000", 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0645999999999998e-05 2024-09-12T05:20:11.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.931865+0000", 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5637e-05 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932017+0000", 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015272800000000001 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:11.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932344+0000", 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032669099999999999 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4266.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:59.932730+0000", 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.699235092, 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049769600000000005, 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:11.646 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4266", 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1459658516", 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932730+0000", 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:11.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932730+0000", 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932733+0000", 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.34e-06 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932752+0000", 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.963e-05 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932783+0000", 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1210000000000001e-05 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932801+0000", 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8057e-05 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.932960+0000", 2024-09-12T05:20:11.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015820100000000001 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:59.933228+0000", 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026825800000000001 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4266.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:00.920165+0000", 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.711800295, 2024-09-12T05:20:11.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0068717939999999996, 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4266", 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1459658516", 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 5 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.920165+0000", 2024-09-12T05:20:11.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.920165+0000", 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.920169+0000", 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6169999999999998e-06 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:11.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.920189+0000", 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0523e-05 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.920226+0000", 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6739999999999997e-05 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.920245+0000", 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9012999999999999e-05 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.920384+0000", 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139262 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.920395+0000", 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.059e-05 2024-09-12T05:20:11.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.923647+0000", 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032524950000000002 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.923867+0000", 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021985099999999999 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:11.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.924075+0000", 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000207846 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.925533+0000", 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014579180000000001 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926874+0000", 2024-09-12T05:20:11.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001341603 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926954+0000", 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9672999999999994e-05 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.927037+0000", 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2663000000000005e-05 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4266.0:5 2.2 e21/19 ondisk, result = 0)", 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:00.926685+0000", 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.705280761999999, 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036922700000000002, 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926685+0000", 2024-09-12T05:20:11.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926685+0000", 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926687+0000", 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926697+0000", 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0137e-05 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926725+0000", 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8243e-05 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926743+0000", 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7742999999999999e-05 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926850+0000", 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107279 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.926866+0000", 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5656999999999999e-05 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:00.927054+0000", 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018816500000000001 2024-09-12T05:20:11.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4266.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:01.938105+0000", 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6938606810000003, 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0030842460000000001, 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:11.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4266", 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1459658516", 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938105+0000", 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938105+0000", 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938108+0000", 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938123+0000", 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.509e-05 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:11.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938154+0000", 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1538999999999997e-05 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938172+0000", 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8136999999999999e-05 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938324+0000", 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000151488 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938471+0000", 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014694900000000001 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.938689+0000", 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021797200000000001 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940441+0000", 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017517800000000001 2024-09-12T05:20:11.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940893+0000", 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00045280599999999999 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.941062+0000", 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016895899999999999 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:11.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.941189+0000", 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012657200000000001 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4266.0:7 2.2 e22/19 ondisk, result = 0)", 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:01.940651+0000", 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6913140210000002, 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00055624600000000004, 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:11.670 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940651+0000", 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940651+0000", 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:11.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940653+0000", 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.564e-06 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940662+0000", 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0960000000000007e-06 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:11.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940685+0000", 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.279e-05 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940723+0000", 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7876999999999997e-05 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940848+0000", 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012551199999999999 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.940874+0000", 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5400000000000001e-05 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:01.941208+0000", 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00033400699999999999 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:11.674 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:11.676 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:11.677 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:11.678+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:11.761 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:20:11.807 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:11.810+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:11.851 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:11.851 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:11.851 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:11.851 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:11.865 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:11.877 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:11.878+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:11.978 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:11.978+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:11.986 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:11.986 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:11.986 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:11.986 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:11.986 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:12.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:12.079 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:12.078+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:12.123 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:12.123 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:12.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:12.123 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [] 2024-09-12T05:20:12.123 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:12.136 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:12.181 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:12.182+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:12.282 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:12.282+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:12.302 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:12.302 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:12.302 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:12.302 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:12.316 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:12.382 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:12.382+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:12.483 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:12.486+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:12.489 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:12.489 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:12.489 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:12.489 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:12.489 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:12.503 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:12.583 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:12.586+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:12.624 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:12.624 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:12.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:12.624 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:12.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.743742808, 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.10902002500000001, 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878726+0000", 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:20:12.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878741+0000", 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4696e-05 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878767+0000", 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5812999999999998e-05 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878789+0000", 2024-09-12T05:20:12.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.179e-05 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878868+0000", 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9116999999999995e-05 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878878+0000", 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8549999999999997e-06 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.984853+0000", 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.105974939 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985185+0000", 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000332827 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985604+0000", 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000418477 2024-09-12T05:20:12.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.986868+0000", 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001264004 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987594+0000", 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072604400000000002 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987679+0000", 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4826000000000004e-05 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987744+0000", 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4716999999999997e-05 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.488168334000001, 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016500958999999999, 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 42 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134299+0000", 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134306+0000", 2024-09-12T05:20:12.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9399999999999996e-06 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134317+0000", 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0837e-05 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134324+0000", 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.138682+0000", 2024-09-12T05:20:12.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004357072 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.138911+0000", 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022904199999999999 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.139320+0000", 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040928999999999998 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.143904+0000", 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045844750000000002 2024-09-12T05:20:12.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150511+0000", 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066061560000000002 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150667+0000", 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156062 2024-09-12T05:20:12.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150799+0000", 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013236199999999999 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.487876079999999, 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016623514999999998, 2024-09-12T05:20:12.637 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 43 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134591+0000", 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.11e-06 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134599+0000", 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.627e-06 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134612+0000", 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3407000000000001e-05 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134622+0000", 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2e-06 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141025+0000", 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006403583 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141161+0000", 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135902 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141361+0000", 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000199989 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.146593+0000", 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052320429999999996 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151014+0000", 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044212720000000004 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151108+0000", 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3676000000000002e-05 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151214+0000", 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010570599999999999 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.487720907, 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016792813, 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 44 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134746+0000", 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-09-12T05:20:12.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134828+0000", 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1456000000000001e-05 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134841+0000", 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.312e-05 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134850+0000", 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7430000000000008e-06 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141992+0000", 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071420340000000002 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.142253+0000", 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026151199999999999 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.142632+0000", 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037914399999999999 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.148913+0000", 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062808880000000001 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151338+0000", 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024248749999999999 2024-09-12T05:20:12.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151425+0000", 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6322000000000005e-05 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151538+0000", 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113656 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.487485449000001, 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01686226, 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 45 2024-09-12T05:20:12.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134982+0000", 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4130000000000001e-06 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134993+0000", 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023e-05 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135038+0000", 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5970000000000002e-05 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135049+0000", 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0263e-05 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144033+0000", 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0089840030000000008 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144177+0000", 2024-09-12T05:20:12.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014395900000000001 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144405+0000", 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000228092 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.148928+0000", 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045228179999999996 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151679+0000", 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027509990000000001 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151773+0000", 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4802999999999993e-05 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151843+0000", 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9709999999999995e-05 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.487395694, 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017063834999999999, 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 46 2024-09-12T05:20:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135072+0000", 2024-09-12T05:20:12.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0400000000000005e-07 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135079+0000", 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0129999999999996e-06 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135092+0000", 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3349999999999999e-05 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135100+0000", 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6569999999999997e-06 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145135+0000", 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010035572 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145383+0000", 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000247731 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145742+0000", 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035916399999999998 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150864+0000", 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051218569999999996 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151961+0000", 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001096872 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152037+0000", 2024-09-12T05:20:12.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5945999999999994e-05 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152134+0000", 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7769000000000005e-05 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.487352309999999, 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018299068000000002, 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.660 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 47 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135115+0000", 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8599999999999997e-07 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135228+0000", 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112936 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135265+0000", 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7426999999999999e-05 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135280+0000", 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4693e-05 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147037+0000", 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011756951 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147310+0000", 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027367800000000002 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147689+0000", 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037831399999999998 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151564+0000", 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038754779999999999 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153266+0000", 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017021600000000001 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153350+0000", 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3829e-05 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153413+0000", 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2816000000000003e-05 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.665 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.487165975, 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018428901000000001, 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 48 2024-09-12T05:20:12.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135301+0000", 2024-09-12T05:20:12.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023e-06 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135308+0000", 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8499999999999996e-06 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135321+0000", 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3157e-05 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135329+0000", 2024-09-12T05:20:12.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6860000000000006e-06 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149031+0000", 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013702147 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149176+0000", 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014521299999999999 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149426+0000", 2024-09-12T05:20:12.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024937100000000002 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152156+0000", 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027301320000000001 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153560+0000", 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001403856 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153662+0000", 2024-09-12T05:20:12.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010180599999999999 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153729+0000", 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7659999999999999e-05 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.487122672000002, 2024-09-12T05:20:12.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021491874000000001, 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 49 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4000000000000001e-07 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135351+0000", 2024-09-12T05:20:12.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135361+0000", 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135368+0000", 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152252+0000", 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016884542999999998 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152387+0000", 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013445500000000001 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152594+0000", 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020751600000000001 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156614+0000", 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040193820000000002 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156659+0000", 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5498999999999999e-05 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156774+0000", 2024-09-12T05:20:12.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011445199999999999 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156836+0000", 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1953999999999997e-05 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.487085656000001, 2024-09-12T05:20:12.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022587169000000001, 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 50 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9400000000000005e-07 2024-09-12T05:20:12.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135461+0000", 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0111999999999995e-05 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135481+0000", 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9150000000000001e-05 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135496+0000", 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5486999999999999e-05 2024-09-12T05:20:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153835+0000", 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018339030999999999 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.154049+0000", 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000214119 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.154289+0000", 2024-09-12T05:20:12.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023974099999999999 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157804+0000", 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035150989999999998 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157826+0000", 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1883e-05 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157900+0000", 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3780000000000002e-05 2024-09-12T05:20:12.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157968+0000", 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8072999999999997e-05 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.486939747000001, 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022671417999999999, 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.683 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 51 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135528+0000", 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3969999999999999e-06 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135540+0000", 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1737e-05 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135559+0000", 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9123e-05 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135573+0000", 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3719e-05 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155276+0000", 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019703064999999999 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155411+0000", 2024-09-12T05:20:12.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013550199999999999 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155623+0000", 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021140500000000001 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158032+0000", 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002409015 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158059+0000", 2024-09-12T05:20:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7518999999999999e-05 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158139+0000", 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0286999999999999e-05 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158198+0000", 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8649e-05 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.486829840999999, 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023015342000000001, 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 52 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135638+0000", 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5600000000000001e-06 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135651+0000", 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.326e-05 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135672+0000", 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0780000000000001e-05 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135693+0000", 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1095999999999999e-05 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156933+0000", 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021240146000000001 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157096+0000", 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016222900000000001 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157301+0000", 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020542100000000001 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158464+0000", 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001163054 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158500+0000", 2024-09-12T05:20:12.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6157e-05 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158578+0000", 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7359000000000003e-05 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158652+0000", 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.428e-05 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.234340431, 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013423977, 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 69 2024-09-12T05:20:12.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388127+0000", 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0529999999999999e-06 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388230+0000", 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010274500000000001 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388246+0000", 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6742e-05 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388258+0000", 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1109e-05 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.391889+0000", 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036317430000000002 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.392026+0000", 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137045 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.392236+0000", 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020941199999999999 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395594+0000", 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033585199999999998 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401431+0000", 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058363579999999998 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401493+0000", 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2335999999999994e-05 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401550+0000", 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6913999999999998e-05 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.700 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.234186035, 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013386148, 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 70 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388281+0000", 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8400000000000002e-07 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388290+0000", 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8659999999999995e-06 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388306+0000", 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5430999999999998e-05 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388314+0000", 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5189999999999992e-06 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395647+0000", 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073332930000000003 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395758+0000", 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011106400000000001 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395929+0000", 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170349 2024-09-12T05:20:12.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401409+0000", 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054803860000000003 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401561+0000", 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000151941 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401619+0000", 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8279000000000002e-05 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401666+0000", 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7036000000000002e-05 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:12.706 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.234134747999999, 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013501121, 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 71 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:12.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.54e-07 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388339+0000", 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8850000000000001e-06 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388356+0000", 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6643e-05 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388364+0000", 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5529999999999993e-06 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396392+0000", 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.008027536 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396460+0000", 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8031e-05 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396563+0000", 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401677+0000", 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051139849999999997 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401753+0000", 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5506999999999994e-05 2024-09-12T05:20:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401797+0000", 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4532e-05 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401833+0000", 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5222999999999998e-05 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.234048920999999, 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013626012, 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 72 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388418+0000", 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2500000000000004e-07 2024-09-12T05:20:12.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388492+0000", 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3240999999999999e-05 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388503+0000", 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1878999999999999e-05 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388512+0000", 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8789999999999992e-06 2024-09-12T05:20:12.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396954+0000", 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0084420309999999991 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.397049+0000", 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4588999999999998e-05 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.397215+0000", 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016635599999999999 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401915+0000", 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046998910000000003 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401933+0000", 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7844000000000001e-05 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401991+0000", 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7742999999999999e-05 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402043+0000", 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2633999999999998e-05 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:12.718 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.233931599999998, 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016972929000000001, 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 73 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:12.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388536+0000", 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7000000000000003e-07 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388544+0000", 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8859999999999993e-06 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388556+0000", 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1289e-05 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388564+0000", 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400688+0000", 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012124731 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400781+0000", 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2958e-05 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400934+0000", 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015275600000000001 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403647+0000", 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027130800000000001 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405434+0000", 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017866889999999999 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405473+0000", 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8723000000000002e-05 2024-09-12T05:20:12.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405508+0000", 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4984000000000003e-05 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.233881715999999, 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017101682999999999, 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 74 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388593+0000", 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3270000000000003e-06 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388603+0000", 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9159999999999996e-06 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388610+0000", 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1679999999999998e-06 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402091+0000", 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013480779 2024-09-12T05:20:12.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402157+0000", 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6842999999999997e-05 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402265+0000", 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010712700000000001 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403660+0000", 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001395213 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405565+0000", 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001905166 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405635+0000", 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9840999999999998e-05 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405686+0000", 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1499000000000003e-05 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.233835541000001, 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017927399, 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 75 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388632+0000", 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388719+0000", 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7251999999999997e-05 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388733+0000", 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3900000000000001e-05 2024-09-12T05:20:12.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388752+0000", 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9519999999999999e-05 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402653+0000", 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013900538 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402765+0000", 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011212199999999999 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402936+0000", 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017109699999999999 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.404269+0000", 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013328400000000001 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406480+0000", 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022108700000000002 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406519+0000", 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9730000000000001e-05 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406558+0000", 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8736999999999999e-05 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.233694324999998, 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018396794000000001, 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:12.736 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 76 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:12.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388773+0000", 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6199999999999996e-07 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388780+0000", 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3170000000000004e-06 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:12.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388791+0000", 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417e-05 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388809+0000", 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8377999999999999e-05 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403692+0000", 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014883234 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:12.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403762+0000", 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0088999999999999e-05 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403867+0000", 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104627 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.404656+0000", 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078953200000000002 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407056+0000", 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002399502 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407119+0000", 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3186000000000001e-05 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:12.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:12.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407169+0000", 2024-09-12T05:20:12.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9650000000000001e-05 2024-09-12T05:20:12.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.742 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:12.742 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:12.742 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:12.743 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:20:12.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:12.742+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:12.744 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:12.844 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:12.846+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:12.872 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:12.873 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:12.873 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:12.873 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:12.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:12.945 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:12.946+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:13.042 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:13.042 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:13.042 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:13.042 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:13.042 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:13.046 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:13.046+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:13.056 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:13.147 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:13.146+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:13.173 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:13.173 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:20 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'10, mlcod=17'8)", 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.027594+0000", 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.147501427999998, 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029438340000000002, 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.027594+0000", 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.027594+0000", 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.027596+0000", 2024-09-12T05:20:13.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.714e-06 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.027895+0000", 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029903800000000001 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.027921+0000", 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.603e-05 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.027933+0000", 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.276e-05 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.028066+0000", 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013211899999999999 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.028126+0000", 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0299e-05 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030449+0000", 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023236049999999999 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030538+0000", 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8269000000000005e-05 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.178 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:21 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'11, mlcod=17'8)", 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.029228+0000", 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.145867506999998, 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035043470000000001, 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029228+0000", 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029228+0000", 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029229+0000", 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.694e-06 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029408+0000", 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017856099999999999 2024-09-12T05:20:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029440+0000", 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.154e-05 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029460+0000", 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.075e-05 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029590+0000", 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000129949 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029646+0000", 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5776000000000003e-05 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032593+0000", 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029467650000000001 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032732+0000", 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000139312 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:22 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'12, mlcod=17'8)", 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.030861+0000", 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.144234102999999, 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047448179999999996, 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030861+0000", 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030861+0000", 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030868+0000", 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3369999999999996e-06 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030991+0000", 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012322900000000001 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.031016+0000", 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5497e-05 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.031036+0000", 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9306000000000001e-05 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.031203+0000", 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167205 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.031239+0000", 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6329999999999999e-05 2024-09-12T05:20:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.035532+0000", 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042928109999999997 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.035606+0000", 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103000000000005e-05 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:23 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'13, mlcod=17'8)", 2024-09-12T05:20:13.187 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.032497+0000", 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.142598779, 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003462391, 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032497+0000", 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032497+0000", 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032499+0000", 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.407e-06 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032574+0000", 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5506000000000005e-05 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032602+0000", 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7267000000000002e-05 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032619+0000", 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.774e-05 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032787+0000", 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167205 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032821+0000", 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4526000000000001e-05 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.035867+0000", 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003046034 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.035959+0000", 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1706000000000006e-05 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.191 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:24 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'14, mlcod=17'10)", 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.034551+0000", 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.140543927, 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034047270000000002, 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034551+0000", 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034551+0000", 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034552+0000", 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034599+0000", 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6422999999999999e-05 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034622+0000", 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3298999999999998e-05 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034640+0000", 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7989999999999999e-05 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034793+0000", 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015279200000000001 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034832+0000", 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8627000000000001e-05 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.037846+0000", 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030147630000000002 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.037956+0000", 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109743 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:41 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'23, mlcod=17'19)", 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.139571+0000", 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.035524341999999, 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064674349999999997, 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.196 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139571+0000", 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139571+0000", 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139572+0000", 2024-09-12T05:20:13.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0529999999999999e-06 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139660+0000", 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7546000000000005e-05 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139675+0000", 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.501e-05 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139684+0000", 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5230000000000001e-06 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139780+0000", 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6137999999999993e-05 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139800+0000", 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0106999999999999e-05 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.145981+0000", 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061806650000000001 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146038+0000", 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7392999999999998e-05 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:42 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'24, mlcod=17'19)", 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.141467+0000", 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.033628284999999, 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076791079999999996, 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.200 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141467+0000", 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141467+0000", 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141468+0000", 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5700000000000001e-07 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141473+0000", 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1680000000000003e-06 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141487+0000", 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3473e-05 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141503+0000", 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6174000000000001e-05 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141598+0000", 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5470000000000006e-05 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141616+0000", 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7844000000000001e-05 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149096+0000", 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074798750000000004 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149146+0000", 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0247000000000002e-05 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:43 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'25, mlcod=17'21)", 2024-09-12T05:20:13.204 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.143494+0000", 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.031600822000001, 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056750259999999997, 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143494+0000", 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143494+0000", 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143495+0000", 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0999999999999997e-07 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143516+0000", 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1180000000000001e-05 2024-09-12T05:20:13.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143530+0000", 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3534e-05 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143540+0000", 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9340000000000001e-06 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143678+0000", 2024-09-12T05:20:13.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013800999999999999 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143716+0000", 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7633999999999999e-05 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149148+0000", 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054324689999999997 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149169+0000", 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1455e-05 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:44 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'26, mlcod=17'21)", 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.144848+0000", 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.030246824999999, 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047816760000000003, 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.209 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144848+0000", 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144848+0000", 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144849+0000", 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2699999999999999e-07 2024-09-12T05:20:13.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144914+0000", 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5094999999999999e-05 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144928+0000", 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3577999999999999e-05 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144937+0000", 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0149999999999992e-06 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.145034+0000", 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6749000000000005e-05 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.145050+0000", 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6398000000000001e-05 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149563+0000", 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045126510000000003 2024-09-12T05:20:13.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149630+0000", 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7563000000000003e-05 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:45 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'27, mlcod=17'21)", 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.146590+0000", 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.028504936000001, 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030926460000000001, 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.213 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146590+0000", 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146590+0000", 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146591+0000", 2024-09-12T05:20:13.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5700000000000002e-07 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146596+0000", 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.809e-06 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146609+0000", 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3023999999999999e-05 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146618+0000", 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1030000000000008e-06 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146681+0000", 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2737999999999995e-05 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146698+0000", 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7153999999999999e-05 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149640+0000", 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002942442 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149683+0000", 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2719000000000002e-05 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.217 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:64 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'40)", 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.389416+0000", 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.785679167000001, 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032279589999999999, 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.389416+0000", 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.389416+0000", 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.389418+0000", 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6869999999999999e-06 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.389429+0000", 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1060000000000001e-05 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.389457+0000", 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8385999999999999e-05 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.389471+0000", 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3713000000000001e-05 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.389598+0000", 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000126539 2024-09-12T05:20:13.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.389656+0000", 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8189999999999997e-05 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.392583+0000", 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029269140000000001 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.392644+0000", 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1470000000000006e-05 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.391066+0000", 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.784028942999999, 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003291282, 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.222 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.391066+0000", 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.391066+0000", 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.391069+0000", 2024-09-12T05:20:13.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.187e-06 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.391208+0000", 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000139522 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.391237+0000", 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8673000000000001e-05 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.391254+0000", 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7235999999999999e-05 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.391363+0000", 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109473 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.391396+0000", 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2190000000000002e-05 2024-09-12T05:20:13.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.394295+0000", 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028995010000000001 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.394358+0000", 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2500000000000001e-05 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'45)", 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.403105+0000", 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.771990739, 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040138930000000001, 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403105+0000", 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403105+0000", 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403106+0000", 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4869999999999999e-06 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403118+0000", 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.17e-05 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403143+0000", 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5323000000000001e-05 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403157+0000", 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3456e-05 2024-09-12T05:20:13.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403304+0000", 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147906 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403370+0000", 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5133000000000001e-05 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.407035+0000", 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036656649999999998 2024-09-12T05:20:13.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.407118+0000", 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3222999999999999e-05 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'49)", 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.405152+0000", 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.769943261000002, 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003027563, 2024-09-12T05:20:13.231 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.405152+0000", 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.405152+0000", 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.405154+0000", 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.593e-06 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.405230+0000", 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6693000000000006e-05 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.405270+0000", 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0126000000000002e-05 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.405282+0000", 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.135e-05 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.405477+0000", 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019570500000000001 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.405535+0000", 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7516999999999998e-05 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.408082+0000", 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025468729999999998 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.408180+0000", 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7706000000000003e-05 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.235 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.410095+0000", 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.765000152999999, 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032963150000000002, 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410095+0000", 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410095+0000", 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410097+0000", 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.334e-06 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410222+0000", 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125012 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410254+0000", 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1143000000000003e-05 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410268+0000", 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3873000000000001e-05 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410392+0000", 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012417600000000001 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410452+0000", 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.029e-05 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.413298+0000", 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028458509999999999 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.413391+0000", 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3635999999999996e-05 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:11.754943+0000", 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.420152385, 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090034469999999995, 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754943+0000", 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754943+0000", 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754946+0000", 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4369999999999999e-06 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754964+0000", 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7669e-05 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754995+0000", 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1430000000000002e-05 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.755013+0000", 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7243000000000001e-05 2024-09-12T05:20:13.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.755154+0000", 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014086900000000001 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.755165+0000", 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1347e-05 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.759737+0000", 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045725210000000004 2024-09-12T05:20:13.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.760073+0000", 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00033558699999999998 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.760552+0000", 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000478553 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.763168+0000", 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026163029999999999 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.763666+0000", 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00049852299999999996 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.763829+0000", 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016230199999999999 2024-09-12T05:20:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.763946+0000", 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000117663 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:12 3.1f 3:ff982a43:::rbd_header.1118c379fb68:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:11.764148+0000", 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.41094714, 2024-09-12T05:20:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029824080000000002, 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 12 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.764148+0000", 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.764148+0000", 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.764150+0000", 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.136e-06 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.764167+0000", 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7104000000000001e-05 2024-09-12T05:20:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.764196+0000", 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.904e-05 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.764216+0000", 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9202999999999999e-05 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.764357+0000", 2024-09-12T05:20:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014113900000000001 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.764759+0000", 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040241700000000002 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.765460+0000", 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00070072099999999996 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.766664+0000", 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001204304 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.766813+0000", 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014870199999999999 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767001+0000", 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188226 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767131+0000", 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012941600000000001 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:13 3.17 3:e973cf78:::rbd_object_map.1118c379fb68:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:11.767394+0000", 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.407701758, 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036860450000000002, 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 13 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767394+0000", 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767394+0000", 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767396+0000", 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0099999999999998e-06 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767406+0000", 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0706999999999999e-05 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767437+0000", 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1068999999999997e-05 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767452+0000", 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.508e-05 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767625+0000", 2024-09-12T05:20:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017300599999999999 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767985+0000", 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00035931 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.768473+0000", 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00048837900000000005 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.770006+0000", 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015326319999999999 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.770823+0000", 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00081693399999999995 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.770953+0000", 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012985899999999999 2024-09-12T05:20:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.771080+0000", 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127059 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:15 3.1f 3:fa654f18:::rbd_id.image_client.0:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:11.777851+0000", 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.3972446029999999, 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031113130000000001, 2024-09-12T05:20:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 15 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.777851+0000", 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.777851+0000", 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.777853+0000", 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3410000000000001e-06 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.777865+0000", 2024-09-12T05:20:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2337000000000001e-05 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.777881+0000", 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5855999999999999e-05 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.777890+0000", 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6880000000000005e-06 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.777954+0000", 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4393999999999994e-05 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.778019+0000", 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5094999999999999e-05 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.780962+0000", 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029426019999999999 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:25 3.1f 3:ff982a43:::rbd_header.1118c379fb68:head [watch watch cookie 140195248844976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:11.788685+0000", 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.386410793, 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029305120000000001, 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 25 2024-09-12T05:20:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.788685+0000", 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.788685+0000", 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.788686+0000", 2024-09-12T05:20:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5629999999999999e-06 2024-09-12T05:20:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.788694+0000", 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4880000000000001e-06 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.788717+0000", 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3679000000000001e-05 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.788746+0000", 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9187999999999999e-05 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.788833+0000", 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7032000000000003e-05 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.788968+0000", 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013425399999999999 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.789215+0000", 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000247493 2024-09-12T05:20:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.790281+0000", 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010653889999999999 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.791515+0000", 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001234686 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.791559+0000", 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4088999999999997e-05 2024-09-12T05:20:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.791615+0000", 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5651e-05 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:13.269 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:13.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:13.271 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:13.270+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:13.372 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:13.374+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:13.392 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:13.392 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:13.393 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:13.393 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:13.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:13.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:13.491 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:13.494+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:13.570 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:13.570 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:13.571 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:13.571 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:13.571 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:13.573 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:13.574+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:13.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:13.629 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:13.629 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:13.646 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:13.663 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:13.673 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:13.674+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:13.682 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:13.692 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:13.692 INFO:teuthology.orchestra.run.smithi059.stdout:skipping zero size read 2024-09-12T05:20:13.700 INFO:teuthology.orchestra.run.smithi059.stdout:3 write 0xc1567 thru 0xc8147 (0x6be1 bytes) 2024-09-12T05:20:13.704 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:13.726 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:13.727 INFO:teuthology.orchestra.run.smithi059.stdout:4 write 0xb1e8d7f thru 0xb1ed391 (0x4613 bytes) 2024-09-12T05:20:13.734 INFO:teuthology.orchestra.run.smithi059.stdout:truncating to largest ever: 0x7ebb83d 2024-09-12T05:20:13.738 INFO:teuthology.orchestra.run.smithi059.stdout:5 trunc from 0xb1ed392 to 0x7ebb83d 2024-09-12T05:20:13.750 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:13.751 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:13.751 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:13.756 INFO:teuthology.orchestra.run.smithi059.stdout:6 read 0x46501f3 thru 0x465bc5e (0xba6c bytes) 2024-09-12T05:20:13.764 INFO:teuthology.orchestra.run.smithi059.stdout:7 writesame 0x8044a1b thru 0x8047b54 data_size 0x1(0x313a bytes) 2024-09-12T05:20:13.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:13.772 INFO:teuthology.orchestra.run.smithi059.stdout:9 write 0x89e351a thru 0x89e79c6 (0x44ad bytes) 2024-09-12T05:20:13.774 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:13.774+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:13.779 INFO:teuthology.orchestra.run.smithi059.stdout:12 write 0x72525e1 thru 0x72589c7 (0x63e7 bytes) 2024-09-12T05:20:13.780 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout:13 writesame 0xd0a130b thru 0xd0a6359 data_size 0x4d(0x504f bytes) 2024-09-12T05:20:13.812 INFO:teuthology.orchestra.run.smithi059.stdout:14 trunc from 0xd0a635a to 0x1724f4a 2024-09-12T05:20:13.828 INFO:teuthology.orchestra.run.smithi059.stdout:15 punch from 0xa912fb to 0xa923e1, (0x10e6 bytes) 2024-09-12T05:20:13.828 INFO:teuthology.orchestra.run.smithi059.stdout:16 read 0x15bc4f9 thru 0x15c097a (0x4482 bytes) 2024-09-12T05:20:13.841 INFO:teuthology.orchestra.run.smithi059.stdout:17 writesame 0x5faa438 thru 0x5faf3f9 data_size 0x29(0x4fc2 bytes) 2024-09-12T05:20:13.841 INFO:teuthology.orchestra.run.smithi059.stdout:19 write 0x47789c1 thru 0x477a867 (0x1ea7 bytes) 2024-09-12T05:20:13.858 INFO:teuthology.orchestra.run.smithi059.stdout:20 write 0x82a6ba0 thru 0x82b349b (0xc8fc bytes) 2024-09-12T05:20:13.865 INFO:teuthology.orchestra.run.smithi059.stdout:21 write 0x1e84beb thru 0x1e933d7 (0xe7ed bytes) 2024-09-12T05:20:13.871 INFO:teuthology.orchestra.run.smithi059.stdout:22 read 0x2a6801 thru 0x2ae1aa (0x79aa bytes) 2024-09-12T05:20:13.872 INFO:teuthology.orchestra.run.smithi059.stdout:23 read 0x1d3d0be thru 0x1d3fc61 (0x2ba4 bytes) 2024-09-12T05:20:13.873 INFO:teuthology.orchestra.run.smithi059.stdout:24 read 0x2f67fb6 thru 0x2f762ac (0xe2f7 bytes) 2024-09-12T05:20:13.875 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:13.878+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:13.891 INFO:teuthology.orchestra.run.smithi059.stdout:25 write 0xb53bc3e thru 0xb53cf44 (0x1307 bytes) 2024-09-12T05:20:13.898 INFO:teuthology.orchestra.run.smithi059.stdout:26 punch from 0x2883d6e to 0x2890e39, (0xd0cb bytes) 2024-09-12T05:20:13.898 INFO:teuthology.orchestra.run.smithi059.stdout:27 clone 1 order 18 su 131072 sc 3 2024-09-12T05:20:13.898 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:13.898 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:13.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:13.999 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:14.002+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:14.074 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:14.074 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:14.078 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:14.078+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:14.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:14.179 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:14.178+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:14.252 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:14.252 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:14.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:14.311 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:14.314+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:14.380 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:14.382+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:14.385 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:14.386 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:14.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:14.481 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:14.482+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:14.554 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:14.555 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:14.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:14.615 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:14.618+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:14.678 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:14.678 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:14.683 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:14.682+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:14.691 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:14.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:20:14.762 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:14.762 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:14.763 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T05:20:14.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:20:14.783 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:14.782+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:14.826 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:14.827 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:14.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:14.885 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:14.886+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:14.960 INFO:teuthology.orchestra.run.smithi059.stdout:28 writesame 0x5344c82 thru 0x534f43c data_size 0x27(0xa7bb bytes) 2024-09-12T05:20:14.980 INFO:teuthology.orchestra.run.smithi059.stdout:29 trunc from 0xb53cf45 to 0x53cab28 2024-09-12T05:20:14.985 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:14.986+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:15.007 INFO:teuthology.orchestra.run.smithi059.stdout:30 writesame 0xa3aba5f thru 0xa3ae564 data_size 0x1(0x2b06 bytes) 2024-09-12T05:20:15.008 INFO:teuthology.orchestra.run.smithi059.stdout:32 write 0x8510b20 thru 0x851da15 (0xcef6 bytes) 2024-09-12T05:20:15.009 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:15.010 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:15.012 INFO:teuthology.orchestra.run.smithi059.stdout:33 read 0x2a8d0e3 thru 0x2a9c402 (0xf320 bytes) 2024-09-12T05:20:15.012 INFO:teuthology.orchestra.run.smithi059.stdout:34 read 0x9d5705c thru 0x9d58aa2 (0x1a47 bytes) 2024-09-12T05:20:15.012 INFO:teuthology.orchestra.run.smithi059.stdout:35 write 0x4213875 thru 0x421b014 (0x77a0 bytes) 2024-09-12T05:20:15.017 INFO:teuthology.orchestra.run.smithi059.stdout:37 read 0x4662a1e thru 0x467226a (0xf84d bytes) 2024-09-12T05:20:15.018 INFO:teuthology.orchestra.run.smithi059.stdout:38 read 0xa06ffa6 thru 0xa077f98 (0x7ff3 bytes) 2024-09-12T05:20:15.018 INFO:teuthology.orchestra.run.smithi059.stdout:40 write 0x1398d01 thru 0x13a458f (0xb88f bytes) 2024-09-12T05:20:15.023 INFO:teuthology.orchestra.run.smithi059.stdout:41 read 0xe170dc thru 0xe1aaa1 (0x39c6 bytes) 2024-09-12T05:20:15.023 INFO:teuthology.orchestra.run.smithi059.stdout:43 write 0x799e0af thru 0x79a3f74 (0x5ec6 bytes) 2024-09-12T05:20:15.025 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:15.028 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.029 INFO:teuthology.orchestra.run.smithi059.stdout:truncating to largest ever: 0x9b3a157 2024-09-12T05:20:15.029 INFO:teuthology.orchestra.run.smithi059.stdout:45 trunc from 0xa3ae565 to 0x9b3a157 2024-09-12T05:20:15.054 INFO:teuthology.orchestra.run.smithi059.stdout:46 write 0xe599f7b thru 0xe5a2825 (0x88ab bytes) 2024-09-12T05:20:15.062 INFO:teuthology.orchestra.run.smithi059.stdout:47 read 0xc6782d4 thru 0xc683b55 (0xb882 bytes) 2024-09-12T05:20:15.062 INFO:teuthology.orchestra.run.smithi059.stdout:48 read 0xa582074 thru 0xa585750 (0x36dd bytes) 2024-09-12T05:20:15.062 INFO:teuthology.orchestra.run.smithi059.stdout:49 punch from 0x5608f5a to 0x56170f3, (0xe199 bytes) 2024-09-12T05:20:15.062 INFO:teuthology.orchestra.run.smithi059.stdout:50 punch from 0x4b206a5 to 0x4b249a1, (0x42fc bytes) 2024-09-12T05:20:15.062 INFO:teuthology.orchestra.run.smithi059.stdout:52 write 0x9075227 thru 0x9082528 (0xd302 bytes) 2024-09-12T05:20:15.072 INFO:teuthology.orchestra.run.smithi059.stdout:53 write 0x6b3e3bf thru 0x6b4333a (0x4f7c bytes) 2024-09-12T05:20:15.083 INFO:teuthology.orchestra.run.smithi059.stdout:56 read 0x42a284 thru 0x4302b1 (0x602e bytes) 2024-09-12T05:20:15.083 INFO:teuthology.orchestra.run.smithi059.stdout:58 punch from 0x3a45d54 to 0x3a50026, (0xa2d2 bytes) 2024-09-12T05:20:15.083 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.085 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:15.086+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:15.096 INFO:teuthology.orchestra.run.smithi059.stdout:60 trunc from 0xe5a2826 to 0x5e4a69c 2024-09-12T05:20:15.112 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.112 INFO:teuthology.orchestra.run.smithi059.stdout:63 punch from 0x3037fe to 0x3061dd, (0x29df bytes) 2024-09-12T05:20:15.128 INFO:teuthology.orchestra.run.smithi059.stdout:64 write 0xab88fdd thru 0xab928ce (0x98f2 bytes) 2024-09-12T05:20:15.132 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.144 INFO:teuthology.orchestra.run.smithi059.stdout:67 writesame 0xd4e4c65 thru 0xd4e5d62 data_size 0x1d(0x10fe bytes) 2024-09-12T05:20:15.144 INFO:teuthology.orchestra.run.smithi059.stdout:68 read 0xa7ef76a thru 0xa7fe765 (0xeffc bytes) 2024-09-12T05:20:15.144 INFO:teuthology.orchestra.run.smithi059.stdout:69 write 0xc7216d5 thru 0xc728f2c (0x7858 bytes) 2024-09-12T05:20:15.149 INFO:teuthology.orchestra.run.smithi059.stdout:70 read 0xaaf5e0b thru 0xaaf61d1 (0x3c7 bytes) 2024-09-12T05:20:15.149 INFO:teuthology.orchestra.run.smithi059.stdout:71 writesame 0x96616d1 thru 0x9662f29 data_size 0x17(0x1859 bytes) 2024-09-12T05:20:15.153 INFO:teuthology.orchestra.run.smithi059.stdout:truncating to largest ever: 0xc85ada8 2024-09-12T05:20:15.155 INFO:teuthology.orchestra.run.smithi059.stdout:72 trunc from 0xd4e5d63 to 0xc85ada8 2024-09-12T05:20:15.162 INFO:teuthology.orchestra.run.smithi059.stdout:75 write 0x7545336 thru 0x7551237 (0xbf02 bytes) 2024-09-12T05:20:15.166 INFO:teuthology.orchestra.run.smithi059.stdout:78 write 0x91b1590 thru 0x91bc3ba (0xae2b bytes) 2024-09-12T05:20:15.172 INFO:teuthology.orchestra.run.smithi059.stdout:80 punch from 0x8c36515 to 0x8c438a7, (0xd392 bytes) 2024-09-12T05:20:15.172 INFO:teuthology.orchestra.run.smithi059.stdout:82 writesame 0xb3a53d9 thru 0xb3a7b77 data_size 0x17(0x279f bytes) 2024-09-12T05:20:15.176 INFO:teuthology.orchestra.run.smithi059.stdout:truncating to largest ever: 0xe4a3656 2024-09-12T05:20:15.178 INFO:teuthology.orchestra.run.smithi059.stdout:83 trunc from 0xc85ada8 to 0xe4a3656 2024-09-12T05:20:15.186 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:15.186+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:15.187 INFO:teuthology.orchestra.run.smithi059.stdout:84 read 0x5c5cbf4 thru 0x5c67837 (0xac44 bytes) 2024-09-12T05:20:15.187 INFO:teuthology.orchestra.run.smithi059.stdout:85 write 0x2fdb05e thru 0x2fe0b33 (0x5ad6 bytes) 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 28, 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:20:14.721228+0000", 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:19:51.845158+0000", 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:20:09.718345+0000", 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:20:15.190 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5806080, 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "nodeep-scrub", 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "noscrub", 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 5, 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:20:15.191 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "jewel", 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:20:15.192 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:20:15.193 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:15.194 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:15.195 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:15.197 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:15.199 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:15.200 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:15.201 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:15.202 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:15.203 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 2.9900000095367432, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 2.9900000095367432, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2.630000114440918, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2.630000114440918, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:15.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:15.205 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:15.206 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "28", 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 3, 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 28, 2024-09-12T05:20:15.207 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:15.208 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:15.209 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.7400000095367432, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.7400000095367432, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-12T05:20:15.210 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:15.211 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:15.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:15.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:15.216 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:15.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:20:15.220 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:20:15.221 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.222 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 19, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:15.224 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.225 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:20:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:15.228 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:15.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:15.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:15.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:20:15.232 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:20:15.233 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:15.234 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.235 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:15.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/2467380900", 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/2467380900", 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/2467380900", 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/2467380900", 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:15.239 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:15.240 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 23, 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.242 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.244 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:20:15.245 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 0, 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 0, 2024-09-12T05:20:15.246 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 23, 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:15.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.248 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.249 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.250 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:20:15.251 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:15.252 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.253 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.254 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.255 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.256 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:20:15.258 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:20:15.259 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:15.260 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:20:15.261 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:20:15.262 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 65536, 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:15.263 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [], 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [], 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:20:15.264 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [ 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: "snaps": [ 2024-09-12T05:20:15.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "begin": 2, 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "length": 1 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:20:15.266 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:20:15.267 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:20:15.267 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:15.267 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:15.268 INFO:teuthology.orchestra.run.smithi059.stdout:86 write 0x6f6a008 thru 0x6f71c78 (0x7c71 bytes) 2024-09-12T05:20:15.268 INFO:teuthology.orchestra.run.smithi059.stdout:88 read 0xbdc4a89 thru 0xbdc8233 (0x37ab bytes) 2024-09-12T05:20:15.268 INFO:teuthology.orchestra.run.smithi059.stdout:90 write 0xa4f6a20 thru 0xa4f92bd (0x289e bytes) 2024-09-12T05:20:15.268 INFO:teuthology.orchestra.run.smithi059.stdout:91 writesame 0xc062fcd thru 0xc063b1c data_size 0x8(0xb50 bytes) 2024-09-12T05:20:15.269 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:15.269 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:15.269 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:15.271 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:20:14.721228+0000', 'last_up_change': '2024-09-12T05:19:51.845158+0000', 'last_in_change': '2024-09-12T05:20:09.718345+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 28, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 2467380900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 2467380900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 2467380900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 2467380900}]}, 'public_addr': '172.21.15.194:6825/2467380900', 'cluster_addr': '172.21.15.194:6827/2467380900', 'heartbeat_back_addr': '172.21.15.194:6831/2467380900', 'heartbeat_front_addr': '172.21.15.194:6829/2467380900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 2, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:20:15.271 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T05:20:15.272 INFO:teuthology.orchestra.run.smithi059.stdout:93 punch from 0x4e57dff to 0x4e5c52e, (0x472f bytes) 2024-09-12T05:20:15.272 INFO:teuthology.orchestra.run.smithi059.stdout:95 read 0xd5c50d1 thru 0xd5d50b2 (0xffe2 bytes) 2024-09-12T05:20:15.272 INFO:teuthology.orchestra.run.smithi059.stdout:96 write 0x541c3f6 thru 0x54283b3 (0xbfbe bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:98 read 0x5eb461d thru 0x5ebaadc (0x64c0 bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:102 write 0xc12ee65 thru 0xc134208 (0x53a4 bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:103 read 0xbeb280a thru 0xbec05e0 (0xddd7 bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:104 writesame 0x4c115fd thru 0x4c1a1d0 data_size 0x72(0x8bd4 bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:105 read 0x9766ed1 thru 0x9776ebf (0xffef bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:106 read 0x17c2177 thru 0x17c8a48 (0x68d2 bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:107 writesame 0x79e04c thru 0x7a6341 data_size 0x1(0x82f6 bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:109 read 0x4506ac thru 0x45b27e (0xabd3 bytes) 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.273 INFO:teuthology.orchestra.run.smithi059.stdout:114 trunc from 0xe4a3656 to 0x6a24e42 2024-09-12T05:20:15.293 INFO:teuthology.orchestra.run.smithi059.stdout:115 trunc from 0x6a24e42 to 0x113f1ff 2024-09-12T05:20:15.320 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:15.322+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:15.322 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.322 INFO:teuthology.orchestra.run.smithi059.stdout:118 read 0xf16fa8 thru 0xf1e0cf (0x7128 bytes) 2024-09-12T05:20:15.322 INFO:teuthology.orchestra.run.smithi059.stdout:119 read 0xf0fea1 thru 0xf1fbc1 (0xfd21 bytes) 2024-09-12T05:20:15.322 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.339 INFO:teuthology.orchestra.run.smithi059.stdout:121 writesame 0x401dc6c thru 0x4027afd data_size 0x1(0x9e92 bytes) 2024-09-12T05:20:15.358 INFO:teuthology.orchestra.run.smithi059.stdout:122 writesame 0x71f11fa thru 0x71fbf25 data_size 0x2(0xad2c bytes) 2024-09-12T05:20:15.358 INFO:teuthology.orchestra.run.smithi059.stdout:123 read 0x668ed92 thru 0x669c400 (0xd66f bytes) 2024-09-12T05:20:15.358 INFO:teuthology.orchestra.run.smithi059.stdout:125 punch from 0x53f1cd to 0x5463a0, (0x71d3 bytes) 2024-09-12T05:20:15.358 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.358 INFO:teuthology.orchestra.run.smithi059.stdout:131 read 0xc6a4f1 thru 0xc72c79 (0x8789 bytes) 2024-09-12T05:20:15.377 INFO:teuthology.orchestra.run.smithi059.stdout:132 write 0xa356aad thru 0xa3669a2 (0xfef6 bytes) 2024-09-12T05:20:15.388 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:15.390+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:15.405 INFO:teuthology.orchestra.run.smithi059.stdout:133 write 0xc6c8e11 thru 0xc6cf2ae (0x649e bytes) 2024-09-12T05:20:15.413 INFO:teuthology.orchestra.run.smithi059.stdout:136 punch from 0x8f5aacc to 0x8f65b65, (0xb099 bytes) 2024-09-12T05:20:15.413 INFO:teuthology.orchestra.run.smithi059.stdout:138 write 0x7b8d074 thru 0x7b96e42 (0x9dcf bytes) 2024-09-12T05:20:15.419 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:15.420 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.420 INFO:teuthology.orchestra.run.smithi059.stdout:141 trunc from 0xc6cf2af to 0xc48b7bf 2024-09-12T05:20:15.457 INFO:teuthology.orchestra.run.smithi059.stdout:143 writesame 0xc9d0aad thru 0xc9d68be data_size 0x1(0x5e12 bytes) 2024-09-12T05:20:15.475 INFO:teuthology.orchestra.run.smithi059.stdout:144 write 0xe393b6f thru 0xe397ba7 (0x4039 bytes) 2024-09-12T05:20:15.482 INFO:teuthology.orchestra.run.smithi059.stdout:147 punch from 0x1a2fb28 to 0x1a3a873, (0xad4b bytes) 2024-09-12T05:20:15.482 INFO:teuthology.orchestra.run.smithi059.stdout:148 write 0x24c8ca8 thru 0x24c9a40 (0xd99 bytes) 2024-09-12T05:20:15.488 INFO:teuthology.orchestra.run.smithi059.stdout:149 punch from 0x1ede3ef to 0x1eed70b, (0xf31c bytes) 2024-09-12T05:20:15.489 INFO:teuthology.orchestra.run.smithi059.stdout:153 read 0xa9c419d thru 0xa9cca43 (0x88a7 bytes) 2024-09-12T05:20:15.489 INFO:teuthology.orchestra.run.smithi059.stdout:154 read 0xba6b365 thru 0xba78413 (0xd0af bytes) 2024-09-12T05:20:15.489 INFO:teuthology.orchestra.run.smithi059.stdout:155 punch from 0xc2086d1 to 0xc218040, (0xf96f bytes) 2024-09-12T05:20:15.489 INFO:teuthology.orchestra.run.smithi059.stdout:156 write 0x97af8dc thru 0x97b11d9 (0x18fe bytes) 2024-09-12T05:20:15.495 INFO:teuthology.orchestra.run.smithi059.stdout:157 write 0x37dab93 thru 0x37e62cb (0xb739 bytes) 2024-09-12T05:20:15.503 INFO:teuthology.orchestra.run.smithi059.stdout:158 write 0xdf2936e thru 0xdf2adb3 (0x1a46 bytes) 2024-09-12T05:20:15.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:15.506+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:15.509 INFO:teuthology.orchestra.run.smithi059.stdout:159 punch from 0xa69b8f4 to 0xa6a0a10, (0x511c bytes) 2024-09-12T05:20:15.509 INFO:teuthology.orchestra.run.smithi059.stdout:162 write 0x8cefb8b thru 0x8cf1183 (0x15f9 bytes) 2024-09-12T05:20:15.516 INFO:teuthology.orchestra.run.smithi059.stdout:164 write 0xe12c915 thru 0xe131668 (0x4d54 bytes) 2024-09-12T05:20:15.527 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.527 INFO:teuthology.orchestra.run.smithi059.stdout:167 read 0x84249b3 thru 0x8424f4f (0x59d bytes) 2024-09-12T05:20:15.527 INFO:teuthology.orchestra.run.smithi059.stdout:169 read 0x3ad1d8a thru 0x3ad5c71 (0x3ee8 bytes) 2024-09-12T05:20:15.527 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.527 INFO:teuthology.orchestra.run.smithi059.stdout:171 write 0x1d9f447 thru 0x1daf3ae (0xff68 bytes) 2024-09-12T05:20:15.538 INFO:teuthology.orchestra.run.smithi059.stdout:172 read 0x35ffcea thru 0x36063b5 (0x66cc bytes) 2024-09-12T05:20:15.538 INFO:teuthology.orchestra.run.smithi059.stdout:173 writesame 0x69146a5 thru 0x6920aa0 data_size 0x25(0xc3fc bytes) 2024-09-12T05:20:15.550 INFO:teuthology.orchestra.run.smithi059.stdout:174 write 0x93c5eba thru 0x93cd50e (0x7655 bytes) 2024-09-12T05:20:15.557 INFO:teuthology.orchestra.run.smithi059.stdout:176 punch from 0xd2a96b0 to 0xd2a9d39, (0x689 bytes) 2024-09-12T05:20:15.572 INFO:teuthology.orchestra.run.smithi059.stdout:177 trunc from 0xe397ba8 to 0x9020a6d 2024-09-12T05:20:15.587 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:15.587 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:15.591 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:15.594+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:15.602 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:15.602 INFO:teuthology.orchestra.run.smithi059.stdout:178 trunc from 0x9020a6d to 0x92724eb 2024-09-12T05:20:15.614 INFO:teuthology.orchestra.run.smithi059.stdout:179 write 0x1b42a95 thru 0x1b4755c (0x4ac8 bytes) 2024-09-12T05:20:15.621 INFO:teuthology.orchestra.run.smithi059.stdout:180 read 0x90a6d50 thru 0x90b5970 (0xec21 bytes) 2024-09-12T05:20:15.635 INFO:teuthology.orchestra.run.smithi059.stdout:181 write 0x947dd82 thru 0x94867a6 (0x8a25 bytes) 2024-09-12T05:20:15.644 INFO:teuthology.orchestra.run.smithi059.stdout:183 read 0x201e99f thru 0x2022995 (0x3ff7 bytes) 2024-09-12T05:20:15.658 INFO:teuthology.orchestra.run.smithi059.stdout:184 trunc from 0x94867a7 to 0xe2b2415 2024-09-12T05:20:15.671 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.686 INFO:teuthology.orchestra.run.smithi059.stdout:186 write 0xec0d923 thru 0xec159a0 (0x807e bytes) 2024-09-12T05:20:15.691 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:15.689+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:15.694 INFO:teuthology.orchestra.run.smithi059.stdout:189 write 0x3506f27 thru 0x350c5af (0x5689 bytes) 2024-09-12T05:20:15.701 INFO:teuthology.orchestra.run.smithi059.stdout:190 write 0xdc9892f thru 0xdca1428 (0x8afa bytes) 2024-09-12T05:20:15.711 INFO:teuthology.orchestra.run.smithi059.stdout:191 read 0xd249446 thru 0xd250753 (0x730e bytes) 2024-09-12T05:20:15.734 INFO:teuthology.orchestra.run.smithi059.stdout:193 trunc from 0xec159a1 to 0x6665928 2024-09-12T05:20:15.767 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:15.787 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:15.789 INFO:teuthology.orchestra.run.smithi059.stdout:195 writesame 0xb54d875 thru 0xb5521dd data_size 0x1(0x4969 bytes) 2024-09-12T05:20:15.790 INFO:teuthology.orchestra.run.smithi059.stdout:196 read 0x7a336e9 thru 0x7a3a782 (0x709a bytes) 2024-09-12T05:20:15.790 INFO:teuthology.orchestra.run.smithi059.stdout:198 punch from 0x4e4fd00 to 0x4e5edbe, (0xf0be bytes) 2024-09-12T05:20:15.790 INFO:teuthology.orchestra.run.smithi059.stdout:199 write 0x9a94d8f thru 0x9a9d937 (0x8ba9 bytes) 2024-09-12T05:20:15.801 INFO:teuthology.orchestra.run.smithi059.stdout:200 read 0x1897e7e thru 0x18a0b4d (0x8cd0 bytes) 2024-09-12T05:20:15.802 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:15.819 INFO:teuthology.orchestra.run.smithi059.stdout:201 trunc from 0xb5521de to 0x258e56b 2024-09-12T05:20:15.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:15.829+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:15.844 INFO:teuthology.orchestra.run.smithi059.stdout:206 trunc from 0x258e56b to 0x6947856 2024-09-12T05:20:15.852 INFO:teuthology.orchestra.run.smithi059.stdout:207 read 0x503ff thru 0x55aba (0x56bc bytes) 2024-09-12T05:20:15.853 INFO:teuthology.orchestra.run.smithi059.stdout:208 read 0x39b05bd thru 0x39bf13f (0xeb83 bytes) 2024-09-12T05:20:15.853 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.853 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.853 INFO:teuthology.orchestra.run.smithi059.stdout:213 read 0x1a18a4f thru 0x1a19d37 (0x12e9 bytes) 2024-09-12T05:20:15.854 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.854 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.854 INFO:teuthology.orchestra.run.smithi059.stdout:217 read 0x34519c1 thru 0x3455b35 (0x4175 bytes) 2024-09-12T05:20:15.868 INFO:teuthology.orchestra.run.smithi059.stdout:218 writesame 0x9a7818e thru 0x9a7d7ca data_size 0x21(0x563d bytes) 2024-09-12T05:20:15.868 INFO:teuthology.orchestra.run.smithi059.stdout:220 read 0x64b208c thru 0x64c009f (0xe014 bytes) 2024-09-12T05:20:15.868 INFO:teuthology.orchestra.run.smithi059.stdout:221 write 0x6d436fd thru 0x6d4ec6f (0xb573 bytes) 2024-09-12T05:20:15.889 INFO:teuthology.orchestra.run.smithi059.stdout:222 writesame 0xccbf40d thru 0xccccef9 data_size 0xb(0xdaed bytes) 2024-09-12T05:20:15.889 INFO:teuthology.orchestra.run.smithi059.stdout:223 read 0x787df3f thru 0x788a049 (0xc10b bytes) 2024-09-12T05:20:15.889 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.892 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:15.894+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:15.904 INFO:teuthology.orchestra.run.smithi059.stdout:228 trunc from 0xccccefa to 0x518b502 2024-09-12T05:20:15.934 INFO:teuthology.orchestra.run.smithi059.stdout:229 writesame 0x77977a9 thru 0x77a7093 data_size 0xb(0xf8eb bytes) 2024-09-12T05:20:15.934 INFO:teuthology.orchestra.run.smithi059.stdout:230 punch from 0x681d973 to 0x682518e, (0x781b bytes) 2024-09-12T05:20:15.955 INFO:teuthology.orchestra.run.smithi059.stdout:231 write 0xd67245b thru 0xd673b16 (0x16bc bytes) 2024-09-12T05:20:15.957 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:15.957 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:15.959 INFO:teuthology.orchestra.run.smithi059.stdout:232 read 0x7536662 thru 0x7544077 (0xda16 bytes) 2024-09-12T05:20:15.960 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.960 INFO:teuthology.orchestra.run.smithi059.stdout:237 punch from 0x813c7db to 0x8141274, (0x4a99 bytes) 2024-09-12T05:20:15.960 INFO:teuthology.orchestra.run.smithi059.stdout:238 punch from 0x318211d to 0x3191df1, (0xfcd4 bytes) 2024-09-12T05:20:15.960 INFO:teuthology.orchestra.run.smithi059.stdout:239 write 0x7ea9f28 thru 0x7eb0516 (0x65ef bytes) 2024-09-12T05:20:15.965 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:15.965 INFO:teuthology.orchestra.run.smithi059.stdout:242 clone 2 order 23 su 524288 sc 12 2024-09-12T05:20:15.972 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:15.980 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:15.997 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:16.013 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:16.017 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:16.017+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:16.030 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:16.048 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:16.048 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:16.066 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:16.067 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:16.086 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:16.087 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:16.090 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:16.090 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:16.091 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:16.091 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:16.091 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:16.094 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:16.093+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:16.105 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:16.108 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:16.109 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:16.195 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:16.193+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [] 2024-09-12T05:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:16.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:16.296 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:16.298+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:16.397 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:16.398+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:16.453 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:16.453 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:16.453 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:16.453 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:16.467 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:16.498 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:16.498+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:16.589 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:16.589 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:16.589 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:16.589 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:16.589 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:16.599 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:16.602+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:16.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:16.699 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:16.697+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:16.721 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.843389489, 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.10902002500000001, 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:16.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878726+0000", 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878741+0000", 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4696e-05 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878767+0000", 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5812999999999998e-05 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878789+0000", 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.179e-05 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878868+0000", 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9116999999999995e-05 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878878+0000", 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8549999999999997e-06 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.984853+0000", 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.105974939 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985185+0000", 2024-09-12T05:20:16.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000332827 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985604+0000", 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000418477 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.986868+0000", 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001264004 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987594+0000", 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072604400000000002 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987679+0000", 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4826000000000004e-05 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987744+0000", 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4716999999999997e-05 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.728 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.587815015, 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016500958999999999, 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 42 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134299+0000", 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134306+0000", 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9399999999999996e-06 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134317+0000", 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0837e-05 2024-09-12T05:20:16.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134324+0000", 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.138682+0000", 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004357072 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.138911+0000", 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022904199999999999 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.139320+0000", 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040928999999999998 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.143904+0000", 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045844750000000002 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150511+0000", 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066061560000000002 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150667+0000", 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156062 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150799+0000", 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013236199999999999 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.734 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.587522760999999, 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016623514999999998, 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 43 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134591+0000", 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.11e-06 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134599+0000", 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.627e-06 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134612+0000", 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3407000000000001e-05 2024-09-12T05:20:16.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134622+0000", 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2e-06 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141025+0000", 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006403583 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141161+0000", 2024-09-12T05:20:16.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135902 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141361+0000", 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000199989 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.146593+0000", 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052320429999999996 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151014+0000", 2024-09-12T05:20:16.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044212720000000004 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151108+0000", 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3676000000000002e-05 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151214+0000", 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010570599999999999 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.587367587999999, 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016792813, 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.741 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 44 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134746+0000", 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134828+0000", 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1456000000000001e-05 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134841+0000", 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.312e-05 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134850+0000", 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7430000000000008e-06 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141992+0000", 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071420340000000002 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.142253+0000", 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026151199999999999 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.142632+0000", 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037914399999999999 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.148913+0000", 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062808880000000001 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151338+0000", 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024248749999999999 2024-09-12T05:20:16.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151425+0000", 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6322000000000005e-05 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151538+0000", 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113656 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.746 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.587132130000001, 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01686226, 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 45 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134982+0000", 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4130000000000001e-06 2024-09-12T05:20:16.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134993+0000", 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023e-05 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135038+0000", 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5970000000000002e-05 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135049+0000", 2024-09-12T05:20:16.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0263e-05 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144033+0000", 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0089840030000000008 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144177+0000", 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014395900000000001 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144405+0000", 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000228092 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.148928+0000", 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045228179999999996 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151679+0000", 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027509990000000001 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151773+0000", 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4802999999999993e-05 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151843+0000", 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9709999999999995e-05 2024-09-12T05:20:16.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.587042374999999, 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017063834999999999, 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 46 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135072+0000", 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0400000000000005e-07 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135079+0000", 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0129999999999996e-06 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135092+0000", 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3349999999999999e-05 2024-09-12T05:20:16.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135100+0000", 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6569999999999997e-06 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145135+0000", 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010035572 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145383+0000", 2024-09-12T05:20:16.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000247731 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145742+0000", 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035916399999999998 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150864+0000", 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051218569999999996 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151961+0000", 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001096872 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152037+0000", 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5945999999999994e-05 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152134+0000", 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7769000000000005e-05 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.586998991000002, 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018299068000000002, 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 47 2024-09-12T05:20:16.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135115+0000", 2024-09-12T05:20:16.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8599999999999997e-07 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135228+0000", 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112936 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135265+0000", 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7426999999999999e-05 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135280+0000", 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4693e-05 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147037+0000", 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011756951 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147310+0000", 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027367800000000002 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147689+0000", 2024-09-12T05:20:16.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037831399999999998 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151564+0000", 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038754779999999999 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153266+0000", 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017021600000000001 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153350+0000", 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3829e-05 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153413+0000", 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2816000000000003e-05 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.764 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.586812655999999, 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018428901000000001, 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 48 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:16.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135301+0000", 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023e-06 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135308+0000", 2024-09-12T05:20:16.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8499999999999996e-06 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135321+0000", 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3157e-05 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135329+0000", 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6860000000000006e-06 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149031+0000", 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013702147 2024-09-12T05:20:16.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149176+0000", 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014521299999999999 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149426+0000", 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024937100000000002 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152156+0000", 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027301320000000001 2024-09-12T05:20:16.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153560+0000", 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001403856 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153662+0000", 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010180599999999999 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153729+0000", 2024-09-12T05:20:16.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7659999999999999e-05 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.586769353000001, 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021491874000000001, 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.770 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 49 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4000000000000001e-07 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135351+0000", 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135361+0000", 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:20:16.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135368+0000", 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152252+0000", 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016884542999999998 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152387+0000", 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013445500000000001 2024-09-12T05:20:16.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152594+0000", 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020751600000000001 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156614+0000", 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040193820000000002 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156659+0000", 2024-09-12T05:20:16.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5498999999999999e-05 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156774+0000", 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011445199999999999 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156836+0000", 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1953999999999997e-05 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.586732337000001, 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022587169000000001, 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 50 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:16.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9400000000000005e-07 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135461+0000", 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0111999999999995e-05 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135481+0000", 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9150000000000001e-05 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135496+0000", 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5486999999999999e-05 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153835+0000", 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018339030999999999 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.154049+0000", 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000214119 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.154289+0000", 2024-09-12T05:20:16.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023974099999999999 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157804+0000", 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035150989999999998 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157826+0000", 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1883e-05 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157900+0000", 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3780000000000002e-05 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157968+0000", 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8072999999999997e-05 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:16.785 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.586586428, 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022671417999999999, 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 51 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:16.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135528+0000", 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3969999999999999e-06 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135540+0000", 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1737e-05 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135559+0000", 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9123e-05 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135573+0000", 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3719e-05 2024-09-12T05:20:16.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155276+0000", 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019703064999999999 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155411+0000", 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013550199999999999 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155623+0000", 2024-09-12T05:20:16.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021140500000000001 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158032+0000", 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002409015 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158059+0000", 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7518999999999999e-05 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158139+0000", 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0286999999999999e-05 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158198+0000", 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8649e-05 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.586476522000002, 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023015342000000001, 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 52 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135638+0000", 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5600000000000001e-06 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135651+0000", 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.326e-05 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135672+0000", 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0780000000000001e-05 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135693+0000", 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1095999999999999e-05 2024-09-12T05:20:16.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156933+0000", 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021240146000000001 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157096+0000", 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016222900000000001 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157301+0000", 2024-09-12T05:20:16.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020542100000000001 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158464+0000", 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001163054 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158500+0000", 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6157e-05 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158578+0000", 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7359000000000003e-05 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158652+0000", 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.428e-05 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:16.797 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.333987111999999, 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013423977, 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 69 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388127+0000", 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0529999999999999e-06 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388230+0000", 2024-09-12T05:20:16.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010274500000000001 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388246+0000", 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6742e-05 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388258+0000", 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1109e-05 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.391889+0000", 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036317430000000002 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.392026+0000", 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137045 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.392236+0000", 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020941199999999999 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395594+0000", 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033585199999999998 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401431+0000", 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058363579999999998 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401493+0000", 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2335999999999994e-05 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401550+0000", 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6913999999999998e-05 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.333832716, 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013386148, 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 70 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388281+0000", 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8400000000000002e-07 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388290+0000", 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8659999999999995e-06 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388306+0000", 2024-09-12T05:20:16.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5430999999999998e-05 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388314+0000", 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5189999999999992e-06 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395647+0000", 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073332930000000003 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395758+0000", 2024-09-12T05:20:16.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011106400000000001 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395929+0000", 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170349 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401409+0000", 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054803860000000003 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401561+0000", 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000151941 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401619+0000", 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8279000000000002e-05 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401666+0000", 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7036000000000002e-05 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.333781428999998, 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013501121, 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 71 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.809 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.54e-07 2024-09-12T05:20:16.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388339+0000", 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8850000000000001e-06 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388356+0000", 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6643e-05 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388364+0000", 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5529999999999993e-06 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396392+0000", 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.008027536 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396460+0000", 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8031e-05 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396563+0000", 2024-09-12T05:20:16.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401677+0000", 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051139849999999997 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401753+0000", 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5506999999999994e-05 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401797+0000", 2024-09-12T05:20:16.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4532e-05 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401833+0000", 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5222999999999998e-05 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.333695601999999, 2024-09-12T05:20:16.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013626012, 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 72 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388418+0000", 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2500000000000004e-07 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388492+0000", 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3240999999999999e-05 2024-09-12T05:20:16.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388503+0000", 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1878999999999999e-05 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388512+0000", 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8789999999999992e-06 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396954+0000", 2024-09-12T05:20:16.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0084420309999999991 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.397049+0000", 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4588999999999998e-05 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.397215+0000", 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016635599999999999 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401915+0000", 2024-09-12T05:20:16.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046998910000000003 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401933+0000", 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7844000000000001e-05 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401991+0000", 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7742999999999999e-05 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402043+0000", 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2633999999999998e-05 2024-09-12T05:20:16.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.333578281000001, 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016972929000000001, 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 73 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388536+0000", 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7000000000000003e-07 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388544+0000", 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8859999999999993e-06 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388556+0000", 2024-09-12T05:20:16.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1289e-05 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388564+0000", 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400688+0000", 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012124731 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400781+0000", 2024-09-12T05:20:16.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2958e-05 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400934+0000", 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015275600000000001 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403647+0000", 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027130800000000001 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405434+0000", 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017866889999999999 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405473+0000", 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8723000000000002e-05 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405508+0000", 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4984000000000003e-05 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.333528396999998, 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017101682999999999, 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 74 2024-09-12T05:20:16.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388593+0000", 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3270000000000003e-06 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388603+0000", 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9159999999999996e-06 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388610+0000", 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1679999999999998e-06 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402091+0000", 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013480779 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402157+0000", 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6842999999999997e-05 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402265+0000", 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010712700000000001 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403660+0000", 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001395213 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405565+0000", 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001905166 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405635+0000", 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9840999999999998e-05 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405686+0000", 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1499000000000003e-05 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.831 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.333482222000001, 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017927399, 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 75 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:16.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388632+0000", 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388719+0000", 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7251999999999997e-05 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388733+0000", 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3900000000000001e-05 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388752+0000", 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9519999999999999e-05 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402653+0000", 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013900538 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402765+0000", 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011212199999999999 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402936+0000", 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017109699999999999 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.404269+0000", 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013328400000000001 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406480+0000", 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022108700000000002 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406519+0000", 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9730000000000001e-05 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406558+0000", 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8736999999999999e-05 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.333341006000001, 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018396794000000001, 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:16.837 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 76 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:16.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388773+0000", 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6199999999999996e-07 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388780+0000", 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3170000000000004e-06 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388791+0000", 2024-09-12T05:20:16.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417e-05 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388809+0000", 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8377999999999999e-05 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403692+0000", 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014883234 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403762+0000", 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0088999999999999e-05 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403867+0000", 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104627 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.404656+0000", 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078953200000000002 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407056+0000", 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002399502 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407119+0000", 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3186000000000001e-05 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407169+0000", 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9650000000000001e-05 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.842 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:16.843 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:16.843 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:16.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:16.845 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:16.846+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:16.923 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone1 from 0xd673b17 (overlap 0x113f1ff) to 0xdcc198 2024-09-12T05:20:16.945 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:16.945+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:16.995 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:16.995 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:16.995 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:16.995 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:17.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:17.046 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:17.045+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:17.063 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-12T05:20:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:17.131 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:17.131 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:17.131 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:17.147 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:17.145+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:17.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:17.248 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:17.245+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:17.304 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:21 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'11, mlcod=17'8)", 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.029228+0000", 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.277702457, 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035043470000000001, 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029228+0000", 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029228+0000", 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029229+0000", 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.694e-06 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029408+0000", 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017856099999999999 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029440+0000", 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.154e-05 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029460+0000", 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.075e-05 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029590+0000", 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000129949 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.029646+0000", 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5776000000000003e-05 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032593+0000", 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029467650000000001 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032732+0000", 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000139312 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:22 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'12, mlcod=17'8)", 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.030861+0000", 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.276069053000001, 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047448179999999996, 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.309 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030861+0000", 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030861+0000", 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030868+0000", 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3369999999999996e-06 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.030991+0000", 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012322900000000001 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.031016+0000", 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5497e-05 2024-09-12T05:20:17.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.031036+0000", 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9306000000000001e-05 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.031203+0000", 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167205 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.031239+0000", 2024-09-12T05:20:17.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6329999999999999e-05 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.035532+0000", 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042928109999999997 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.035606+0000", 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103000000000005e-05 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:23 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'13, mlcod=17'8)", 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.032497+0000", 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.274433728999998, 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003462391, 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032497+0000", 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032497+0000", 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032499+0000", 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.407e-06 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032574+0000", 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5506000000000005e-05 2024-09-12T05:20:17.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032602+0000", 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7267000000000002e-05 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032619+0000", 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.774e-05 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032787+0000", 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167205 2024-09-12T05:20:17.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.032821+0000", 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4526000000000001e-05 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.035867+0000", 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003046034 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.035959+0000", 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1706000000000006e-05 2024-09-12T05:20:17.317 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:24 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'14, mlcod=17'10)", 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.034551+0000", 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.272378877000001, 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034047270000000002, 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034551+0000", 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034551+0000", 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034552+0000", 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034599+0000", 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6422999999999999e-05 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034622+0000", 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3298999999999998e-05 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034640+0000", 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7989999999999999e-05 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034793+0000", 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015279200000000001 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.034832+0000", 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8627000000000001e-05 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.037846+0000", 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030147630000000002 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.037956+0000", 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109743 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:41 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'23, mlcod=17'19)", 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.139571+0000", 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.167359292, 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064674349999999997, 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.322 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139571+0000", 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139571+0000", 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139572+0000", 2024-09-12T05:20:17.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0529999999999999e-06 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139660+0000", 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7546000000000005e-05 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139675+0000", 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.501e-05 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139684+0000", 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5230000000000001e-06 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139780+0000", 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6137999999999993e-05 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.139800+0000", 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0106999999999999e-05 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.145981+0000", 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061806650000000001 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.146038+0000", 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7392999999999998e-05 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:42 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'24, mlcod=17'19)", 2024-09-12T05:20:17.326 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.141467+0000", 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.165463235000001, 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076791079999999996, 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141467+0000", 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141467+0000", 2024-09-12T05:20:17.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141468+0000", 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5700000000000001e-07 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141473+0000", 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1680000000000003e-06 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141487+0000", 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3473e-05 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141503+0000", 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6174000000000001e-05 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141598+0000", 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5470000000000006e-05 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.141616+0000", 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7844000000000001e-05 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149096+0000", 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074798750000000004 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149146+0000", 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0247000000000002e-05 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:43 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'25, mlcod=17'21)", 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.143494+0000", 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.163435772, 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056750259999999997, 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143494+0000", 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143494+0000", 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143495+0000", 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0999999999999997e-07 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143516+0000", 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1180000000000001e-05 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143530+0000", 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3534e-05 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143540+0000", 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9340000000000001e-06 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143678+0000", 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013800999999999999 2024-09-12T05:20:17.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.143716+0000", 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7633999999999999e-05 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149148+0000", 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054324689999999997 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149169+0000", 2024-09-12T05:20:17.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1455e-05 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:44 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'26, mlcod=17'21)", 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.144848+0000", 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.162081775000001, 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047816760000000003, 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144848+0000", 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144848+0000", 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144849+0000", 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2699999999999999e-07 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144914+0000", 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5094999999999999e-05 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144928+0000", 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3577999999999999e-05 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.144937+0000", 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0149999999999992e-06 2024-09-12T05:20:17.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.145034+0000", 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6749000000000005e-05 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.145050+0000", 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6398000000000001e-05 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149563+0000", 2024-09-12T05:20:17.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045126510000000003 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.149630+0000", 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7563000000000003e-05 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'45)", 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.403105+0000", 2024-09-12T05:20:17.339 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.903825689000001, 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040138930000000001, 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403105+0000", 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403105+0000", 2024-09-12T05:20:17.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403106+0000", 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4869999999999999e-06 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403118+0000", 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.17e-05 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403143+0000", 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5323000000000001e-05 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403157+0000", 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3456e-05 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403304+0000", 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147906 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.403370+0000", 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5133000000000001e-05 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.407035+0000", 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036656649999999998 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.407118+0000", 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3222999999999999e-05 2024-09-12T05:20:17.343 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4198.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:55.410095+0000", 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.896835103000001, 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032963150000000002, 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.344 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410095+0000", 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410095+0000", 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410097+0000", 2024-09-12T05:20:17.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.334e-06 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410222+0000", 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125012 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410254+0000", 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1143000000000003e-05 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410268+0000", 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3873000000000001e-05 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410392+0000", 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012417600000000001 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.410452+0000", 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.029e-05 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.413298+0000", 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028458509999999999 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:55.413391+0000", 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3635999999999996e-05 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:11.754943+0000", 2024-09-12T05:20:17.348 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.5519873349999997, 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090034469999999995, 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754943+0000", 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754943+0000", 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754946+0000", 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4369999999999999e-06 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754964+0000", 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7669e-05 2024-09-12T05:20:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.754995+0000", 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1430000000000002e-05 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.755013+0000", 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7243000000000001e-05 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.755154+0000", 2024-09-12T05:20:17.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014086900000000001 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.755165+0000", 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1347e-05 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.759737+0000", 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045725210000000004 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.760073+0000", 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00033558699999999998 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.760552+0000", 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000478553 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.763168+0000", 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026163029999999999 2024-09-12T05:20:17.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.763666+0000", 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00049852299999999996 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.763829+0000", 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016230199999999999 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.763946+0000", 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000117663 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:13 3.17 3:e973cf78:::rbd_object_map.1118c379fb68:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:11.767394+0000", 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.539536708, 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036860450000000002, 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.355 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 13 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767394+0000", 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767394+0000", 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767396+0000", 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0099999999999998e-06 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767406+0000", 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0706999999999999e-05 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767437+0000", 2024-09-12T05:20:17.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1068999999999997e-05 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767452+0000", 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.508e-05 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767625+0000", 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017300599999999999 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.767985+0000", 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00035931 2024-09-12T05:20:17.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.768473+0000", 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00048837900000000005 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.770006+0000", 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015326319999999999 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.770823+0000", 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00081693399999999995 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.770953+0000", 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012985899999999999 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.771080+0000", 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127059 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:766 3.6 3:63de744d:::rbd_object_map.1118bd2b1382:head [read 0~249] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.789987+0000", 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51694295899999998, 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049302950000000003, 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.361 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 766 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.789987+0000", 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.789987+0000", 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.789991+0000", 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.473e-06 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.790004+0000", 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3157e-05 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.790040+0000", 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.578e-05 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.790057+0000", 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7010000000000001e-05 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.790188+0000", 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013162199999999999 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.790199+0000", 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0263e-05 2024-09-12T05:20:17.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.794429+0000", 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042303810000000001 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.794644+0000", 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000215014 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.794918+0000", 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027359500000000001 2024-09-12T05:20:17.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:768 3.6 3:63de744d:::rbd_object_map.1118bd2b1382:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.798653+0000", 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.50827765599999997, 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043050069999999996, 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 768 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.798653+0000", 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.798653+0000", 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.798655+0000", 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4940000000000002e-06 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.798667+0000", 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1803e-05 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.798696+0000", 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9196e-05 2024-09-12T05:20:17.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.798711+0000", 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4603000000000001e-05 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.798876+0000", 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016499900000000001 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.799141+0000", 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026505799999999998 2024-09-12T05:20:17.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.799897+0000", 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00075587099999999997 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.801667+0000", 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017701660000000001 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.802675+0000", 2024-09-12T05:20:17.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001008049 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.802843+0000", 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016845200000000001 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.802958+0000", 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011431599999999999 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:853 3.17 3:e8d00d0f:::rbd_data.1118bd2b1382.000000000000003e:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.930941+0000", 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.37598913099999998, 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034830880000000001, 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 853 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930941+0000", 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930941+0000", 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930943+0000", 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.705e-06 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930950+0000", 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4610000000000002e-06 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930971+0000", 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0460000000000001e-05 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930984+0000", 2024-09-12T05:20:17.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3339999999999999e-05 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931057+0000", 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2621999999999997e-05 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931244+0000", 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018693900000000001 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934424+0000", 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805610000000002 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "pg_update_log_missing(3.3 epoch 30/23 rep_tid 32 entries 30'3 (0'0) error 3:c159abf0:::rbd_data.1118bd2b1382.0000000000000039:head by client.4376.0:848 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 28'1)", 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.932288+0000", 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.37464185799999999, 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035105090000000002, 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:17.376 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.932288+0000", 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.932288+0000", 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.932289+0000", 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-07 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.932297+0000", 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2199999999999992e-06 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.932320+0000", 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2694e-05 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.932344+0000", 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3640000000000001e-05 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.932452+0000", 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000107774 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.935799+0000", 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003347301 2024-09-12T05:20:17.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:859 3.17 3:e8d00d0f:::rbd_data.1118bd2b1382.000000000000003e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.934634+0000", 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.37229644099999998, 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065545559999999996, 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 859 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934634+0000", 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934634+0000", 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934635+0000", 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.663e-06 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934642+0000", 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9840000000000004e-06 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934659+0000", 2024-09-12T05:20:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6514000000000001e-05 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934668+0000", 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4239999999999999e-06 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934741+0000", 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3069000000000001e-05 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934839+0000", 2024-09-12T05:20:17.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7331999999999996e-05 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.935017+0000", 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000177994 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.938306+0000", 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032891050000000001 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.941040+0000", 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027342439999999998 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.941123+0000", 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2588000000000003e-05 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.941188+0000", 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5639e-05 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:878 3.6 3:63de744d:::rbd_object_map.1118bd2b1382:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.958855+0000", 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34807535299999998, 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043762080000000004, 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 878 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958855+0000", 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958855+0000", 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958857+0000", 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9309999999999998e-06 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958865+0000", 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8019999999999992e-06 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958885+0000", 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0699e-05 2024-09-12T05:20:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958897+0000", 2024-09-12T05:20:17.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1270999999999999e-05 2024-09-12T05:20:17.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958988+0000", 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1360000000000006e-05 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.959127+0000", 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013882599999999999 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:17.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.959727+0000", 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060064099999999996 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963071+0000", 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033437509999999998 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963121+0000", 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9759000000000003e-05 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963186+0000", 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5013999999999998e-05 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963231+0000", 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5154000000000002e-05 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:879 3.6 3:63de744d:::rbd_object_map.1118bd2b1382:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.958941+0000", 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34798896699999998, 2024-09-12T05:20:17.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057676159999999997, 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 879 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958941+0000", 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958941+0000", 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958942+0000", 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4900000000000005e-07 2024-09-12T05:20:17.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958947+0000", 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5709999999999999e-06 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958957+0000", 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8430000000000005e-06 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958962+0000", 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9290000000000003e-06 2024-09-12T05:20:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.960540+0000", 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001578018 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.960624+0000", 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3770000000000006e-05 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.960981+0000", 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00035652200000000001 2024-09-12T05:20:17.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.964389+0000", 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034085830000000002 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.964451+0000", 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1506000000000004e-05 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.964596+0000", 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000144869 2024-09-12T05:20:17.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.964709+0000", 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000113156 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:880 3.6 3:63de744d:::rbd_object_map.1118bd2b1382:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.958974+0000", 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34795647600000001, 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078276690000000006, 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 880 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958974+0000", 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958974+0000", 2024-09-12T05:20:17.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958974+0000", 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2e-07 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958982+0000", 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0029999999999994e-06 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958988+0000", 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.857e-06 2024-09-12T05:20:17.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.958995+0000", 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5880000000000003e-06 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961525+0000", 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002530081 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961680+0000", 2024-09-12T05:20:17.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000155033 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.962273+0000", 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00059310099999999996 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.964836+0000", 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025627340000000001 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.966626+0000", 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001790647 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.966706+0000", 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9789000000000005e-05 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.966801+0000", 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5315999999999993e-05 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.406 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.407 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.407 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:17.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:17.408 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:17.410+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:17.429 INFO:teuthology.orchestra.run.smithi059.stdout:243 writesame 0x19e4a20 thru 0x19ea3e6 data_size 0x2f(0x59c7 bytes) 2024-09-12T05:20:17.449 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.449 INFO:teuthology.orchestra.run.smithi059.stdout:245 writesame 0xc25238d thru 0xc25964b data_size 0x2f(0x72bf bytes) 2024-09-12T05:20:17.456 INFO:teuthology.orchestra.run.smithi059.stdout:248 write 0xad1eb33 thru 0xad2ca56 (0xdf24 bytes) 2024-09-12T05:20:17.463 INFO:teuthology.orchestra.run.smithi059.stdout:249 write 0x7e7826 thru 0x7f22eb (0xaac6 bytes) 2024-09-12T05:20:17.465 INFO:teuthology.orchestra.run.smithi059.stdout:250 write 0x9fee829 thru 0x9ffe23c (0xfa14 bytes) 2024-09-12T05:20:17.472 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.472 INFO:teuthology.orchestra.run.smithi059.stdout:252 write 0x94213b6 thru 0x942cee4 (0xbb2f bytes) 2024-09-12T05:20:17.492 INFO:teuthology.orchestra.run.smithi059.stdout:254 write 0xeb7672b thru 0xeb800f4 (0x99ca bytes) 2024-09-12T05:20:17.500 INFO:teuthology.orchestra.run.smithi059.stdout:255 write 0xcd2fc8e thru 0xcd35690 (0x5a03 bytes) 2024-09-12T05:20:17.504 INFO:teuthology.orchestra.run.smithi059.stdout:256 trunc from 0xeb800f5 to 0xcf02bf5 2024-09-12T05:20:17.509 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:17.509+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:17.535 INFO:teuthology.orchestra.run.smithi059.stdout:257 read 0x8f97028 thru 0x8fa5a64 (0xea3d bytes) 2024-09-12T05:20:17.535 INFO:teuthology.orchestra.run.smithi059.stdout:258 read 0x6589341 thru 0x6593337 (0x9ff7 bytes) 2024-09-12T05:20:17.535 INFO:teuthology.orchestra.run.smithi059.stdout:259 read 0x1211952 thru 0x121d521 (0xbbd0 bytes) 2024-09-12T05:20:17.535 INFO:teuthology.orchestra.run.smithi059.stdout:260 writesame 0xccbc13a thru 0xccc7835 data_size 0x31(0xb6fc bytes) 2024-09-12T05:20:17.549 INFO:teuthology.orchestra.run.smithi059.stdout:261 trunc from 0xcf02bf5 to 0x5fb8e70 2024-09-12T05:20:17.573 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:17.573 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:17.573 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:17.573 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:17.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:17.596 INFO:teuthology.orchestra.run.smithi059.stdout:262 write 0xc66935 thru 0xc70b12 (0xa1de bytes) 2024-09-12T05:20:17.604 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.609 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:17.609+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:17.620 INFO:teuthology.orchestra.run.smithi059.stdout:264 write 0x9227ebd thru 0x9230e1c (0x8f60 bytes) 2024-09-12T05:20:17.626 INFO:teuthology.orchestra.run.smithi059.stdout:265 read 0x269d7cd thru 0x26a83b0 (0xabe4 bytes) 2024-09-12T05:20:17.626 INFO:teuthology.orchestra.run.smithi059.stdout:266 write 0x5cac3c thru 0x5d060e (0x59d3 bytes) 2024-09-12T05:20:17.630 INFO:teuthology.orchestra.run.smithi059.stdout:267 read 0x4d8136d thru 0x4d8cff4 (0xbc88 bytes) 2024-09-12T05:20:17.631 INFO:teuthology.orchestra.run.smithi059.stdout:268 punch from 0x37389e4 to 0x3745032, (0xc64e bytes) 2024-09-12T05:20:17.631 INFO:teuthology.orchestra.run.smithi059.stdout:269 punch from 0x67efc70 to 0x67fa20f, (0xa59f bytes) 2024-09-12T05:20:17.649 INFO:teuthology.orchestra.run.smithi059.stdout:270 write 0xcedd3a6 thru 0xcee7522 (0xa17d bytes) 2024-09-12T05:20:17.657 INFO:teuthology.orchestra.run.smithi059.stdout:271 read 0x7f9a263 thru 0x7fa5d47 (0xbae5 bytes) 2024-09-12T05:20:17.657 INFO:teuthology.orchestra.run.smithi059.stdout:272 writesame 0xaa718e thru 0xaae798 data_size 0x7(0x760b bytes) 2024-09-12T05:20:17.674 INFO:teuthology.orchestra.run.smithi059.stdout:273 trunc from 0xcee7523 to 0x76501f6 2024-09-12T05:20:17.698 INFO:teuthology.orchestra.run.smithi059.stdout:274 punch from 0xd3c5fb to 0xd462ed, (0x9cf2 bytes) 2024-09-12T05:20:17.698 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.698 INFO:teuthology.orchestra.run.smithi059.stdout:277 punch from 0x15150c7 to 0x151d202, (0x813b bytes) 2024-09-12T05:20:17.698 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.698 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.710 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:17.710+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:17.718 INFO:teuthology.orchestra.run.smithi059.stdout:280 writesame 0xafcab0c thru 0xafd1daf data_size 0xb(0x72a4 bytes) 2024-09-12T05:20:17.718 INFO:teuthology.orchestra.run.smithi059.stdout:282 read 0x780d907 thru 0x7815c3b (0x8335 bytes) 2024-09-12T05:20:17.719 INFO:teuthology.orchestra.run.smithi059.stdout:283 read 0x113512e thru 0x113d155 (0x8028 bytes) 2024-09-12T05:20:17.719 INFO:teuthology.orchestra.run.smithi059.stdout:284 write 0x85204d2 thru 0x8525bad (0x56dc bytes) 2024-09-12T05:20:17.725 INFO:teuthology.orchestra.run.smithi059.stdout:285 read 0x62326fa thru 0x6241fe0 (0xf8e7 bytes) 2024-09-12T05:20:17.726 INFO:teuthology.orchestra.run.smithi059.stdout:286 punch from 0x79665b6 to 0x7972a29, (0xc473 bytes) 2024-09-12T05:20:17.726 INFO:teuthology.orchestra.run.smithi059.stdout:288 read 0x1dc00d8 thru 0x1dc6c0c (0x6b35 bytes) 2024-09-12T05:20:17.727 INFO:teuthology.orchestra.run.smithi059.stdout:289 read 0x98911f6 thru 0x9895aaf (0x48ba bytes) 2024-09-12T05:20:17.727 INFO:teuthology.orchestra.run.smithi059.stdout:291 read 0x8e14964 thru 0x8e23280 (0xe91d bytes) 2024-09-12T05:20:17.727 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.728 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.728 INFO:teuthology.orchestra.run.smithi059.stdout:298 punch from 0x29cea23 to 0x29db254, (0xc831 bytes) 2024-09-12T05:20:17.728 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:17.728 INFO:teuthology.orchestra.run.smithi059.stdout:300 punch from 0x90af580 to 0x90b6b27, (0x75a7 bytes) 2024-09-12T05:20:17.734 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:17.734 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:17.734 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:17.734 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:17.734 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:17.742 INFO:teuthology.orchestra.run.smithi059.stdout:301 writesame 0xc8a5b78 thru 0xc8aab11 data_size 0x17(0x4f9a bytes) 2024-09-12T05:20:17.742 INFO:teuthology.orchestra.run.smithi059.stdout:303 read 0xa59f1f8 thru 0xa5aebf8 (0xfa01 bytes) 2024-09-12T05:20:17.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:17.757 INFO:teuthology.orchestra.run.smithi059.stdout:304 trunc from 0xc8aab12 to 0x5d47d86 2024-09-12T05:20:17.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:20:17.811 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:17.809+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:17.820 INFO:teuthology.orchestra.run.smithi059.stdout:305 write 0xc1ea614 thru 0xc1f7bf6 (0xd5e3 bytes) 2024-09-12T05:20:17.838 INFO:teuthology.orchestra.run.smithi059.stdout:306 trunc from 0xc1f7bf7 to 0x540f14e 2024-09-12T05:20:17.894 INFO:teuthology.orchestra.run.smithi059.stdout:307 trunc from 0x540f14e to 0xae7c1b9 2024-09-12T05:20:17.906 INFO:teuthology.orchestra.run.smithi059.stdout:308 writesame 0x2e27755 thru 0x2e2c35d data_size 0x11(0x4c09 bytes) 2024-09-12T05:20:17.910 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:17.910 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4266.0:5 2.2 e21/19 2:5cea7035:::rbd_info:head v 21'1, mlcod=0'0)", 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:00.926422+0000", 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.98613731, 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020934170000000002, 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.926422+0000", 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.926422+0000", 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.926423+0000", 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0699999999999996e-07 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.926431+0000", 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5660000000000007e-06 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.926458+0000", 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6817000000000001e-05 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.926483+0000", 2024-09-12T05:20:17.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.514e-05 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.926631+0000", 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014791899999999999 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.926669+0000", 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7698999999999999e-05 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.928371+0000", 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001702177 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:00.928516+0000", 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000144392 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-12T05:20:17.915 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:11.748504+0000", 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.1640558260000002, 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026233699999999999, 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.748504+0000", 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.748504+0000", 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.748505+0000", 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.06e-06 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.748513+0000", 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7900000000000005e-06 2024-09-12T05:20:17.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.748537+0000", 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3473e-05 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.748553+0000", 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5627000000000001e-05 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.748719+0000", 2024-09-12T05:20:17.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016618199999999999 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.748781+0000", 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2179000000000002e-05 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.751057+0000", 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00227561 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:11.751127+0000", 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0449000000000003e-05 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:768 3.6 e30/23 3:63de744d:::rbd_object_map.1118bd2b1382:head v 30'116, mlcod=29'114)", 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.800283+0000", 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.112276262, 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020522539999999999, 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.920 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.800283+0000", 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.800283+0000", 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.800284+0000", 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999998e-07 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.800291+0000", 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3100000000000003e-06 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.800316+0000", 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.525e-05 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.800332+0000", 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5437000000000001e-05 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.800494+0000", 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016198800000000001 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.800554+0000", 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0006000000000001e-05 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.802248+0000", 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001694264 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.802335+0000", 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7482e-05 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:813 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.924 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.873911+0000", 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.038648496, 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002731402, 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 813 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.873911+0000", 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.873911+0000", 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.873914+0000", 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.36e-06 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.873925+0000", 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0864e-05 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.873950+0000", 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5208e-05 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.873962+0000", 2024-09-12T05:20:17.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1406000000000001e-05 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.874124+0000", 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016244999999999999 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.874376+0000", 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025157100000000002 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.874583+0000", 2024-09-12T05:20:17.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000207591 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.876242+0000", 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016582999999999999 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.876539+0000", 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029734800000000001 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.876601+0000", 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1482000000000005e-05 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.876642+0000", 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1822e-05 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:855 3.4 3:20597007:::rbd_data.1118bd2b1382.0000000000000040:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.930 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.930981+0000", 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.98157877999999998, 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002287421, 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 855 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930981+0000", 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930981+0000", 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930983+0000", 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.04e-06 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.930990+0000", 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6240000000000002e-06 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931011+0000", 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0551e-05 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931023+0000", 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2576e-05 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931109+0000", 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5952999999999995e-05 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931288+0000", 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017907 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933268+0000", 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001979607 2024-09-12T05:20:17.934 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "pg_update_log_missing(3.8 epoch 30/23 rep_tid 65 entries 30'44 (0'0) error 3:14e2f7fe:::rbd_data.1118bd2b1382.0000000000000042:head by client.4376.0:857 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 30'42)", 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.931492+0000", 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.98106773400000002, 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041491560000000002, 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931492+0000", 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931492+0000", 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931493+0000", 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931507+0000", 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3905e-05 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931548+0000", 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1152999999999997e-05 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931577+0000", 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8645000000000001e-05 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.931709+0000", 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013237899999999999 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.935641+0000", 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039316469999999999 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.938 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:858 3.4 3:20597007:::rbd_data.1118bd2b1382.0000000000000040:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.933484+0000", 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.97907506600000005, 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051751200000000001, 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 858 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933484+0000", 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933484+0000", 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933486+0000", 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.277e-06 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933500+0000", 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3923e-05 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933515+0000", 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5801999999999999e-05 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933523+0000", 2024-09-12T05:20:17.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4730000000000003e-06 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933598+0000", 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4673999999999997e-05 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.933729+0000", 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000131836 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934044+0000", 2024-09-12T05:20:17.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031419100000000001 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.935953+0000", 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019097579999999999 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.938462+0000", 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025091470000000002 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.938592+0000", 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012981599999999999 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.938659+0000", 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7223000000000003e-05 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:861 3.8 e30/23 3:14e2f7fe:::rbd_data.1118bd2b1382.0000000000000042:head v 30'45, mlcod=30'43)", 2024-09-12T05:20:17.944 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.936825+0000", 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.97573409300000002, 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043424229999999998, 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.936825+0000", 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.936825+0000", 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.936827+0000", 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2529999999999999e-06 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.936836+0000", 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.594e-06 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.936859+0000", 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2855999999999999e-05 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.936871+0000", 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.154e-05 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.936942+0000", 2024-09-12T05:20:17.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0912000000000001e-05 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.936965+0000", 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3124000000000001e-05 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.941121+0000", 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041560290000000003 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.941168+0000", 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7114999999999999e-05 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:872 3.4 3:246b0b7f:::rbd_data.1118bd2b1382.0000000000000075:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.949577+0000", 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.96298220999999995, 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030755370000000001, 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.949 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 872 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949577+0000", 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949577+0000", 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949579+0000", 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9800000000000001e-06 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949587+0000", 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4869999999999996e-06 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949610+0000", 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3309999999999999e-05 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949622+0000", 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1916000000000001e-05 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949703+0000", 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1497999999999998e-05 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949810+0000", 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010677 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949984+0000", 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017408199999999999 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.951229+0000", 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012445309999999999 2024-09-12T05:20:17.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952524+0000", 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012952230000000001 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952606+0000", 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2130000000000001e-05 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952653+0000", 2024-09-12T05:20:17.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6610000000000003e-05 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:876 3.0 3:029ab416:::rbd_data.1118bd2b1382.0000000000000359:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.949752+0000", 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.96280703999999995, 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031670119999999999, 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.955 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 876 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949752+0000", 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949752+0000", 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949754+0000", 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4839999999999999e-06 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949761+0000", 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2080000000000003e-06 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949777+0000", 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5812e-05 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949788+0000", 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0890000000000001e-05 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949868+0000", 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9744000000000001e-05 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.949935+0000", 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7506e-05 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950116+0000", 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018116200000000001 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.951577+0000", 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001461179 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952846+0000", 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012682699999999999 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952884+0000", 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8145000000000002e-05 2024-09-12T05:20:17.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952919+0000", 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5611999999999997e-05 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:879 3.6 e30/23 3:63de744d:::rbd_object_map.1118bd2b1382:head v 30'120, mlcod=30'117)", 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.961114+0000", 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.95144504100000005, 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027334999999999998, 2024-09-12T05:20:17.961 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961114+0000", 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961114+0000", 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961116+0000", 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1820000000000001e-06 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961125+0000", 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9789999999999999e-06 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961141+0000", 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6007000000000001e-05 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961150+0000", 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5270000000000004e-06 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961270+0000", 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011990299999999999 2024-09-12T05:20:17.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.961298+0000", 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7739e-05 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963764+0000", 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00246612 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963848+0000", 2024-09-12T05:20:17.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4042999999999995e-05 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:881 3.19 3:9d4262ca:::rbd_data.1118bd2b1382.0000000000000036:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,truncate 131072] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.963533+0000", 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.94902689600000001, 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003393999, 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 881 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963533+0000", 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963533+0000", 2024-09-12T05:20:17.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963536+0000", 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7799999999999998e-06 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963550+0000", 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3767e-05 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963584+0000", 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4226000000000001e-05 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963609+0000", 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4844000000000001e-05 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.963777+0000", 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016746799999999999 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.964170+0000", 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039333400000000001 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.964459+0000", 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000288588 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.966463+0000", 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020040460000000002 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.966809+0000", 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000346657 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.966885+0000", 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6118000000000005e-05 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.966927+0000", 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1171000000000003e-05 2024-09-12T05:20:17.971 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:1010 3.8 e30/23 3:101b7752:::rbd_data.1118feb697f7.0000000000000003:head v 30'49, mlcod=30'47)", 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.449157+0000", 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.46340238700000003, 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040454590000000004, 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.449157+0000", 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.449157+0000", 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.449159+0000", 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6440000000000001e-06 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.449837+0000", 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000678165 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.449858+0000", 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1027e-05 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.449870+0000", 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1667e-05 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.449951+0000", 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1874999999999998e-05 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.449978+0000", 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6387e-05 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.453104+0000", 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003126059 2024-09-12T05:20:17.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.453203+0000", 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8634999999999993e-05 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1031 3.0 3:036b063d:::rbd_data.1118feb697f7.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write 4155179~39125] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.500737+0000", 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.41182196399999998, 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002151404, 2024-09-12T05:20:17.976 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1031 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.500737+0000", 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.500737+0000", 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.500741+0000", 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1389999999999999e-06 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.500779+0000", 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8346000000000002e-05 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.500814+0000", 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4674e-05 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.500836+0000", 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2566e-05 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.500925+0000", 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9079999999999994e-05 2024-09-12T05:20:17.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.501048+0000", 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012296099999999999 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.501186+0000", 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000137422 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.502506+0000", 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001320676 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.502820+0000", 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000313257 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.502853+0000", 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3306999999999998e-05 2024-09-12T05:20:17.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.502889+0000", 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5976000000000002e-05 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1036 3.0 3:036b063d:::rbd_data.1118feb697f7.000000000000001a:head [stat,truncate 1572864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.509647+0000", 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.40291252100000002, 2024-09-12T05:20:17.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002452138, 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1036 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509647+0000", 2024-09-12T05:20:17.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509647+0000", 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509650+0000", 2024-09-12T05:20:17.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.903e-06 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509659+0000", 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7299999999999994e-06 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509682+0000", 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3305000000000001e-05 2024-09-12T05:20:17.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509693+0000", 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0723000000000001e-05 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509769+0000", 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6784000000000002e-05 2024-09-12T05:20:17.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509843+0000", 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3380000000000006e-05 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.509964+0000", 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000121218 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.511977+0000", 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020126440000000001 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.511993+0000", 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6038000000000001e-05 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512051+0000", 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8508999999999998e-05 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512099+0000", 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7904000000000001e-05 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1072 3.0 3:036b063d:::rbd_data.1118feb697f7.000000000000001a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.989 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.557187+0000", 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.35537201800000001, 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028617920000000002, 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1072 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557187+0000", 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557187+0000", 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557190+0000", 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.582e-06 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557200+0000", 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0084999999999999e-05 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557225+0000", 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4762000000000001e-05 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557239+0000", 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3749e-05 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557414+0000", 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017588099999999999 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557646+0000", 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023137200000000001 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.557990+0000", 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00034398700000000003 2024-09-12T05:20:17.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.559067+0000", 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010771660000000001 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.559887+0000", 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00082007599999999999 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.559980+0000", 2024-09-12T05:20:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2702999999999997e-05 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.560049+0000", 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9429000000000002e-05 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1112 3.4 3:2517f5ce:::rbd_data.1118feb697f7.0000000000000010:head [set-alloc-hint object_size 8388608 write_size 8388608,write 4357821~36704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.628304+0000", 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.284255274, 2024-09-12T05:20:17.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021866469999999999, 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1112 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628304+0000", 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628304+0000", 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628306+0000", 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9800000000000001e-06 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628328+0000", 2024-09-12T05:20:17.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1919000000000001e-05 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628346+0000", 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7458000000000001e-05 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628357+0000", 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1593999999999999e-05 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628429+0000", 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1828000000000004e-05 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628550+0000", 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000121471 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.628659+0000", 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010900699999999999 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:17.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.629529+0000", 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00086946199999999999 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.630378+0000", 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00084881400000000004 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.630442+0000", 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3973999999999994e-05 2024-09-12T05:20:18.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.630491+0000", 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.914e-05 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1153 3.19 3:997e0ed6:::rbd_data.1118feb697f7.000000000000000e:head [set-alloc-hint object_size 8388608 write_size 8388608,write 3278034~22236] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.727468+0000", 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.18509118399999999, 2024-09-12T05:20:18.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025499390000000002, 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1153 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727468+0000", 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727468+0000", 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727471+0000", 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5859999999999999e-06 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727499+0000", 2024-09-12T05:20:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7929999999999999e-05 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727531+0000", 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1816000000000002e-05 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727552+0000", 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1633000000000001e-05 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:18.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727646+0000", 2024-09-12T05:20:18.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4042000000000005e-05 2024-09-12T05:20:18.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727809+0000", 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016249400000000001 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.727968+0000", 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015932000000000001 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.728937+0000", 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000969026 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.729914+0000", 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00097698699999999991 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.729972+0000", 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7547999999999999e-05 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.730018+0000", 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6557000000000002e-05 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1189 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 8158598] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.779476+0000", 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.13308326300000001, 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010619807, 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:18.010 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1189 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.779476+0000", 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:18.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.779476+0000", 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.779478+0000", 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0540000000000002e-06 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780257+0000", 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00077859000000000001 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:18.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780277+0000", 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0534999999999999e-05 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780287+0000", 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9129999999999998e-06 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780353+0000", 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5817999999999999e-05 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780489+0000", 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013598399999999999 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780917+0000", 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00042794399999999998 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.787739+0000", 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068218339999999997 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.789960+0000", 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022211650000000002 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.790035+0000", 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4783999999999994e-05 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.790096+0000", 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1186000000000007e-05 2024-09-12T05:20:18.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1190 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.780317+0000", 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.13224272200000001, 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010181851, 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:18.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1190 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780317+0000", 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780317+0000", 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780317+0000", 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8299999999999997e-07 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780321+0000", 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.292e-06 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780328+0000", 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6129999999999998e-06 2024-09-12T05:20:18.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.780337+0000", 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6659999999999997e-06 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.783752+0000", 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034154260000000001 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.783877+0000", 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012427599999999999 2024-09-12T05:20:18.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.784053+0000", 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017691199999999999 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.790113+0000", 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060593920000000003 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.790397+0000", 2024-09-12T05:20:18.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028429099999999999 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.790457+0000", 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9395000000000003e-05 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.790499+0000", 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2005000000000002e-05 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:18.022 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:18.022 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:18.022 INFO:teuthology.orchestra.run.smithi059.stdout:309 write 0x1fde5d5 thru 0x1feb15e (0xcb8a bytes) 2024-09-12T05:20:18.022 INFO:teuthology.orchestra.run.smithi059.stdout:311 write 0xb4c4b24 thru 0xb4c602a (0x1507 bytes) 2024-09-12T05:20:18.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:18.025 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.025 INFO:teuthology.orchestra.run.smithi059.stdout:313 punch from 0x980307c to 0x9804348, (0x12cc bytes) 2024-09-12T05:20:18.025 INFO:teuthology.orchestra.run.smithi059.stdout:314 read 0x257aa05 thru 0x25809cb (0x5fc7 bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:315 write 0x1779fbb thru 0x177e476 (0x44bc bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:316 punch from 0xb14a678 to 0xb14bda9, (0x1731 bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:317 read 0x94f3515 thru 0x94f4926 (0x1412 bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:318 write 0x5a272e3 thru 0x5a347d2 (0xd4f0 bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:319 flatten 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:321 trunc from 0xb4c602b to 0x90adbf7 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:322 writesame 0x57bdb61 thru 0x57c74be data_size 0x2(0x995e bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:324 writesame 0x4d988c thru 0x4e4c69 data_size 0x5b(0xb3de bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:326 punch from 0x2bbd023 to 0x2bc229a, (0x5277 bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:327 read 0x554a8a6 thru 0x5558d11 (0xe46c bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:328 write 0xd9c73c5 thru 0xd9d54b2 (0xe0ee bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:329 write 0x94351a2 thru 0x943a50d (0x536c bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:330 write 0xa6471ce thru 0xa652285 (0xb0b8 bytes) 2024-09-12T05:20:18.026 INFO:teuthology.orchestra.run.smithi059.stdout:331 punch from 0x6706c89 to 0x670a9b4, (0x3d2b bytes) 2024-09-12T05:20:18.027 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:18.025+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:18.032 INFO:teuthology.orchestra.run.smithi059.stdout:334 trunc from 0xd9d54b3 to 0xc08df4 2024-09-12T05:20:18.077 INFO:teuthology.orchestra.run.smithi059.stdout:336 trunc from 0xc08df4 to 0xca36f0b 2024-09-12T05:20:18.087 INFO:teuthology.orchestra.run.smithi059.stdout:337 read 0x676bebe thru 0x676cc09 (0xd4c bytes) 2024-09-12T05:20:18.087 INFO:teuthology.orchestra.run.smithi059.stdout:338 writesame 0x3ffa734 thru 0x400901f data_size 0x6(0xe8ec bytes) 2024-09-12T05:20:18.094 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.094 INFO:teuthology.orchestra.run.smithi059.stdout:340 read 0xdc193 thru 0xe9ce6 (0xdb54 bytes) 2024-09-12T05:20:18.096 INFO:teuthology.orchestra.run.smithi059.stdout:342 punch from 0x4de3915 to 0x4dedd32, (0xa41d bytes) 2024-09-12T05:20:18.096 INFO:teuthology.orchestra.run.smithi059.stdout:343 write 0x3363580 thru 0x336373b (0x1bc bytes) 2024-09-12T05:20:18.098 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.098 INFO:teuthology.orchestra.run.smithi059.stdout:348 write 0xc754277 thru 0xc75bd34 (0x7abe bytes) 2024-09-12T05:20:18.103 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.104 INFO:teuthology.orchestra.run.smithi059.stdout:351 writesame 0x445ad87 thru 0x4466126 data_size 0x30(0xb3a0 bytes) 2024-09-12T05:20:18.108 INFO:teuthology.orchestra.run.smithi059.stdout:352 punch from 0xc99cbe9 to 0xc9ab977, (0xed8e bytes) 2024-09-12T05:20:18.108 INFO:teuthology.orchestra.run.smithi059.stdout:353 punch from 0x7e8e9d2 to 0x7e8fec5, (0x14f3 bytes) 2024-09-12T05:20:18.109 INFO:teuthology.orchestra.run.smithi059.stdout:356 read 0x68cc556 thru 0x68d9fb9 (0xda64 bytes) 2024-09-12T05:20:18.115 INFO:teuthology.orchestra.run.smithi059.stdout:357 trunc from 0xca36f0b to 0x8dd43ed 2024-09-12T05:20:18.126 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:18.130+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:18.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:18.136 INFO:teuthology.orchestra.run.smithi059.stdout:358 write 0x604b36a thru 0x604ec6c (0x3903 bytes) 2024-09-12T05:20:18.156 INFO:teuthology.orchestra.run.smithi059.stdout:359 trunc from 0x8dd43ed to 0x714fe9 2024-09-12T05:20:18.182 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:18.183 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:18.183 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:18.183 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:18.201 INFO:teuthology.orchestra.run.smithi059.stdout:360 write 0x4179210 thru 0x4188659 (0xf44a bytes) 2024-09-12T05:20:18.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:18.205 INFO:teuthology.orchestra.run.smithi059.stdout:363 read 0x1ef960c thru 0x1efff4c (0x6941 bytes) 2024-09-12T05:20:18.222 INFO:teuthology.orchestra.run.smithi059.stdout:364 write 0x77ab786 thru 0x77ab7ad (0x28 bytes) 2024-09-12T05:20:18.227 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:18.230+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:18.227 INFO:teuthology.orchestra.run.smithi059.stdout:365 write 0x5ceb67f thru 0x5cf0eb4 (0x5836 bytes) 2024-09-12T05:20:18.229 INFO:teuthology.orchestra.run.smithi059.stdout:366 read 0x65d5b35 thru 0x65e1452 (0xb91e bytes) 2024-09-12T05:20:18.230 INFO:teuthology.orchestra.run.smithi059.stdout:367 write 0x61765c3 thru 0x61864d7 (0xff15 bytes) 2024-09-12T05:20:18.247 INFO:teuthology.orchestra.run.smithi059.stdout:369 writesame 0x89dbb77 thru 0x89eaca8 data_size 0x29(0xf132 bytes) 2024-09-12T05:20:18.249 INFO:teuthology.orchestra.run.smithi059.stdout:370 read 0x80983ab thru 0x809af2b (0x2b81 bytes) 2024-09-12T05:20:18.249 INFO:teuthology.orchestra.run.smithi059.stdout:372 read 0x89771ff thru 0x8985543 (0xe345 bytes) 2024-09-12T05:20:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:373 write 0x2cfbe27 thru 0x2cfc580 (0x75a bytes) 2024-09-12T05:20:18.267 INFO:teuthology.orchestra.run.smithi059.stdout:374 write 0xc5255ee thru 0xc52a387 (0x4d9a bytes) 2024-09-12T05:20:18.274 INFO:teuthology.orchestra.run.smithi059.stdout:377 write 0xa4d014c thru 0xa4d5613 (0x54c8 bytes) 2024-09-12T05:20:18.287 INFO:teuthology.orchestra.run.smithi059.stdout:378 trunc from 0xc52a388 to 0x5d78604 2024-09-12T05:20:18.290 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:18.311 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:18.311 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:18.327 INFO:teuthology.orchestra.run.smithi059.stdout:379 write 0xaf608c5 thru 0xaf6a834 (0x9f70 bytes) 2024-09-12T05:20:18.328 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:18.325+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:18.329 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:18.329 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:18.334 INFO:teuthology.orchestra.run.smithi059.stdout:381 trunc from 0xaf6a835 to 0x97377f3 2024-09-12T05:20:18.336 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:18.337 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:18.346 INFO:teuthology.orchestra.run.smithi059.stdout:382 writesame 0x7c7cd08 thru 0x7c86ac6 data_size 0x15(0x9dbf bytes) 2024-09-12T05:20:18.348 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:18.349 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:18.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:18.356 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.356 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.356 INFO:teuthology.orchestra.run.smithi059.stdout:388 writesame 0x11c946a thru 0x11d5721 data_size 0x1f(0xc2b8 bytes) 2024-09-12T05:20:18.371 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:18.378 INFO:teuthology.orchestra.run.smithi059.stdout:389 writesame 0xde42b04 thru 0xde462ea data_size 0x1(0x37e7 bytes) 2024-09-12T05:20:18.378 INFO:teuthology.orchestra.run.smithi059.stdout:390 punch from 0xaf337e0 to 0xaf3df2b, (0xa74b bytes) 2024-09-12T05:20:18.378 INFO:teuthology.orchestra.run.smithi059.stdout:392 read 0x57df253 thru 0x57e503b (0x5de9 bytes) 2024-09-12T05:20:18.378 INFO:teuthology.orchestra.run.smithi059.stdout:393 read 0x6984862 thru 0x698cf4d (0x86ec bytes) 2024-09-12T05:20:18.378 INFO:teuthology.orchestra.run.smithi059.stdout:394 write 0x81bdf70 thru 0x81c4bcb (0x6c5c bytes) 2024-09-12T05:20:18.384 INFO:teuthology.orchestra.run.smithi059.stdout:395 read 0x4e3aa3a thru 0x4e4a3fa (0xf9c1 bytes) 2024-09-12T05:20:18.385 INFO:teuthology.orchestra.run.smithi059.stdout:397 writesame 0x57038e9 thru 0x5708a7c data_size 0x17(0x5194 bytes) 2024-09-12T05:20:18.386 INFO:teuthology.orchestra.run.smithi059.stdout:398 read 0x3c60fe8 thru 0x3c6f08e (0xe0a7 bytes) 2024-09-12T05:20:18.387 INFO:teuthology.orchestra.run.smithi059.stdout:399 write 0x5836282 thru 0x5842923 (0xc6a2 bytes) 2024-09-12T05:20:18.392 INFO:teuthology.orchestra.run.smithi059.stdout:401 read 0xe52817 thru 0xe5d45e (0xac48 bytes) 2024-09-12T05:20:18.393 INFO:teuthology.orchestra.run.smithi059.stdout:403 write 0xa120957 thru 0xa1269d8 (0x6082 bytes) 2024-09-12T05:20:18.394 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:18.394 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:18.400 INFO:teuthology.orchestra.run.smithi059.stdout:405 read 0x60378ae thru 0x60439f7 (0xc14a bytes) 2024-09-12T05:20:18.400 INFO:teuthology.orchestra.run.smithi059.stdout:406 write 0xad4006e thru 0xad49735 (0x96c8 bytes) 2024-09-12T05:20:18.405 INFO:teuthology.orchestra.run.smithi059.stdout:407 trunc from 0xde462eb to 0xc361e4c 2024-09-12T05:20:18.417 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:18.417 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:18.418 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.418 INFO:teuthology.orchestra.run.smithi059.stdout:409 writesame 0x812250e thru 0x8125e76 data_size 0x17(0x3969 bytes) 2024-09-12T05:20:18.425 INFO:teuthology.orchestra.run.smithi059.stdout:412 read 0xa828131 thru 0xa8367be (0xe68e bytes) 2024-09-12T05:20:18.425 INFO:teuthology.orchestra.run.smithi059.stdout:413 writesame 0x19b4c8c thru 0x19b7266 data_size 0x1(0x25db bytes) 2024-09-12T05:20:18.428 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:18.425+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:18.430 INFO:teuthology.orchestra.run.smithi059.stdout:415 write 0x367e5ee thru 0x368d18d (0xeba0 bytes) 2024-09-12T05:20:18.434 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.434 INFO:teuthology.orchestra.run.smithi059.stdout:417 trunc from 0xc361e4c to 0xc2b0034 2024-09-12T05:20:18.444 INFO:teuthology.orchestra.run.smithi059.stdout:418 punch from 0x6aa99cb to 0x6ab4a89, (0xb0be bytes) 2024-09-12T05:20:18.455 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:18.455 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:18.458 INFO:teuthology.orchestra.run.smithi059.stdout:420 write 0xe1100f2 thru 0xe11e498 (0xe3a7 bytes) 2024-09-12T05:20:18.473 INFO:teuthology.orchestra.run.smithi059.stdout:421 trunc from 0xe11e499 to 0x4842db5 2024-09-12T05:20:18.484 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:18.484 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:18.498 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:18.498 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.499 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.521 INFO:teuthology.orchestra.run.smithi059.stdout:424 writesame 0xe0f5835 thru 0xe105094 data_size 0x10(0xf860 bytes) 2024-09-12T05:20:18.521 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.521 INFO:teuthology.orchestra.run.smithi059.stdout:427 punch from 0x8290bec to 0x8290f3e, (0x352 bytes) 2024-09-12T05:20:18.521 INFO:teuthology.orchestra.run.smithi059.stdout:428 write 0x95216d3 thru 0x952d956 (0xc284 bytes) 2024-09-12T05:20:18.527 INFO:teuthology.orchestra.run.smithi059.stdout:430 read 0x767448f thru 0x76804f9 (0xc06b bytes) 2024-09-12T05:20:18.527 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.527 INFO:teuthology.orchestra.run.smithi059.stdout:434 writesame 0x98e6b38 thru 0x98eedea data_size 0x13(0x82b3 bytes) 2024-09-12T05:20:18.528 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:18.530+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:18.533 INFO:teuthology.orchestra.run.smithi059.stdout:435 write 0x91869fe thru 0x9196266 (0xf869 bytes) 2024-09-12T05:20:18.553 INFO:teuthology.orchestra.run.smithi059.stdout:436 trunc from 0xe105095 to 0xb11765 2024-09-12T05:20:18.582 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.582 INFO:teuthology.orchestra.run.smithi059.stdout:439 read 0xaa969c thru 0xaabf36 (0x289b bytes) 2024-09-12T05:20:18.582 INFO:teuthology.orchestra.run.smithi059.stdout:440 read 0x6e046a thru 0x6e5fea (0x5b81 bytes) 2024-09-12T05:20:18.584 INFO:teuthology.orchestra.run.smithi059.stdout:442 read 0x5ff40b thru 0x60db2e (0xe724 bytes) 2024-09-12T05:20:18.605 INFO:teuthology.orchestra.run.smithi059.stdout:443 write 0x659e47f thru 0x65a0bfb (0x277d bytes) 2024-09-12T05:20:18.612 INFO:teuthology.orchestra.run.smithi059.stdout:444 trunc from 0x65a0bfc to 0x669b10f 2024-09-12T05:20:18.629 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:18.629+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:18.644 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:18.644 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:18.645 INFO:teuthology.orchestra.run.smithi059.stdout:446 writesame 0xcc3c678 thru 0xcc436ab data_size 0x56(0x7034 bytes) 2024-09-12T05:20:18.645 INFO:teuthology.orchestra.run.smithi059.stdout:447 read 0xc91fdb5 thru 0xc92c050 (0xc29c bytes) 2024-09-12T05:20:18.645 INFO:teuthology.orchestra.run.smithi059.stdout:449 write 0xb7e3138 thru 0xb7f2ec5 (0xfd8e bytes) 2024-09-12T05:20:18.652 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.652 INFO:teuthology.orchestra.run.smithi059.stdout:451 punch from 0x44eb739 to 0x44f8c22, (0xd4e9 bytes) 2024-09-12T05:20:18.652 INFO:teuthology.orchestra.run.smithi059.stdout:453 write 0xae07dab thru 0xae14497 (0xc6ed bytes) 2024-09-12T05:20:18.659 INFO:teuthology.orchestra.run.smithi059.stdout:455 writesame 0x21cf836 thru 0x21ddd31 data_size 0x1e(0xe4fc bytes) 2024-09-12T05:20:18.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:18.663 INFO:teuthology.orchestra.run.smithi059.stdout:456 write 0xbbcfa66 thru 0xbbdb33c (0xb8d7 bytes) 2024-09-12T05:20:18.669 INFO:teuthology.orchestra.run.smithi059.stdout:457 write 0xaca0d1d thru 0xaca93c7 (0x86ab bytes) 2024-09-12T05:20:18.676 INFO:teuthology.orchestra.run.smithi059.stdout:458 read 0x2cc59cb thru 0x2ccff78 (0xa5ae bytes) 2024-09-12T05:20:18.676 INFO:teuthology.orchestra.run.smithi059.stdout:460 punch from 0x6a9b2fb to 0x6aa57e1, (0xa4e6 bytes) 2024-09-12T05:20:18.677 INFO:teuthology.orchestra.run.smithi059.stdout:461 write 0x2f17ac9 thru 0x2f21e05 (0xa33d bytes) 2024-09-12T05:20:18.681 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.681 INFO:teuthology.orchestra.run.smithi059.stdout:463 writesame 0xa97aebc thru 0xa987654 data_size 0x1(0xc799 bytes) 2024-09-12T05:20:18.715 INFO:teuthology.orchestra.run.smithi059.stdout:464 trunc from 0xcc436ac to 0x2d78712 2024-09-12T05:20:18.729 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:18.730+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:18.767 INFO:teuthology.orchestra.run.smithi059.stdout:466 write 0xdaf1df0 thru 0xdaf5320 (0x3531 bytes) 2024-09-12T05:20:18.773 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.773 INFO:teuthology.orchestra.run.smithi059.stdout:468 write 0x6172c6f thru 0x6175982 (0x2d14 bytes) 2024-09-12T05:20:18.779 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.779 INFO:teuthology.orchestra.run.smithi059.stdout:470 punch from 0x3b372b5 to 0x3b3b5e4, (0x432f bytes) 2024-09-12T05:20:18.780 INFO:teuthology.orchestra.run.smithi059.stdout:471 write 0xc8e4a18 thru 0xc8e501f (0x608 bytes) 2024-09-12T05:20:18.783 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.783 INFO:teuthology.orchestra.run.smithi059.stdout:473 read 0x4715498 thru 0x471e325 (0x8e8e bytes) 2024-09-12T05:20:18.784 INFO:teuthology.orchestra.run.smithi059.stdout:476 write 0xc4be590 thru 0xc4c67bb (0x822c bytes) 2024-09-12T05:20:18.790 INFO:teuthology.orchestra.run.smithi059.stdout:477 punch from 0xc79578a to 0xc79c67b, (0x6ef1 bytes) 2024-09-12T05:20:18.790 INFO:teuthology.orchestra.run.smithi059.stdout:478 read 0xbc0038c thru 0xbc0f33c (0xefb1 bytes) 2024-09-12T05:20:18.790 INFO:teuthology.orchestra.run.smithi059.stdout:479 write 0xb3affee thru 0xb3b3894 (0x38a7 bytes) 2024-09-12T05:20:18.791 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:18.791 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:20:18.804 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.804 INFO:teuthology.orchestra.run.smithi059.stdout:482 read 0x9e9308c thru 0x9e984e9 (0x545e bytes) 2024-09-12T05:20:18.804 INFO:teuthology.orchestra.run.smithi059.stdout:483 punch from 0x890e755 to 0x891a883, (0xc12e bytes) 2024-09-12T05:20:18.804 INFO:teuthology.orchestra.run.smithi059.stdout:484 write 0x1fa4e20 thru 0x1fa620a (0x13eb bytes) 2024-09-12T05:20:18.806 INFO:teuthology.orchestra.run.smithi059.stdout:485 write 0xad6c73b thru 0xad751a1 (0x8a67 bytes) 2024-09-12T05:20:18.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:18.818 INFO:teuthology.orchestra.run.smithi059.stdout:487 punch from 0xc5cc75a to 0xc5cf484, (0x2d2a bytes) 2024-09-12T05:20:18.818 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.818 INFO:teuthology.orchestra.run.smithi059.stdout:truncating to largest ever: 0xedf8b4f 2024-09-12T05:20:18.820 INFO:teuthology.orchestra.run.smithi059.stdout:490 trunc from 0xdaf5321 to 0xedf8b4f 2024-09-12T05:20:18.831 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:18.829+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:18.833 INFO:teuthology.orchestra.run.smithi059.stdout:492 punch from 0x2dc433 to 0x2ebdd9, (0xf9a6 bytes) 2024-09-12T05:20:18.833 INFO:teuthology.orchestra.run.smithi059.stdout:493 read 0x77f4ade thru 0x77f863c (0x3b5f bytes) 2024-09-12T05:20:18.833 INFO:teuthology.orchestra.run.smithi059.stdout:495 read 0x49f8894 thru 0x4a07c88 (0xf3f5 bytes) 2024-09-12T05:20:18.833 INFO:teuthology.orchestra.run.smithi059.stdout:496 write 0xba15758 thru 0xba1d430 (0x7cd9 bytes) 2024-09-12T05:20:18.839 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.839 INFO:teuthology.orchestra.run.smithi059.stdout:498 writesame 0x6045515 thru 0x604f886 data_size 0x1(0xa372 bytes) 2024-09-12T05:20:18.894 INFO:teuthology.orchestra.run.smithi059.stdout:499 writesame 0x706f89e thru 0x707b763 data_size 0x1(0xbec6 bytes) 2024-09-12T05:20:18.932 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:18.932 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:18.932 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:18.934+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:18.946 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:18.963 INFO:teuthology.orchestra.run.smithi059.stdout:503 write 0xb089a42 thru 0xb090488 (0x6a47 bytes) 2024-09-12T05:20:18.970 INFO:teuthology.orchestra.run.smithi059.stdout:504 writesame 0x4b5e8de thru 0x4b65038 data_size 0x1(0x675b bytes) 2024-09-12T05:20:18.987 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:18.987 INFO:teuthology.orchestra.run.smithi059.stdout:506 write 0x19a2bbd thru 0x19a982b (0x6c6f bytes) 2024-09-12T05:20:18.989 INFO:teuthology.orchestra.run.smithi059.stdout:507 punch from 0xc0c7b55 to 0xc0d13d5, (0x9880 bytes) 2024-09-12T05:20:18.989 INFO:teuthology.orchestra.run.smithi059.stdout:508 write 0x87971ca thru 0x87a1dbd (0xabf4 bytes) 2024-09-12T05:20:18.997 INFO:teuthology.orchestra.run.smithi059.stdout:509 trunc from 0xedf8b4f to 0xdf6107f 2024-09-12T05:20:19.012 INFO:teuthology.orchestra.run.smithi059.stdout:510 read 0xc5c6353 thru 0xc5d5143 (0xedf1 bytes) 2024-09-12T05:20:19.020 INFO:teuthology.orchestra.run.smithi059.stdout:511 trunc from 0xdf6107f to 0xa1ede4f 2024-09-12T05:20:19.032 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:19.033+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:19.047 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.047 INFO:teuthology.orchestra.run.smithi059.stdout:513 write 0x8375ab1 thru 0x8377029 (0x1579 bytes) 2024-09-12T05:20:19.049 INFO:teuthology.orchestra.run.smithi059.stdout:516 read 0xbb1f2b thru 0xbbf6f9 (0xd7cf bytes) 2024-09-12T05:20:19.051 INFO:teuthology.orchestra.run.smithi059.stdout:517 writesame 0x8499a0 thru 0x858353 data_size 0x2(0xe9b4 bytes) 2024-09-12T05:20:19.081 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:19.081 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:19.090 INFO:teuthology.orchestra.run.smithi059.stdout:518 read 0x325c513 thru 0x325f59b (0x3089 bytes) 2024-09-12T05:20:19.095 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:19.101 INFO:teuthology.orchestra.run.smithi059.stdout:520 write 0xb0ee980 thru 0xb0f4131 (0x57b2 bytes) 2024-09-12T05:20:19.105 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.118 INFO:teuthology.orchestra.run.smithi059.stdout:522 write 0xc688b86 thru 0xc68a63e (0x1ab9 bytes) 2024-09-12T05:20:19.125 INFO:teuthology.orchestra.run.smithi059.stdout:523 read 0x2f93df6 thru 0x2fa121c (0xd427 bytes) 2024-09-12T05:20:19.125 INFO:teuthology.orchestra.run.smithi059.stdout:525 read 0x5c626c1 thru 0x5c69d87 (0x76c7 bytes) 2024-09-12T05:20:19.126 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.127 INFO:teuthology.orchestra.run.smithi059.stdout:527 read 0xfa806 thru 0x103b10 (0x930b bytes) 2024-09-12T05:20:19.128 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.128 INFO:teuthology.orchestra.run.smithi059.stdout:529 write 0x7e4a5a6 thru 0x7e4fade (0x5539 bytes) 2024-09-12T05:20:19.133 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:19.134+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:19.149 INFO:teuthology.orchestra.run.smithi059.stdout:530 write 0xe41b679 thru 0xe4243a5 (0x8d2d bytes) 2024-09-12T05:20:19.156 INFO:teuthology.orchestra.run.smithi059.stdout:531 read 0x59f57ef thru 0x59fc7d5 (0x6fe7 bytes) 2024-09-12T05:20:19.157 INFO:teuthology.orchestra.run.smithi059.stdout:532 writesame 0x1cc3b27 thru 0x1cc4568 data_size 0xd(0xa42 bytes) 2024-09-12T05:20:19.161 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.161 INFO:teuthology.orchestra.run.smithi059.stdout:536 punch from 0x6322768 to 0x6328875, (0x610d bytes) 2024-09-12T05:20:19.161 INFO:teuthology.orchestra.run.smithi059.stdout:537 read 0xc0c6dc3 thru 0xc0cf686 (0x88c4 bytes) 2024-09-12T05:20:19.161 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.161 INFO:teuthology.orchestra.run.smithi059.stdout:539 read 0xefd7c8 thru 0xeffc5d (0x2496 bytes) 2024-09-12T05:20:19.162 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.163 INFO:teuthology.orchestra.run.smithi059.stdout:543 read 0x53bde93 thru 0x53cc4a5 (0xe613 bytes) 2024-09-12T05:20:19.163 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.163 INFO:teuthology.orchestra.run.smithi059.stdout:545 write 0x6700ba2 thru 0x6707e06 (0x7265 bytes) 2024-09-12T05:20:19.167 INFO:teuthology.orchestra.run.smithi059.stdout:547 write 0x7d03959 thru 0x7d0dba0 (0xa248 bytes) 2024-09-12T05:20:19.170 INFO:teuthology.orchestra.run.smithi059.stdout:549 read 0x8c51a8c thru 0x8c54c28 (0x319d bytes) 2024-09-12T05:20:19.170 INFO:teuthology.orchestra.run.smithi059.stdout:550 read 0x71ec52d thru 0x71f141e (0x4ef2 bytes) 2024-09-12T05:20:19.171 INFO:teuthology.orchestra.run.smithi059.stdout:551 write 0x248a72a thru 0x2493b7c (0x9453 bytes) 2024-09-12T05:20:19.173 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.173 INFO:teuthology.orchestra.run.smithi059.stdout:553 punch from 0x26122e3 to 0x2618028, (0x5d45 bytes) 2024-09-12T05:20:19.183 INFO:teuthology.orchestra.run.smithi059.stdout:554 write 0xe6e0b9c thru 0xe6ee149 (0xd5ae bytes) 2024-09-12T05:20:19.189 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.189 INFO:teuthology.orchestra.run.smithi059.stdout:556 read 0xd20cf88 thru 0xd216c06 (0x9c7f bytes) 2024-09-12T05:20:19.190 INFO:teuthology.orchestra.run.smithi059.stdout:557 punch from 0xe1987f4 to 0xe19ec82, (0x648e bytes) 2024-09-12T05:20:19.190 INFO:teuthology.orchestra.run.smithi059.stdout:558 read 0x583e8d0 thru 0x584d7e7 (0xef18 bytes) 2024-09-12T05:20:19.190 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.190 INFO:teuthology.orchestra.run.smithi059.stdout:560 punch from 0xaa61a41 to 0xaa6365d, (0x1c1c bytes) 2024-09-12T05:20:19.190 INFO:teuthology.orchestra.run.smithi059.stdout:561 write 0x6bb790b thru 0x6bbe90b (0x7001 bytes) 2024-09-12T05:20:19.193 INFO:teuthology.orchestra.run.smithi059.stdout:562 write 0x2a8c27e thru 0x2a8c2f1 (0x74 bytes) 2024-09-12T05:20:19.195 INFO:teuthology.orchestra.run.smithi059.stdout:563 punch from 0x7d23c6c to 0x7d2f018, (0xb3ac bytes) 2024-09-12T05:20:19.195 INFO:teuthology.orchestra.run.smithi059.stdout:565 write 0x6475c57 thru 0x647df1d (0x82c7 bytes) 2024-09-12T05:20:19.199 INFO:teuthology.orchestra.run.smithi059.stdout:566 writesame 0x9b2496e thru 0x9b2998d data_size 0x10(0x5020 bytes) 2024-09-12T05:20:19.202 INFO:teuthology.orchestra.run.smithi059.stdout:567 read 0x6cb6895 thru 0x6cbd4fd (0x6c69 bytes) 2024-09-12T05:20:19.202 INFO:teuthology.orchestra.run.smithi059.stdout:568 punch from 0xc496810 to 0xc49c036, (0x5826 bytes) 2024-09-12T05:20:19.202 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.202 INFO:teuthology.orchestra.run.smithi059.stdout:571 write 0x1374545 thru 0x137b6bc (0x7178 bytes) 2024-09-12T05:20:19.205 INFO:teuthology.orchestra.run.smithi059.stdout:572 read 0x7ce8457 thru 0x7cf61e0 (0xdd8a bytes) 2024-09-12T05:20:19.205 INFO:teuthology.orchestra.run.smithi059.stdout:573 write 0x3434256 thru 0x343f7f6 (0xb5a1 bytes) 2024-09-12T05:20:19.209 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.209 INFO:teuthology.orchestra.run.smithi059.stdout:576 read 0x8164ff0 thru 0x81741e5 (0xf1f6 bytes) 2024-09-12T05:20:19.234 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:19.238+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:19.243 INFO:teuthology.orchestra.run.smithi059.stdout:577 trunc from 0xe6ee14a to 0xc4d5de 2024-09-12T05:20:19.263 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:19.263 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:19.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:19.307 INFO:teuthology.orchestra.run.smithi059.stdout:578 write 0x959d9ae thru 0x95a91b0 (0xb803 bytes) 2024-09-12T05:20:19.316 INFO:teuthology.orchestra.run.smithi059.stdout:580 trunc from 0x95a91b1 to 0xab36c43 2024-09-12T05:20:19.325 INFO:teuthology.orchestra.run.smithi059.stdout:582 read 0x2f3c5d5 thru 0x2f42d67 (0x6793 bytes) 2024-09-12T05:20:19.335 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:19.333+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:19.348 INFO:teuthology.orchestra.run.smithi059.stdout:583 write 0xe786f39 thru 0xe78a74a (0x3812 bytes) 2024-09-12T05:20:19.354 INFO:teuthology.orchestra.run.smithi059.stdout:584 write 0x16cf981 thru 0x16d7354 (0x79d4 bytes) 2024-09-12T05:20:19.358 INFO:teuthology.orchestra.run.smithi059.stdout:585 punch from 0x3c0a8db to 0x3c13742, (0x8e67 bytes) 2024-09-12T05:20:19.358 INFO:teuthology.orchestra.run.smithi059.stdout:586 write 0xdc28452 thru 0xdc30723 (0x82d2 bytes) 2024-09-12T05:20:19.364 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.364 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:19.364 INFO:teuthology.orchestra.run.smithi059.stdout:589 clone 3 order 23 su 65536 sc 9 2024-09-12T05:20:19.404 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:19.404 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:19.418 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:19.461 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:19.461+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:19.537 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:19.537+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:19.600 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:19.641 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:19.641+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:19.740 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:19.742+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:19.763 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:19.763 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:19.777 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:19.840 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:19.842+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:19.906 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:19.907 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:19.922 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:19.942 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:19.942+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:20.039 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:20.039 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:20.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:20.041+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:20.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:20.143 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:20.141+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:20.161 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-12T05:20:20.220 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:20.220 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:20.221 INFO:teuthology.orchestra.run.smithi059.stdout:592 write 0xad14aa3 thru 0xad1db34 (0x9092 bytes) 2024-09-12T05:20:20.235 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:20.242 INFO:teuthology.orchestra.run.smithi059.stdout:593 punch from 0xe6a8896 to 0xe6a939f, (0xb09 bytes) 2024-09-12T05:20:20.242 INFO:teuthology.orchestra.run.smithi059.stdout:594 read 0x6d6f3c4 thru 0x6d706b7 (0x12f4 bytes) 2024-09-12T05:20:20.242 INFO:teuthology.orchestra.run.smithi059.stdout:595 write 0xd4bc442 thru 0xd4cad77 (0xe936 bytes) 2024-09-12T05:20:20.244 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:20.246+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:20.259 INFO:teuthology.orchestra.run.smithi059.stdout:597 writesame 0x56b9cf0 thru 0x56c6d06 data_size 0x9(0xd017 bytes) 2024-09-12T05:20:20.272 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:20.272 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:20.273 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-12T05:20:20.273 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T05:20:20.273 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T05:20:20.273 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-12T05:20:20.281 INFO:teuthology.orchestra.run.smithi059.stdout:598 read 0x1074695 thru 0x107ffa0 (0xb90c bytes) 2024-09-12T05:20:20.282 INFO:teuthology.orchestra.run.smithi059.stdout:599 write 0x851cfea thru 0x8521a3b (0x4a52 bytes) 2024-09-12T05:20:20.312 INFO:teuthology.orchestra.run.smithi059.stdout:600 trunc from 0xe78a74b to 0x947f9e7 2024-09-12T05:20:20.346 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:20.345+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:20.353 INFO:teuthology.orchestra.run.smithi059.stdout:601 write 0x1cc5365 thru 0x1cc6881 (0x151d bytes) 2024-09-12T05:20:20.372 INFO:teuthology.orchestra.run.smithi059.stdout:602 read 0x8a8f611 thru 0x8a980d5 (0x8ac5 bytes) 2024-09-12T05:20:20.373 INFO:teuthology.orchestra.run.smithi059.stdout:603 write 0x29aafd4 thru 0x29b8bbe (0xdbeb bytes) 2024-09-12T05:20:20.395 INFO:teuthology.orchestra.run.smithi059.stdout:604 writesame 0x515c799 thru 0x5161101 data_size 0x1(0x4969 bytes) 2024-09-12T05:20:20.408 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:20.408 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T05:20:20.408 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:20.410 INFO:teuthology.orchestra.run.smithi059.stdout:606 write 0x2c26713 thru 0x2c2b46e (0x4d5c bytes) 2024-09-12T05:20:20.421 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:20.421 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:20.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:20.447 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:20.450+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:20.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:20.548 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:20.550+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:20.594 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:20.594 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:20.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:20.632 INFO:teuthology.orchestra.run.smithi059.stdout:607 read 0x4dc6932 thru 0x4dccf3f (0x660e bytes) 2024-09-12T05:20:20.633 INFO:teuthology.orchestra.run.smithi059.stdout:608 clone 4 order 19 su 131072 sc 15 2024-09-12T05:20:20.638 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:20.648 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:20.650+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:20.655 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:20.655 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:20.673 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:20.688 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:20.689 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:20.709 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:20.710 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:20.729 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:20.729 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:20.730 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:20.731 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:20.743 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:20.751 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:20.751 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:20.772 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:20.773 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:20.788 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:20.789+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:20.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:20:20.876 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.996070323000001, 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.10902002500000001, 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878726+0000", 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878741+0000", 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4696e-05 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878767+0000", 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5812999999999998e-05 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878789+0000", 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.179e-05 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878868+0000", 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9116999999999995e-05 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878878+0000", 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8549999999999997e-06 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.984853+0000", 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.105974939 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985185+0000", 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000332827 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985604+0000", 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000418477 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.986868+0000", 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001264004 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987594+0000", 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072604400000000002 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987679+0000", 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4826000000000004e-05 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987744+0000", 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4716999999999997e-05 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.740495848999998, 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016500958999999999, 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 42 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134298+0000", 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134299+0000", 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134306+0000", 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9399999999999996e-06 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134317+0000", 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0837e-05 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134324+0000", 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.138682+0000", 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004357072 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.138911+0000", 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022904199999999999 2024-09-12T05:20:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.139320+0000", 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040928999999999998 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.143904+0000", 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045844750000000002 2024-09-12T05:20:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150511+0000", 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066061560000000002 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150667+0000", 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156062 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150799+0000", 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013236199999999999 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.740203595000001, 2024-09-12T05:20:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016623514999999998, 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 43 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134590+0000", 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134591+0000", 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.11e-06 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134599+0000", 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.627e-06 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134612+0000", 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3407000000000001e-05 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134622+0000", 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2e-06 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141025+0000", 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006403583 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141161+0000", 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135902 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141361+0000", 2024-09-12T05:20:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000199989 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.146593+0000", 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052320429999999996 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151014+0000", 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044212720000000004 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151108+0000", 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3676000000000002e-05 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151214+0000", 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010570599999999999 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.740048422000001, 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016792813, 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 44 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134745+0000", 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134746+0000", 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134828+0000", 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1456000000000001e-05 2024-09-12T05:20:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134841+0000", 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.312e-05 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134850+0000", 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7430000000000008e-06 2024-09-12T05:20:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.141992+0000", 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071420340000000002 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.142253+0000", 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026151199999999999 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.142632+0000", 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037914399999999999 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.148913+0000", 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062808880000000001 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151338+0000", 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024248749999999999 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151425+0000", 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6322000000000005e-05 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151538+0000", 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113656 2024-09-12T05:20:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.739812963999999, 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01686226, 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 45 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134981+0000", 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134982+0000", 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4130000000000001e-06 2024-09-12T05:20:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.134993+0000", 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023e-05 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135038+0000", 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5970000000000002e-05 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135049+0000", 2024-09-12T05:20:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0263e-05 2024-09-12T05:20:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144033+0000", 2024-09-12T05:20:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0089840030000000008 2024-09-12T05:20:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144177+0000", 2024-09-12T05:20:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014395900000000001 2024-09-12T05:20:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.144405+0000", 2024-09-12T05:20:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000228092 2024-09-12T05:20:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.148928+0000", 2024-09-12T05:20:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045228179999999996 2024-09-12T05:20:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151679+0000", 2024-09-12T05:20:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027509990000000001 2024-09-12T05:20:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151773+0000", 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4802999999999993e-05 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151843+0000", 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9709999999999995e-05 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.739723209000001, 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017063834999999999, 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 46 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135071+0000", 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135072+0000", 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0400000000000005e-07 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135079+0000", 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0129999999999996e-06 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135092+0000", 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3349999999999999e-05 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135100+0000", 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6569999999999997e-06 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145135+0000", 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010035572 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145383+0000", 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000247731 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.145742+0000", 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035916399999999998 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.150864+0000", 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051218569999999996 2024-09-12T05:20:20.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151961+0000", 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001096872 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152037+0000", 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5945999999999994e-05 2024-09-12T05:20:20.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152134+0000", 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7769000000000005e-05 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.919 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.739679825, 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018299068000000002, 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 47 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135114+0000", 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135115+0000", 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8599999999999997e-07 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135228+0000", 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112936 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135265+0000", 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7426999999999999e-05 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135280+0000", 2024-09-12T05:20:20.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4693e-05 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147037+0000", 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011756951 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147310+0000", 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027367800000000002 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.147689+0000", 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037831399999999998 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.151564+0000", 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038754779999999999 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153266+0000", 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017021600000000001 2024-09-12T05:20:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153350+0000", 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3829e-05 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153413+0000", 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2816000000000003e-05 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.739493490000001, 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018428901000000001, 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 48 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135300+0000", 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135301+0000", 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023e-06 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135308+0000", 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8499999999999996e-06 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135321+0000", 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3157e-05 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135329+0000", 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6860000000000006e-06 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149031+0000", 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013702147 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149176+0000", 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014521299999999999 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.149426+0000", 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024937100000000002 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152156+0000", 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027301320000000001 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153560+0000", 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001403856 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153662+0000", 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010180599999999999 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153729+0000", 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7659999999999999e-05 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.739450186999999, 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021491874000000001, 2024-09-12T05:20:20.932 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 49 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135344+0000", 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4000000000000001e-07 2024-09-12T05:20:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135351+0000", 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135361+0000", 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135368+0000", 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:20:20.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152252+0000", 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016884542999999998 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152387+0000", 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013445500000000001 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.152594+0000", 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020751600000000001 2024-09-12T05:20:20.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156614+0000", 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040193820000000002 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156659+0000", 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5498999999999999e-05 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156774+0000", 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011445199999999999 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156836+0000", 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1953999999999997e-05 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.739413170999999, 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022587169000000001, 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 50 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135381+0000", 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9400000000000005e-07 2024-09-12T05:20:20.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135461+0000", 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0111999999999995e-05 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135481+0000", 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9150000000000001e-05 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135496+0000", 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5486999999999999e-05 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.153835+0000", 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018339030999999999 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.154049+0000", 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000214119 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.154289+0000", 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023974099999999999 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157804+0000", 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035150989999999998 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157826+0000", 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1883e-05 2024-09-12T05:20:20.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157900+0000", 2024-09-12T05:20:20.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3780000000000002e-05 2024-09-12T05:20:20.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157968+0000", 2024-09-12T05:20:20.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8072999999999997e-05 2024-09-12T05:20:20.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.945 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.739267261999998, 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022671417999999999, 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 51 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135527+0000", 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135528+0000", 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3969999999999999e-06 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135540+0000", 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1737e-05 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135559+0000", 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9123e-05 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135573+0000", 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3719e-05 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155276+0000", 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019703064999999999 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155411+0000", 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013550199999999999 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.155623+0000", 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021140500000000001 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158032+0000", 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002409015 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158059+0000", 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7518999999999999e-05 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158139+0000", 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0286999999999999e-05 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158198+0000", 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8649e-05 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.739157356, 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023015342000000001, 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 52 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.952 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135636+0000", 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135638+0000", 2024-09-12T05:20:20.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5600000000000001e-06 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135651+0000", 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.326e-05 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135672+0000", 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0780000000000001e-05 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.135693+0000", 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1095999999999999e-05 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.156933+0000", 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021240146000000001 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157096+0000", 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016222900000000001 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.157301+0000", 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020542100000000001 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158464+0000", 2024-09-12T05:20:20.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001163054 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158500+0000", 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6157e-05 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158578+0000", 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7359000000000003e-05 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.158652+0000", 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.428e-05 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.486667946000001, 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013423977, 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.958 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 69 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388126+0000", 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388127+0000", 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0529999999999999e-06 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388230+0000", 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010274500000000001 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388246+0000", 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6742e-05 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388258+0000", 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1109e-05 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.391889+0000", 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036317430000000002 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.392026+0000", 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137045 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.392236+0000", 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020941199999999999 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395594+0000", 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033585199999999998 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401431+0000", 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058363579999999998 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401493+0000", 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2335999999999994e-05 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401550+0000", 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6913999999999998e-05 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.486513550000002, 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013386148, 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.964 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 70 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388280+0000", 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388281+0000", 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8400000000000002e-07 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388290+0000", 2024-09-12T05:20:20.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8659999999999995e-06 2024-09-12T05:20:20.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388306+0000", 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5430999999999998e-05 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388314+0000", 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5189999999999992e-06 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395647+0000", 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073332930000000003 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395758+0000", 2024-09-12T05:20:20.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011106400000000001 2024-09-12T05:20:20.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.395929+0000", 2024-09-12T05:20:20.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170349 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401409+0000", 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054803860000000003 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401561+0000", 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000151941 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401619+0000", 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8279000000000002e-05 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401666+0000", 2024-09-12T05:20:20.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7036000000000002e-05 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.486462263, 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013501121, 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 71 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388332+0000", 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.54e-07 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388339+0000", 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8850000000000001e-06 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388356+0000", 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6643e-05 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388364+0000", 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5529999999999993e-06 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396392+0000", 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.008027536 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396460+0000", 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8031e-05 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396563+0000", 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401677+0000", 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051139849999999997 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401753+0000", 2024-09-12T05:20:20.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5506999999999994e-05 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401797+0000", 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4532e-05 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401833+0000", 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5222999999999998e-05 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.978 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.486376436, 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013626012, 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 72 2024-09-12T05:20:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388417+0000", 2024-09-12T05:20:20.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388418+0000", 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2500000000000004e-07 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388492+0000", 2024-09-12T05:20:20.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3240999999999999e-05 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388503+0000", 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1878999999999999e-05 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388512+0000", 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8789999999999992e-06 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.396954+0000", 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0084420309999999991 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.397049+0000", 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4588999999999998e-05 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.397215+0000", 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016635599999999999 2024-09-12T05:20:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401915+0000", 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046998910000000003 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401933+0000", 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7844000000000001e-05 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.401991+0000", 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7742999999999999e-05 2024-09-12T05:20:20.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402043+0000", 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2633999999999998e-05 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.486259114999999, 2024-09-12T05:20:20.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016972929000000001, 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 73 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388535+0000", 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388536+0000", 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7000000000000003e-07 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388544+0000", 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8859999999999993e-06 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388556+0000", 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1289e-05 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388564+0000", 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400688+0000", 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012124731 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400781+0000", 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2958e-05 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.400934+0000", 2024-09-12T05:20:20.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015275600000000001 2024-09-12T05:20:20.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403647+0000", 2024-09-12T05:20:20.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027130800000000001 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405434+0000", 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017866889999999999 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405473+0000", 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8723000000000002e-05 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405508+0000", 2024-09-12T05:20:20.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4984000000000003e-05 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.486209231, 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017101682999999999, 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 74 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:20.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388585+0000", 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388593+0000", 2024-09-12T05:20:20.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3270000000000003e-06 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388603+0000", 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9159999999999996e-06 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388610+0000", 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1679999999999998e-06 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:20.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402091+0000", 2024-09-12T05:20:20.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013480779 2024-09-12T05:20:20.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:20.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402157+0000", 2024-09-12T05:20:20.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6842999999999997e-05 2024-09-12T05:20:20.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402265+0000", 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010712700000000001 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403660+0000", 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001395213 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405565+0000", 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001905166 2024-09-12T05:20:20.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:20.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405635+0000", 2024-09-12T05:20:20.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9840999999999998e-05 2024-09-12T05:20:20.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:20.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.405686+0000", 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1499000000000003e-05 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.486163055999999, 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017927399, 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:20.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 75 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:21.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388631+0000", 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388632+0000", 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9299999999999997e-07 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388719+0000", 2024-09-12T05:20:21.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7251999999999997e-05 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388733+0000", 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3900000000000001e-05 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388752+0000", 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9519999999999999e-05 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402653+0000", 2024-09-12T05:20:21.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013900538 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402765+0000", 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011212199999999999 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.402936+0000", 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017109699999999999 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.404269+0000", 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013328400000000001 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406480+0000", 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022108700000000002 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406519+0000", 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9730000000000001e-05 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.406558+0000", 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8736999999999999e-05 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:21.005 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.486021839999999, 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018396794000000001, 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:21.006 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 76 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388772+0000", 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388773+0000", 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6199999999999996e-07 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:21.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388780+0000", 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3170000000000004e-06 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388791+0000", 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417e-05 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.388809+0000", 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8377999999999999e-05 2024-09-12T05:20:21.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:21.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403692+0000", 2024-09-12T05:20:21.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014883234 2024-09-12T05:20:21.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:21.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403762+0000", 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0088999999999999e-05 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.403867+0000", 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104627 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.404656+0000", 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00078953200000000002 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407056+0000", 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002399502 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:21.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407119+0000", 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3186000000000001e-05 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:55.407169+0000", 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9650000000000001e-05 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:21.013 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:21.014 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:20.882+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:21.015 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone3 from 0x947f9e7 (overlap 0x947f9e7) to 0x0 2024-09-12T05:20:21.016 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:21.013+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:21.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:21.056 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-12T05:20:21.116 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:21.118+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:21.139 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:21.139 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:21.139 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:21.140 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:21.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:21.247 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:21.250+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:21.318 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:21.318+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:21.327 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:21.328 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:21.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:21.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:21.417+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:21.450 INFO:teuthology.orchestra.run.smithi059.stdout:610 writesame 0x4b9c4a9 thru 0x4ba9f88 data_size 0x88(0xdae0 bytes) 2024-09-12T05:20:21.475 INFO:teuthology.orchestra.run.smithi059.stdout:611 trunc from 0x947f9e7 to 0x52dba18 2024-09-12T05:20:21.519 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:21.517+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:21.527 INFO:teuthology.orchestra.run.smithi059.stdout:612 write 0xcc05170 thru 0xcc1258b (0xd41c bytes) 2024-09-12T05:20:21.530 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1044 3.1 3:82897231:::rbd_object_map.1118feb697f7:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.512145+0000", 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.0214171839999997, 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010806621000000001, 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.531 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1044 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512145+0000", 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512145+0000", 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512146+0000", 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6599999999999995e-07 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512150+0000", 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1919999999999998e-06 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512159+0000", 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0119999999999994e-06 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512166+0000", 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9160000000000004e-06 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.517697+0000", 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055310170000000001 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.517784+0000", 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7051000000000004e-05 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.518098+0000", 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031354400000000002 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.519156+0000", 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001058184 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.522827+0000", 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036711529999999999 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.522898+0000", 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1351000000000002e-05 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.522952+0000", 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3434999999999999e-05 2024-09-12T05:20:21.536 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1045 3.1 3:82897231:::rbd_object_map.1118feb697f7:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.512177+0000", 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.021385124, 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010953968999999999, 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1045 2024-09-12T05:20:21.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512177+0000", 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512177+0000", 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512178+0000", 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512181+0000", 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5769999999999998e-06 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512190+0000", 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.524e-06 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512196+0000", 2024-09-12T05:20:21.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5889999999999999e-06 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.518406+0000", 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062099809999999998 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.518461+0000", 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4790000000000002e-05 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.518677+0000", 2024-09-12T05:20:21.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021611699999999999 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.520507+0000", 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001829364 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523027+0000", 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025204289999999998 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523087+0000", 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9947000000000001e-05 2024-09-12T05:20:21.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523131+0000", 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4085000000000002e-05 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1046 3.1 3:82897231:::rbd_object_map.1118feb697f7:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.512206+0000", 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.0213561450000004, 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011114188000000001, 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.542 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1046 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512206+0000", 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512206+0000", 2024-09-12T05:20:21.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512207+0000", 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5700000000000002e-07 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512210+0000", 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3780000000000001e-06 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512219+0000", 2024-09-12T05:20:21.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5629999999999992e-06 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512225+0000", 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3960000000000003e-06 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.519201+0000", 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0069755160000000002 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.519298+0000", 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7349000000000006e-05 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.519733+0000", 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043519000000000001 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.521265+0000", 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015322650000000001 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:21.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523198+0000", 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019322549999999999 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523272+0000", 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4884999999999999e-05 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523320+0000", 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7834000000000003e-05 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.547 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3678 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.946383+0000", 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58717880600000005, 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0099991469999999999, 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.548 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3678 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946383+0000", 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946383+0000", 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946384+0000", 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4799999999999999e-07 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946386+0000", 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2800000000000002e-06 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946419+0000", 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2842000000000002e-05 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946426+0000", 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5629999999999997e-06 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.956036+0000", 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0096107769999999992 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.956195+0000", 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015819299999999999 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.956383+0000", 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188044 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3679 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 2621440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.946441+0000", 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.587121424, 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010361789999999999, 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3679 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946441+0000", 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946441+0000", 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946441+0000", 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999995e-07 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946444+0000", 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7580000000000001e-06 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946459+0000", 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4763000000000001e-05 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946579+0000", 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011997000000000001 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.956451+0000", 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0098716659999999994 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.956615+0000", 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000164007 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.956803+0000", 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018810100000000001 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3680 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.946596+0000", 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58696663900000001, 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010615968, 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.556 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3680 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946596+0000", 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946596+0000", 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946596+0000", 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4300000000000002e-07 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946600+0000", 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9160000000000003e-06 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946610+0000", 2024-09-12T05:20:21.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9890000000000004e-06 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946631+0000", 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0701999999999999e-05 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.956867+0000", 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010236357999999999 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.957026+0000", 2024-09-12T05:20:21.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015819299999999999 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.957212+0000", 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018606699999999999 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3687 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950056+0000", 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58350635200000001, 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017577545, 2024-09-12T05:20:21.560 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3687 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950056+0000", 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950056+0000", 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950056+0000", 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.46e-07 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950107+0000", 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0359999999999999e-05 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950118+0000", 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1042e-05 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950124+0000", 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6239999999999996e-06 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.959145+0000", 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090206279999999993 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.964550+0000", 2024-09-12T05:20:21.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054046570000000002 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967633+0000", 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030837880000000001 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3796 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950521+0000", 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58304129299999996, 2024-09-12T05:20:21.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014658548, 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3796 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950521+0000", 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950521+0000", 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950521+0000", 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6400000000000003e-07 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950524+0000", 2024-09-12T05:20:21.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3530000000000002e-06 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950531+0000", 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0140000000000001e-06 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950536+0000", 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1320000000000002e-06 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.964800+0000", 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014263937000000001 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.964975+0000", 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017517699999999999 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965180+0000", 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020447099999999999 2024-09-12T05:20:21.568 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3797 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 589824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950544+0000", 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58301786200000005, 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015040021000000001, 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.569 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3797 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950544+0000", 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950544+0000", 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950545+0000", 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8999999999999997e-07 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950547+0000", 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.204e-06 2024-09-12T05:20:21.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950553+0000", 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.28e-06 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950558+0000", 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8960000000000002e-06 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965238+0000", 2024-09-12T05:20:21.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014679721999999999 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965385+0000", 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014657099999999999 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965584+0000", 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000199858 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3798 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950570+0000", 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58299273600000001, 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015435432000000001, 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3798 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950570+0000", 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950570+0000", 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950570+0000", 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950572+0000", 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2680000000000001e-06 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950579+0000", 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5220000000000004e-06 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950607+0000", 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8204e-05 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965642+0000", 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015034657 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965798+0000", 2024-09-12T05:20:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015634500000000001 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966005+0000", 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020698400000000001 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3799 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950621+0000", 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58294114299999999, 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015797868999999999, 2024-09-12T05:20:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3799 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950621+0000", 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950621+0000", 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950622+0000", 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8699999999999995e-07 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950625+0000", 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9620000000000002e-06 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950634+0000", 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4490000000000005e-06 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950640+0000", 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3799999999999999e-06 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966059+0000", 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015418316 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966221+0000", 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016191 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966419+0000", 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019836499999999999 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3800 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950649+0000", 2024-09-12T05:20:21.582 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58291323500000003, 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016124408999999999, 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3800 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950649+0000", 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950649+0000", 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950649+0000", 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4799999999999999e-07 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950652+0000", 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2840000000000001e-06 2024-09-12T05:20:21.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950658+0000", 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.72e-06 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950664+0000", 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0649999999999998e-06 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966475+0000", 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015811064999999999 2024-09-12T05:20:21.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966610+0000", 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000135597 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966773+0000", 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016322999999999999 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.586 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3801 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950675+0000", 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58288722699999995, 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016417843000000001, 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.587 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3801 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950675+0000", 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950675+0000", 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950675+0000", 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950678+0000", 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7889999999999999e-06 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950686+0000", 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4919999999999996e-06 2024-09-12T05:20:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950691+0000", 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5060000000000003e-06 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966822+0000", 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016130664999999999 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966948+0000", 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012579299999999999 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967093+0000", 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014515900000000001 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3802 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950699+0000", 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58286320800000002, 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016719632000000002, 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.591 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3802 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950699+0000", 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950699+0000", 2024-09-12T05:20:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950699+0000", 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1800000000000001e-07 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950701+0000", 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0169999999999999e-06 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950712+0000", 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0804e-05 2024-09-12T05:20:21.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950718+0000", 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4369999999999998e-06 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967135+0000", 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016417669999999999 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967265+0000", 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000129407 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967419+0000", 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015387899999999999 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3803 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 3735552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950726+0000", 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58283605400000005, 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016995499000000001, 2024-09-12T05:20:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3803 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950726+0000", 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950726+0000", 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950727+0000", 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8500000000000002e-07 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950729+0000", 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.305e-06 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950735+0000", 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.19e-06 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950742+0000", 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4370000000000004e-06 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967462+0000", 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016720499999999999 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967579+0000", 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116407 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967722+0000", 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000143175 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3804 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.953402+0000", 2024-09-12T05:20:21.599 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58016067000000004, 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017858619999999999, 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3804 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953402+0000", 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953402+0000", 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953402+0000", 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2900000000000002e-07 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953410+0000", 2024-09-12T05:20:21.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2439999999999996e-06 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953420+0000", 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0345e-05 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953427+0000", 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3470000000000001e-06 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967857+0000", 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014429365 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967979+0000", 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012214699999999999 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.971260+0000", 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032813429999999999 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3805 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.953439+0000", 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58012369100000005, 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015072868, 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3805 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953439+0000", 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953439+0000", 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953439+0000", 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8699999999999995e-07 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953443+0000", 2024-09-12T05:20:21.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4070000000000002e-06 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953450+0000", 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4919999999999996e-06 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953456+0000", 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7379999999999999e-06 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968240+0000", 2024-09-12T05:20:21.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014783848 2024-09-12T05:20:21.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968358+0000", 2024-09-12T05:20:21.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118371 2024-09-12T05:20:21.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968511+0000", 2024-09-12T05:20:21.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000153425 2024-09-12T05:20:21.609 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.609 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3806 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 5308416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.953465+0000", 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58009751600000004, 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015342853, 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.611 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.611 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3806 2024-09-12T05:20:21.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.611 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953465+0000", 2024-09-12T05:20:21.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953465+0000", 2024-09-12T05:20:21.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953465+0000", 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953473+0000", 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3699999999999997e-06 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953480+0000", 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8159999999999994e-06 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953486+0000", 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4310000000000002e-06 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968555+0000", 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015069333000000001 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968670+0000", 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114795 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968808+0000", 2024-09-12T05:20:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013757900000000001 2024-09-12T05:20:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.617 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3807 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.617 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.953494+0000", 2024-09-12T05:20:21.617 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58006786099999996, 2024-09-12T05:20:21.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015608149, 2024-09-12T05:20:21.617 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3807 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953494+0000", 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953494+0000", 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953495+0000", 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3900000000000005e-07 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953497+0000", 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2199999999999999e-06 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953504+0000", 2024-09-12T05:20:21.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0899999999999999e-06 2024-09-12T05:20:21.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953509+0000", 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.113e-06 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968850+0000", 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015340885 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968965+0000", 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114392 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969103+0000", 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013791000000000001 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.622 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3941 3.6 3:67a3fa36:::rbd_data.1118a362a851.0000000000000002:head [delete] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.980614+0000", 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.55294823100000001, 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0105237, 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3941 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.623 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980614+0000", 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980614+0000", 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:21.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980615+0000", 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.92e-07 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980619+0000", 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4819999999999996e-06 2024-09-12T05:20:21.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980630+0000", 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.112e-05 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980639+0000", 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4500000000000004e-06 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:21.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.982496+0000", 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001857425 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.982569+0000", 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3112000000000001e-05 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.982746+0000", 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017691300000000001 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:21.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986798+0000", 2024-09-12T05:20:21.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040520790000000001 2024-09-12T05:20:21.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:21.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.991037+0000", 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004238393 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.991092+0000", 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5247999999999997e-05 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.991138+0000", 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5686000000000003e-05 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.629 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.630 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.630 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:21.630 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:21.630 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:21.631 INFO:teuthology.orchestra.run.smithi059.stdout:613 punch from 0x46abd12 to 0x46b56c2, (0x99b0 bytes) 2024-09-12T05:20:21.631 INFO:teuthology.orchestra.run.smithi059.stdout:617 read 0x1757c10 thru 0x1763072 (0xb463 bytes) 2024-09-12T05:20:21.631 INFO:teuthology.orchestra.run.smithi059.stdout:618 punch from 0x123fc85 to 0x1244b69, (0x4ee4 bytes) 2024-09-12T05:20:21.631 INFO:teuthology.orchestra.run.smithi059.stdout:620 write 0x41c44a9 thru 0x41d09ef (0xc547 bytes) 2024-09-12T05:20:21.631 INFO:teuthology.orchestra.run.smithi059.stdout:621 trunc from 0xcc1258c to 0xcd5068f 2024-09-12T05:20:21.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:21.633 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:21.633 INFO:teuthology.orchestra.run.smithi059.stdout:623 punch from 0xc71ec87 to 0xc72c9a7, (0xdd20 bytes) 2024-09-12T05:20:21.633 INFO:teuthology.orchestra.run.smithi059.stdout:624 writesame 0xa7de048 thru 0xa7e92f5 data_size 0x1(0xb2ae bytes) 2024-09-12T05:20:21.634 INFO:teuthology.orchestra.run.smithi059.stdout:625 trunc from 0xcd5068f to 0x78455af 2024-09-12T05:20:21.634 INFO:teuthology.orchestra.run.smithi059.stdout:627 read 0x728f3be thru 0x729dad5 (0xe718 bytes) 2024-09-12T05:20:21.634 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:21.634 INFO:teuthology.orchestra.run.smithi059.stdout:629 write 0x1294561 thru 0x1296145 (0x1be5 bytes) 2024-09-12T05:20:21.634 INFO:teuthology.orchestra.run.smithi059.stdout:630 writesame 0x2ed5fb1 thru 0x2ee1271 data_size 0x1(0xb2c1 bytes) 2024-09-12T05:20:21.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:21.629+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:21.706 INFO:teuthology.orchestra.run.smithi059.stdout:631 trunc from 0x78455af to 0xd4a3ce4 2024-09-12T05:20:21.731 INFO:teuthology.orchestra.run.smithi059.stdout:632 trunc from 0xd4a3ce4 to 0x5f3d13f 2024-09-12T05:20:21.731 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:21.734+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:21.744 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:21.744 INFO:teuthology.orchestra.run.smithi059.stdout:636 write 0x51390d9 thru 0x514590c (0xc834 bytes) 2024-09-12T05:20:21.749 INFO:teuthology.orchestra.run.smithi059.stdout:637 read 0x4d35f0e thru 0x4d45b04 (0xfbf7 bytes) 2024-09-12T05:20:21.754 INFO:teuthology.orchestra.run.smithi059.stdout:638 trunc from 0x5f3d13f to 0x815a679 2024-09-12T05:20:21.768 INFO:teuthology.orchestra.run.smithi059.stdout:639 read 0x57b8390 thru 0x57c2e71 (0xaae2 bytes) 2024-09-12T05:20:21.782 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:21.782 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:21.782 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:21.782 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:21.792 INFO:teuthology.orchestra.run.smithi059.stdout:640 writesame 0xccd50f3 thru 0xccdc4c6 data_size 0x2a(0x73d4 bytes) 2024-09-12T05:20:21.792 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:21.792 INFO:teuthology.orchestra.run.smithi059.stdout:642 punch from 0x24182ab to 0x241d85f, (0x55b4 bytes) 2024-09-12T05:20:21.792 INFO:teuthology.orchestra.run.smithi059.stdout:643 write 0x39bda73 thru 0x39c5db5 (0x8343 bytes) 2024-09-12T05:20:21.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:21.803 INFO:teuthology.orchestra.run.smithi059.stdout:647 write 0x6dcf838 thru 0x6dde6c8 (0xee91 bytes) 2024-09-12T05:20:21.808 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:20:21.811 INFO:teuthology.orchestra.run.smithi059.stdout:648 read 0x84c8da7 thru 0x84ca1b1 (0x140b bytes) 2024-09-12T05:20:21.811 INFO:teuthology.orchestra.run.smithi059.stdout:652 punch from 0xbaf97f7 to 0xbafd514, (0x3d1d bytes) 2024-09-12T05:20:21.812 INFO:teuthology.orchestra.run.smithi059.stdout:654 write 0x5188e5c thru 0x518c578 (0x371d bytes) 2024-09-12T05:20:21.830 INFO:teuthology.orchestra.run.smithi059.stdout:655 punch from 0x3edc5f6 to 0x3ee09e5, (0x43ef bytes) 2024-09-12T05:20:21.830 INFO:teuthology.orchestra.run.smithi059.stdout:657 write 0x6e88566 thru 0x6e92fea (0xaa85 bytes) 2024-09-12T05:20:21.832 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:21.834+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:21.841 INFO:teuthology.orchestra.run.smithi059.stdout:659 writesame 0x2eaf427 thru 0x2ebeb01 data_size 0x3(0xf6db bytes) 2024-09-12T05:20:21.875 INFO:teuthology.orchestra.run.smithi059.stdout:661 trunc from 0xccdc4c7 to 0x2e86ec0 2024-09-12T05:20:21.934 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:21.934+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:21.937 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:21.937 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:21.943 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:21.954 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:21.960 INFO:teuthology.orchestra.run.smithi059.stdout:663 write 0x647be62 thru 0x648616d (0xa30c bytes) 2024-09-12T05:20:21.986 INFO:teuthology.orchestra.run.smithi059.stdout:664 write 0x99ba148 thru 0x99c204e (0x7f07 bytes) 2024-09-12T05:20:21.995 INFO:teuthology.orchestra.run.smithi059.stdout:666 read 0x206cef1 thru 0x2073e13 (0x6f23 bytes) 2024-09-12T05:20:21.999 INFO:teuthology.orchestra.run.smithi059.stdout:668 trunc from 0x99c204f to 0x6da878d 2024-09-12T05:20:22.025 INFO:teuthology.orchestra.run.smithi059.stdout:670 read 0x516340b thru 0x5173144 (0xfd3a bytes) 2024-09-12T05:20:22.025 INFO:teuthology.orchestra.run.smithi059.stdout:672 writesame 0x44b3d5c thru 0x44bce08 data_size 0x5b(0x90ad bytes) 2024-09-12T05:20:22.032 INFO:teuthology.orchestra.run.smithi059.stdout:673 read 0x35eef8a thru 0x35ef5b8 (0x62f bytes) 2024-09-12T05:20:22.032 INFO:teuthology.orchestra.run.smithi059.stdout:675 write 0x6a4ba30 thru 0x6a55f12 (0xa4e3 bytes) 2024-09-12T05:20:22.034 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:22.034+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:22.064 INFO:teuthology.orchestra.run.smithi059.stdout:677 write 0xee17013 thru 0xee1f380 (0x836e bytes) 2024-09-12T05:20:22.071 INFO:teuthology.orchestra.run.smithi059.stdout:678 read 0xc1590b7 thru 0xc164863 (0xb7ad bytes) 2024-09-12T05:20:22.071 INFO:teuthology.orchestra.run.smithi059.stdout:679 punch from 0x62f6c3a to 0x62fdf86, (0x734c bytes) 2024-09-12T05:20:22.071 INFO:teuthology.orchestra.run.smithi059.stdout:680 writesame 0xc4bce4e thru 0xc4c9fea data_size 0x1f(0xd19d bytes) 2024-09-12T05:20:22.081 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:22.081 INFO:teuthology.orchestra.run.smithi059.stdout:685 punch from 0x51d2168 to 0x51de6e7, (0xc57f bytes) 2024-09-12T05:20:22.081 INFO:teuthology.orchestra.run.smithi059.stdout:686 writesame 0xed3d3ca thru 0xed44dc5 data_size 0x4(0x79fc bytes) 2024-09-12T05:20:22.096 INFO:teuthology.orchestra.run.smithi059.stdout:687 read 0x9f98b73 thru 0x9f9a495 (0x1923 bytes) 2024-09-12T05:20:22.096 INFO:teuthology.orchestra.run.smithi059.stdout:688 write 0xcb61844 thru 0xcb6e5fe (0xcdbb bytes) 2024-09-12T05:20:22.100 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:22.100 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:22.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:22.100 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:22.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.100 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3779 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.100 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1311747139999999, 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015428234000000001, 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3779 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969069+0000", 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:20:22.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969078+0000", 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2229999999999996e-06 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969089+0000", 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0536999999999999e-05 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969097+0000", 2024-09-12T05:20:22.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7780000000000007e-06 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984386+0000", 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01528902 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984436+0000", 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0577e-05 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984497+0000", 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0386000000000001e-05 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3780 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1311302160000001, 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015612325, 2024-09-12T05:20:22.105 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3780 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969114+0000", 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8899999999999999e-07 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969117+0000", 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2090000000000001e-06 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969127+0000", 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0315e-05 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969135+0000", 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599999999999998e-06 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984543+0000", 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015407403 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984617+0000", 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4270999999999994e-05 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984725+0000", 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108278 2024-09-12T05:20:22.109 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3781 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1310962769999999, 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792308999999998, 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3781 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969148+0000", 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8700000000000005e-07 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969151+0000", 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0120000000000001e-06 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969161+0000", 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0181e-05 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969179+0000", 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8057999999999999e-05 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985705+0000", 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016525623 2024-09-12T05:20:22.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985800+0000", 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5298999999999997e-05 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985939+0000", 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013934900000000001 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3782 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5046272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.131051671, 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016995278999999999, 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3782 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.115 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:22.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1399999999999996e-07 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969196+0000", 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4350000000000001e-06 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969206+0000", 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0593e-05 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969214+0000", 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6380000000000004e-06 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985979+0000", 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016764658000000002 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986091+0000", 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112662 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986187+0000", 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5579000000000001e-05 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3783 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1310179410000001, 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017209842, 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3783 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969226+0000", 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969229+0000", 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.585e-06 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969265+0000", 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5884999999999999e-05 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969274+0000", 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6070000000000008e-06 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986237+0000", 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016962755999999999 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986323+0000", 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5902000000000005e-05 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986435+0000", 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011246700000000001 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3866 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1307593680000001, 2024-09-12T05:20:22.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017196439000000001, 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3866 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:22.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0699999999999997e-07 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969488+0000", 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1e-06 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969498+0000", 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0468e-05 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969505+0000", 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.452e-06 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986467+0000", 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016961092000000001 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986563+0000", 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6010999999999999e-05 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986680+0000", 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011770899999999999 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3867 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.130725148, 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017352149000000001, 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.128 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3867 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969519+0000", 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6700000000000003e-07 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969522+0000", 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.123e-06 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969532+0000", 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0112000000000001e-05 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969540+0000", 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986711+0000", 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017171285000000001 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986781+0000", 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0072000000000003e-05 2024-09-12T05:20:22.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986870+0000", 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3868 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.130691465, 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017560494999999999, 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.132 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3868 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969553+0000", 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4200000000000005e-07 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969556+0000", 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9730000000000002e-06 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969566+0000", 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0387999999999999e-05 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969585+0000", 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8604e-05 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986945+0000", 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017360197000000001 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987016+0000", 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1130000000000005e-05 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987112+0000", 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6360999999999994e-05 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3869 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.136 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.130645487, 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017730589000000001, 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3869 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:22.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969608+0000", 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4490000000000005e-06 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969619+0000", 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0781999999999999e-05 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969636+0000", 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7218e-05 2024-09-12T05:20:22.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987143+0000", 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017506799 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987247+0000", 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010446900000000001 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987328+0000", 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1100999999999995e-05 2024-09-12T05:20:22.140 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3870 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.130594686, 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017855591000000001, 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.141 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3870 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5499999999999998e-07 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969653+0000", 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5499999999999999e-06 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969663+0000", 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.005e-05 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969670+0000", 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.43e-06 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987362+0000", 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017691521000000002 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987426+0000", 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4204999999999999e-05 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987504+0000", 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.818e-05 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3871 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1305632130000001, 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018082318, 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.145 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3871 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:22.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969681+0000", 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969683+0000", 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6350000000000002e-06 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969693+0000", 2024-09-12T05:20:22.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4169999999999998e-06 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969700+0000", 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1350000000000003e-06 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987538+0000", 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017838166999999999 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987609+0000", 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1316999999999995e-05 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987762+0000", 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015310200000000001 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3872 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7995392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:22.149 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1305336749999999, 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018277057999999999, 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3872 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:22.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000002e-07 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969713+0000", 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5830000000000001e-06 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969722+0000", 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2240000000000001e-06 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969752+0000", 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0142e-05 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987828+0000", 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018076297000000002 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987901+0000", 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2767000000000003e-05 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987987+0000", 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5474000000000002e-05 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.153 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3883 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6291456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1304162019999999, 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018349118000000001, 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3883 2024-09-12T05:20:22.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969828+0000", 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7800000000000001e-07 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969839+0000", 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1779e-05 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969851+0000", 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1573000000000001e-05 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969859+0000", 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8320000000000006e-06 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988018+0000", 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018158819999999999 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988085+0000", 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7366000000000005e-05 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988176+0000", 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1169999999999996e-05 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3884 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7012352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1303719910000001, 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018487955, 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.158 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3884 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969872+0000", 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2500000000000005e-07 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969875+0000", 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3950000000000001e-06 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969885+0000", 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9399999999999997e-06 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969893+0000", 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4930000000000001e-06 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988206+0000", 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018312910000000002 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988276+0000", 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0198999999999997e-05 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988359+0000", 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3293000000000004e-05 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.162 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3885 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1303385379999999, 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019004607999999999, 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3885 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:22.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7400000000000003e-07 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969908+0000", 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0529999999999998e-06 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969918+0000", 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.009e-05 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969939+0000", 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0797000000000001e-05 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988391+0000", 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018452177 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988462+0000", 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0154999999999995e-05 2024-09-12T05:20:22.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988909+0000", 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00044776199999999999 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3886 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7864320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.130290421, 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019129604000000001, 2024-09-12T05:20:22.167 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3886 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969954+0000", 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8800000000000001e-07 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969958+0000", 2024-09-12T05:20:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.89e-06 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969971+0000", 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.376e-05 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969979+0000", 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0420000000000003e-06 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988959+0000", 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018980011000000001 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989027+0000", 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7439000000000003e-05 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989082+0000", 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5574e-05 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.171 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3887 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1302508520000001, 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019321270000000001, 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.172 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3887 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969993+0000", 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969996+0000", 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1870000000000001e-06 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970007+0000", 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0676000000000001e-05 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970016+0000", 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5019999999999998e-06 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989125+0000", 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019108750000000001 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989201+0000", 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5852999999999994e-05 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989314+0000", 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112685 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3888 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.176 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1302028040000001, 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019523841, 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3888 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970041+0000", 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-07 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970045+0000", 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5719999999999999e-06 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970056+0000", 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1107999999999999e-05 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970064+0000", 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0239999999999997e-06 2024-09-12T05:20:22.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989388+0000", 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019324108 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989469+0000", 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0958000000000007e-05 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989564+0000", 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5422999999999998e-05 2024-09-12T05:20:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3889 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.130168319, 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019700655000000001, 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.181 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3889 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970076+0000", 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6300000000000004e-07 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970087+0000", 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1449e-05 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970098+0000", 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.042e-05 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970106+0000", 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9209999999999992e-06 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989608+0000", 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019502562000000001 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989680+0000", 2024-09-12T05:20:22.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1762999999999997e-05 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989776+0000", 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5676999999999999e-05 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3890 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:22.185 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.13012512, 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019853272000000002, 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3890 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:22.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970119+0000", 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2900000000000003e-07 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970122+0000", 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7420000000000002e-06 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970131+0000", 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7909999999999999e-06 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970138+0000", 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8090000000000004e-06 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989808+0000", 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019669641000000002 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989880+0000", 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2606000000000002e-05 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989971+0000", 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0953999999999997e-05 2024-09-12T05:20:22.189 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.190 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.190 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.190 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:22.191 INFO:teuthology.orchestra.run.smithi059.stdout:689 writesame 0xcb69cc8 thru 0xcb79165 data_size 0x62(0xf49e bytes) 2024-09-12T05:20:22.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:690 writesame 0x377fbb7 thru 0x378c01e data_size 0x3c(0xc468 bytes) 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:692 write 0xc0c744f thru 0xc0c9ff3 (0x2ba5 bytes) 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:693 writesame 0x3befa86 thru 0x3bf76fa data_size 0x1(0x7c75 bytes) 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:695 write 0x8529020 thru 0x85362f8 (0xd2d9 bytes) 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:697 read 0x5967888 thru 0x596fc9a (0x8413 bytes) 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:698 read 0xaba23ef thru 0xaba8113 (0x5d25 bytes) 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:700 read 0xaa4ad6d thru 0xaa53616 (0x88aa bytes) 2024-09-12T05:20:22.193 INFO:teuthology.orchestra.run.smithi059.stdout:702 write 0x27d39c0 thru 0x27d4011 (0x652 bytes) 2024-09-12T05:20:22.194 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:22.194+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:22.194 INFO:teuthology.orchestra.run.smithi059.stdout:703 writesame 0x70d25e3 thru 0x70e025a data_size 0x14(0xdc78 bytes) 2024-09-12T05:20:22.230 INFO:teuthology.orchestra.run.smithi059.stdout:704 trunc from 0xee1f381 to 0x4da5f06 2024-09-12T05:20:22.292 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:22.293+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:22.296 INFO:teuthology.orchestra.run.smithi059.stdout:705 writesame 0xde20e72 thru 0xde30249 data_size 0xcc(0xf3d8 bytes) 2024-09-12T05:20:22.296 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:22.296 INFO:teuthology.orchestra.run.smithi059.stdout:707 read 0xba7c481 thru 0xba8771a (0xb29a bytes) 2024-09-12T05:20:22.296 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:22.296 INFO:teuthology.orchestra.run.smithi059.stdout:709 writesame 0x4e5dd00 thru 0x4e6a7d1 data_size 0xd(0xcad2 bytes) 2024-09-12T05:20:22.307 INFO:teuthology.orchestra.run.smithi059.stdout:711 read 0xf5b99b thru 0xf66e22 (0xb488 bytes) 2024-09-12T05:20:22.308 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:22.308 INFO:teuthology.orchestra.run.smithi059.stdout:715 write 0xc133a8d thru 0xc13e271 (0xa7e5 bytes) 2024-09-12T05:20:22.316 INFO:teuthology.orchestra.run.smithi059.stdout:716 read 0xb6a5c6c thru 0xb6a6ae8 (0xe7d bytes) 2024-09-12T05:20:22.316 INFO:teuthology.orchestra.run.smithi059.stdout:717 read 0xae02f2d thru 0xae050cf (0x21a3 bytes) 2024-09-12T05:20:22.316 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:22.316 INFO:teuthology.orchestra.run.smithi059.stdout:721 read 0x9d94dcc thru 0x9d9bfd2 (0x7207 bytes) 2024-09-12T05:20:22.317 INFO:teuthology.orchestra.run.smithi059.stdout:722 write 0x813b9db thru 0x81459bb (0x9fe1 bytes) 2024-09-12T05:20:22.325 INFO:teuthology.orchestra.run.smithi059.stdout:724 writesame 0x5216f48 thru 0x5219f0a data_size 0x1(0x2fc3 bytes) 2024-09-12T05:20:22.327 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:22.327 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:22.327 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:22.327 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:22.340 INFO:teuthology.orchestra.run.smithi059.stdout:725 punch from 0x2d6a6e1 to 0x2d6e56e, (0x3e8d bytes) 2024-09-12T05:20:22.340 INFO:teuthology.orchestra.run.smithi059.stdout:727 clone 5 order 25 su 16777216 sc 7 2024-09-12T05:20:22.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:22.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:22.393+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:22.495 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:22.494+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:22.511 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:22.511 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:22.511 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:22.511 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:22.511 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:22.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:22.596 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:22.593+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4266.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.768465018000001, 2024-09-12T05:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045733270000000003, 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:22.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922956+0000", 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922970+0000", 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3633e-05 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922991+0000", 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1449000000000001e-05 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923009+0000", 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7929999999999999e-05 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923095+0000", 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6026000000000006e-05 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923129+0000", 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4545000000000002e-05 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.927399+0000", 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042699849999999996 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.927529+0000", 2024-09-12T05:20:22.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012922899999999999 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:858 3.4 e30/23 3:20597007:::rbd_data.1118bd2b1382.0000000000000040:head v 30'9, mlcod=28'7)", 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.934168+0000", 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.7572520599999999, 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001514615, 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934168+0000", 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934168+0000", 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934169+0000", 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3799999999999996e-07 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934179+0000", 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3910000000000004e-06 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934196+0000", 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7014999999999999e-05 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934203+0000", 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7400000000000004e-06 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934273+0000", 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0081999999999997e-05 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.934302+0000", 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8421000000000001e-05 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.935625+0000", 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013230640000000001 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.935683+0000", 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7964000000000003e-05 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:872 3.4 e30/23 3:246b0b7f:::rbd_data.1118bd2b1382.0000000000000075:head v 30'11, mlcod=30'8)", 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.950231+0000", 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.7411893569999997, 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020145710000000002, 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950231+0000", 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950231+0000", 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950234+0000", 2024-09-12T05:20:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5069999999999999e-06 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950251+0000", 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7108999999999998e-05 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950290+0000", 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9223e-05 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950310+0000", 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9873000000000001e-05 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950418+0000", 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108279 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950450+0000", 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1698e-05 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952202+0000", 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017524999999999999 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952246+0000", 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3381999999999999e-05 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:876 3.0 e30/23 3:029ab416:::rbd_data.1118bd2b1382.0000000000000359:head v 30'4, mlcod=29'1)", 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:16.950369+0000", 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.741051498, 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023224410000000002, 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950369+0000", 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950369+0000", 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950370+0000", 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.113e-06 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950389+0000", 2024-09-12T05:20:22.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8542999999999998e-05 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950410+0000", 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1515999999999999e-05 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950426+0000", 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5489999999999999e-05 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950650+0000", 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022445599999999999 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.950700+0000", 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0336000000000001e-05 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952634+0000", 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019336990000000001 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:16.952691+0000", 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7287999999999998e-05 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:1036 3.0 e30/23 3:036b063d:::rbd_data.1118feb697f7.000000000000001a:head v 30'7, mlcod=30'5)", 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.510056+0000", 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1813638690000001, 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001731254, 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.708 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.510056+0000", 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.510056+0000", 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.510058+0000", 2024-09-12T05:20:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5689999999999999e-06 2024-09-12T05:20:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.510068+0000", 2024-09-12T05:20:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0339999999999999e-05 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.510090+0000", 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1152999999999999e-05 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.510105+0000", 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5002e-05 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.510261+0000", 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156632 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.510326+0000", 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4772999999999998e-05 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.511741+0000", 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014154250000000001 2024-09-12T05:20:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.511788+0000", 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6360000000000003e-05 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:1072 3.0 e30/23 3:036b063d:::rbd_data.1118feb697f7.000000000000001a:head v 30'8, mlcod=30'6)", 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.558149+0000", 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1332716959999996, 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015333899999999999, 2024-09-12T05:20:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.558149+0000", 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.558149+0000", 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.558151+0000", 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9829999999999999e-06 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.558161+0000", 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0701e-05 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.558189+0000", 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7376999999999999e-05 2024-09-12T05:20:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.558201+0000", 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2277e-05 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.558303+0000", 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101717 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.558351+0000", 2024-09-12T05:20:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8748999999999997e-05 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.559609+0000", 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001257123 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.559682+0000", 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3462999999999998e-05 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:2997 3.1e e33/24 3:78abed38:::rbd_data.1118a362a851.0000000000000000:head v 33'5, mlcod=28'2)", 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.919798+0000", 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.771622657, 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023057329999999999, 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.919798+0000", 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.919798+0000", 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.919798+0000", 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.919804+0000", 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8900000000000004e-06 2024-09-12T05:20:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.919827+0000", 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2682000000000001e-05 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.919837+0000", 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0745e-05 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920015+0000", 2024-09-12T05:20:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000177162 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920038+0000", 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3280000000000001e-05 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.921992+0000", 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001953864 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.922103+0000", 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111716 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "pg_update_log_missing(3.4 epoch 33/23 rep_tid 73 entries 33'16 (0'0) error 3:222e90b0:::rbd_data.1118a362a851.0000000000000009:head by client.4376.0:3006 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 30'14)", 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.920240+0000", 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.771180835, 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001728048, 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920240+0000", 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920240+0000", 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920241+0000", 2024-09-12T05:20:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3799999999999999e-06 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920253+0000", 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2387e-05 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920275+0000", 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1651e-05 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920290+0000", 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4882000000000001e-05 2024-09-12T05:20:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.920458+0000", 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016863300000000001 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.921968+0000", 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015091149999999999 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "pg_update_log_missing(3.0 epoch 33/23 rep_tid 74 entries 33'21 (0'0) error 3:057fb6ab:::rbd_data.1118a362a851.0000000000000008:head by client.4376.0:3005 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 31'19)", 2024-09-12T05:20:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.921999+0000", 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.769421637, 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014733159999999999, 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.921999+0000", 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.921999+0000", 2024-09-12T05:20:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.922000+0000", 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6440000000000001e-06 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.922022+0000", 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1313000000000001e-05 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.922076+0000", 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4106e-05 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.922119+0000", 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3316000000000003e-05 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.922367+0000", 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024815200000000002 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.923472+0000", 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011047850000000001 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3928 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'18, mlcod=33'16)", 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.975637+0000", 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.715783434, 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027579879999999998, 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.975637+0000", 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.975637+0000", 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.975638+0000", 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.173e-06 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.975646+0000", 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3350000000000007e-06 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.975666+0000", 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9219999999999999e-05 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.975678+0000", 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2833999999999999e-05 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.975763+0000", 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4693999999999999e-05 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.975800+0000", 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6563999999999998e-05 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.978350+0000", 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002549983 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.978395+0000", 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5185000000000002e-05 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3929 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'19, mlcod=33'16)", 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.976387+0000", 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.71503374, 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023312749999999998, 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.976387+0000", 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.976387+0000", 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.976387+0000", 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5300000000000003e-07 2024-09-12T05:20:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.976393+0000", 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5799999999999999e-06 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.976406+0000", 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3251000000000001e-05 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.976423+0000", 2024-09-12T05:20:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.664e-05 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.976860+0000", 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043718000000000001 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.976889+0000", 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9184e-05 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.978634+0000", 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001745047 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.978718+0000", 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3640000000000006e-05 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3932 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'20, mlcod=33'16)", 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.977635+0000", 2024-09-12T05:20:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.7137855310000001, 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016174970000000001, 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.977635+0000", 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.977635+0000", 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.977636+0000", 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8899999999999998e-07 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.977642+0000", 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.977655+0000", 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2779000000000001e-05 2024-09-12T05:20:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.977664+0000", 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4940000000000003e-06 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.977727+0000", 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3623999999999999e-05 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.977753+0000", 2024-09-12T05:20:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5891e-05 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979195+0000", 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014421169999999999 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979252+0000", 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7049000000000002e-05 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.712159483, 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:4042 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'22, mlcod=33'20)", 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.988547+0000", 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.70287375, 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015802360000000001, 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988547+0000", 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988547+0000", 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988548+0000", 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5850000000000001e-06 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988556+0000", 2024-09-12T05:20:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1610000000000003e-06 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988578+0000", 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1373999999999999e-05 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988587+0000", 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7180000000000008e-06 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988760+0000", 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017279 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988782+0000", 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2251000000000001e-05 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.990088+0000", 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001305811 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.990127+0000", 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8546e-05 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:4278 3.1e e33/24 3:7fa026b4:::rbd_data.1118e5842253.0000000000000152:head v 33'9, mlcod=33'7)", 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:21.580098+0000", 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.11132217, 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015142249999999999, 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.580098+0000", 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.580098+0000", 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.580100+0000", 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2239999999999998e-06 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.580197+0000", 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6818999999999996e-05 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.580233+0000", 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5352999999999998e-05 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.580251+0000", 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7932999999999999e-05 2024-09-12T05:20:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.580356+0000", 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010583500000000001 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.580380+0000", 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4031000000000001e-05 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.581572+0000", 2024-09-12T05:20:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011917029999999999 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.581612+0000", 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0327000000000002e-05 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:4382 3.1e e33/24 3:7ffb84c2:::rbd_data.1118e5842253.0000000000000075:head v 33'11, mlcod=33'9)", 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:21.805622+0000", 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.88579867199999995, 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001549433, 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.805622+0000", 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.805622+0000", 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.805623+0000", 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7600000000000001e-06 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.805646+0000", 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2235999999999999e-05 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.805667+0000", 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1506e-05 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.805680+0000", 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3108000000000001e-05 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.805762+0000", 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2063000000000004e-05 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.805786+0000", 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3506000000000002e-05 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.807099+0000", 2024-09-12T05:20:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001313481 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.807171+0000", 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1773000000000006e-05 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:4384 3.9 e33/23 3:96dad7e5:::rbd_data.1118e5842253.00000000000000da:head v 33'5, mlcod=32'2)", 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:21.812276+0000", 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.87914450499999997, 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001624908, 2024-09-12T05:20:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.812276+0000", 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.812276+0000", 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.812277+0000", 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0750000000000001e-06 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.812571+0000", 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029367899999999998 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.812593+0000", 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2734999999999998e-05 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.812605+0000", 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1812e-05 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.812676+0000", 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1061000000000003e-05 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.812702+0000", 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5463999999999999e-05 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.813837+0000", 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001135299 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.813901+0000", 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3782999999999996e-05 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:4417 3.9 e34/23 3:96dad7e5:::rbd_data.1118e5842253.00000000000000da:head v 34'6, mlcod=33'4)", 2024-09-12T05:20:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:21.885233+0000", 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.806187349, 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036799049999999998, 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.885233+0000", 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.885233+0000", 2024-09-12T05:20:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.885233+0000", 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8699999999999999e-07 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.885237+0000", 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4139999999999998e-06 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.885251+0000", 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4075e-05 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.885259+0000", 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4549999999999995e-06 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.885421+0000", 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016171999999999999 2024-09-12T05:20:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.885444+0000", 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3190999999999999e-05 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.888862+0000", 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034179660000000001 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.888913+0000", 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0896999999999997e-05 2024-09-12T05:20:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:4618 3.4 e34/23 3:21ffce70:::rbd_data.1118e5842253.00000000000001d8:head v 34'23, mlcod=33'21)", 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:22.095406+0000", 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.59601416399999996, 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018711400000000001, 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.095406+0000", 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.095406+0000", 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.095407+0000", 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1399999999999997e-07 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.095424+0000", 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7195000000000001e-05 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.095443+0000", 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9439000000000001e-05 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.095465+0000", 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2167999999999998e-05 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.095594+0000", 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012857999999999999 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.095657+0000", 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3456999999999999e-05 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.097162+0000", 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015049180000000001 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.097277+0000", 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114969 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:4642 3.1e e34/24 3:794a5eb5:::rbd_data.1118e5842253.000000000000004e:head v 34'14, mlcod=34'12)", 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:22.195716+0000", 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.495704857, 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015150509999999999, 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.195716+0000", 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.195716+0000", 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.195718+0000", 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.195813+0000", 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5333000000000004e-05 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.195843+0000", 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0182999999999999e-05 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.195862+0000", 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9202999999999999e-05 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.195953+0000", 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0167000000000006e-05 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.195974+0000", 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1608999999999999e-05 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.197085+0000", 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001110621 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.197231+0000", 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014578200000000001 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:22.776 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:22.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:22.778 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:22.777+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:22.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:22.879 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:22.877+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:22.918 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:22.919 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:22.919 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:22.919 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:22.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:22.976 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone4 from 0xde3024a (overlap 0x2e86ec0) to 0x0 2024-09-12T05:20:22.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:22.977+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:23.002 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:23.002 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:23.037 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:23.037 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:23.072 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:23.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:23.077+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:23.104 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:23.115 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:23.115 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:23.128 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:23.128 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:23.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:23.147 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:23.168 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:23.169 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:23.181 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:23.182+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:23.193 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-12T05:20:23.198 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:23.198 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:23.205 INFO:teuthology.orchestra.run.smithi059.stdout:728 trunc from 0xde3024a to 0x77b087e 2024-09-12T05:20:23.282 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:23.282+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:23.316 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:23.316 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:23.335 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:23.383 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:23.386+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:23.430 INFO:teuthology.orchestra.run.smithi059.stdout:729 writesame 0xc421546 thru 0xc421f41 data_size 0x12(0x9fc bytes) 2024-09-12T05:20:23.433 INFO:teuthology.orchestra.run.smithi059.stdout:731 read 0x8264c21 thru 0x82657e4 (0xbc4 bytes) 2024-09-12T05:20:23.434 INFO:teuthology.orchestra.run.smithi059.stdout:732 trunc from 0xc421f42 to 0xcb1f39d 2024-09-12T05:20:23.443 INFO:teuthology.orchestra.run.smithi059.stdout:733 read 0x34cb0d0 thru 0x34d5707 (0xa638 bytes) 2024-09-12T05:20:23.444 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:23.444 INFO:teuthology.orchestra.run.smithi059.stdout:737 read 0x8642ed5 thru 0x8652d45 (0xfe71 bytes) 2024-09-12T05:20:23.445 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:23.445 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:23.445 INFO:teuthology.orchestra.run.smithi059.stdout:741 writesame 0x317bea thru 0x320d5c data_size 0xb(0x9173 bytes) 2024-09-12T05:20:23.453 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:23.456 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:23.456 INFO:teuthology.orchestra.run.smithi059.stdout:744 read 0x607e1a7 thru 0x608951f (0xb379 bytes) 2024-09-12T05:20:23.457 INFO:teuthology.orchestra.run.smithi059.stdout:745 punch from 0x28aa6a0 to 0x28ae54b, (0x3eab bytes) 2024-09-12T05:20:23.457 INFO:teuthology.orchestra.run.smithi059.stdout:746 read 0x98f9ccb thru 0x98ff6dc (0x5a12 bytes) 2024-09-12T05:20:23.457 INFO:teuthology.orchestra.run.smithi059.stdout:747 read 0x5c4e6 thru 0x5ff2d (0x3a48 bytes) 2024-09-12T05:20:23.457 INFO:teuthology.orchestra.run.smithi059.stdout:748 write 0xc14aeb thru 0xc19f32 (0x5448 bytes) 2024-09-12T05:20:23.462 INFO:teuthology.orchestra.run.smithi059.stdout:749 write 0xc662000 thru 0xc66503b (0x303c bytes) 2024-09-12T05:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:23.483 INFO:teuthology.orchestra.run.smithi059.stdout:752 writesame 0xe98db87 thru 0xe998ac6 data_size 0x20(0xaf40 bytes) 2024-09-12T05:20:23.483 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:23.483 INFO:teuthology.orchestra.run.smithi059.stdout:755 punch from 0x58b1331 to 0x58b2c60, (0x192f bytes) 2024-09-12T05:20:23.484 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:23.484 INFO:teuthology.orchestra.run.smithi059.stdout:758 writesame 0x2047f07 thru 0x2050279 data_size 0x3(0x8373 bytes) 2024-09-12T05:20:23.484 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:23.486+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:23.487 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:23.498 INFO:teuthology.orchestra.run.smithi059.stdout:759 trunc from 0xe998ac7 to 0xe319e14 2024-09-12T05:20:23.506 INFO:teuthology.orchestra.run.smithi059.stdout:760 punch from 0x4a8bdcb to 0x4a9685b, (0xaa90 bytes) 2024-09-12T05:20:23.506 INFO:teuthology.orchestra.run.smithi059.stdout:761 read 0x2e450d3 thru 0x2e504ac (0xb3da bytes) 2024-09-12T05:20:23.508 INFO:teuthology.orchestra.run.smithi059.stdout:762 punch from 0xc49dd58 to 0xc4a2a35, (0x4cdd bytes) 2024-09-12T05:20:23.508 INFO:teuthology.orchestra.run.smithi059.stdout:764 write 0xc7efd37 thru 0xc7f8402 (0x86cc bytes) 2024-09-12T05:20:23.510 INFO:teuthology.orchestra.run.smithi059.stdout:765 read 0xd40604a thru 0xd407685 (0x163c bytes) 2024-09-12T05:20:23.511 INFO:teuthology.orchestra.run.smithi059.stdout:767 writesame 0x74649d2 thru 0x74743a4 data_size 0x1(0xf9d3 bytes) 2024-09-12T05:20:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:768 punch from 0x6b1d3a2 to 0x6b29136, (0xbd94 bytes) 2024-09-12T05:20:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:769 writesame 0x1476553 thru 0x147f1f8 data_size 0x33(0x8ca6 bytes) 2024-09-12T05:20:23.559 INFO:teuthology.orchestra.run.smithi059.stdout:770 punch from 0x6928e4d to 0x6932168, (0x931b bytes) 2024-09-12T05:20:23.559 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:23.559 INFO:teuthology.orchestra.run.smithi059.stdout:773 write 0x9e641c6 thru 0x9e72d39 (0xeb74 bytes) 2024-09-12T05:20:23.562 INFO:teuthology.orchestra.run.smithi059.stdout:775 write 0xd5fa9ab thru 0xd603126 (0x877c bytes) 2024-09-12T05:20:23.565 INFO:teuthology.orchestra.run.smithi059.stdout:777 read 0x5313fef thru 0x53149e5 (0x9f7 bytes) 2024-09-12T05:20:23.566 INFO:teuthology.orchestra.run.smithi059.stdout:778 read 0x721f449 thru 0x722b3e5 (0xbf9d bytes) 2024-09-12T05:20:23.567 INFO:teuthology.orchestra.run.smithi059.stdout:779 write 0xc8e124d thru 0xc8ea1df (0x8f93 bytes) 2024-09-12T05:20:23.570 INFO:teuthology.orchestra.run.smithi059.stdout:781 clone 6 order 24 su 262144 sc 14 2024-09-12T05:20:23.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:23.585+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:23.606 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:23.606 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:23.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:23.709 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:23.709+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:23.786 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:23.786 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:23.786 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:23.785+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:23.800 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:23.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:20:23.887 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:23.890+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:23.959 INFO:teuthology.orchestra.run.smithi059.stdout:leaving image image_client.0-clone5 intact 2024-09-12T05:20:23.971 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:23.971 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:23.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:23.987 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:23.985+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:24.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:24.089+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:24.105 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:24.105 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:24.120 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:24.189 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:24.190+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:24.194 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-12T05:20:24.196 INFO:teuthology.orchestra.run.smithi059.stdout:782 read 0x4cf2809 thru 0x4cfb044 (0x883c bytes) 2024-09-12T05:20:24.198 INFO:teuthology.orchestra.run.smithi059.stdout:784 punch from 0x7d454cb to 0x7d4576a, (0x29f bytes) 2024-09-12T05:20:24.203 INFO:teuthology.orchestra.run.smithi059.stdout:785 punch from 0x9ed52ba to 0x9ee0463, (0xb1a9 bytes) 2024-09-12T05:20:24.204 INFO:teuthology.orchestra.run.smithi059.stdout:786 writesame 0xfccead thru 0xfd3e63 data_size 0x1(0x6fb7 bytes) 2024-09-12T05:20:24.260 INFO:teuthology.orchestra.run.smithi059.stdout:787 punch from 0x23d24ce to 0x23daa27, (0x8559 bytes) 2024-09-12T05:20:24.260 INFO:teuthology.orchestra.run.smithi059.stdout:788 punch from 0x6aa699d to 0x6ab3ea0, (0xd503 bytes) 2024-09-12T05:20:24.260 INFO:teuthology.orchestra.run.smithi059.stdout:789 read 0x3046f21 thru 0x305385d (0xc93d bytes) 2024-09-12T05:20:24.261 INFO:teuthology.orchestra.run.smithi059.stdout:790 write 0x5f6713 thru 0x600aa5 (0xa393 bytes) 2024-09-12T05:20:24.291 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:24.294+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:24.301 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:24.301 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:24.304 INFO:teuthology.orchestra.run.smithi059.stdout:791 read 0xa5349a7 thru 0xa537e57 (0x34b1 bytes) 2024-09-12T05:20:24.305 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.305 INFO:teuthology.orchestra.run.smithi059.stdout:794 read 0xab7e7e8 thru 0xab806bf (0x1ed8 bytes) 2024-09-12T05:20:24.306 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.306 INFO:teuthology.orchestra.run.smithi059.stdout:797 writesame 0xbc760d4 thru 0xbc794b5 data_size 0x1d(0x33e2 bytes) 2024-09-12T05:20:24.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:24.356 INFO:teuthology.orchestra.run.smithi059.stdout:799 writesame 0xc88851d thru 0xc8914b8 data_size 0x1c(0x8f9c bytes) 2024-09-12T05:20:24.392 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:24.394+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:24.423 INFO:teuthology.orchestra.run.smithi059.stdout:801 trunc from 0xe319e14 to 0xa4b32df 2024-09-12T05:20:24.440 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:24.440 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:24.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:24.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:24.505+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:24.569 INFO:teuthology.orchestra.run.smithi059.stdout:803 read 0x676ebc9 thru 0x6777a26 (0x8e5e bytes) 2024-09-12T05:20:24.569 INFO:teuthology.orchestra.run.smithi059.stdout:804 read 0x4c33a5e thru 0x4c3a9ae (0x6f51 bytes) 2024-09-12T05:20:24.570 INFO:teuthology.orchestra.run.smithi059.stdout:805 write 0x43d9d70 thru 0x43dc046 (0x22d7 bytes) 2024-09-12T05:20:24.573 INFO:teuthology.orchestra.run.smithi059.stdout:807 read 0xca0824 thru 0xca4c94 (0x4471 bytes) 2024-09-12T05:20:24.574 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.574 INFO:teuthology.orchestra.run.smithi059.stdout:810 read 0x77985ee thru 0x7799dd2 (0x17e5 bytes) 2024-09-12T05:20:24.575 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.580 INFO:teuthology.orchestra.run.smithi059.stdout:813 trunc from 0xa4b32df to 0xca2fb9f 2024-09-12T05:20:24.588 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:24.588 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:24.592 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:24.594+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:24.594 INFO:teuthology.orchestra.run.smithi059.stdout:814 write 0x6e76239 thru 0x6e762db (0xa3 bytes) 2024-09-12T05:20:24.597 INFO:teuthology.orchestra.run.smithi059.stdout:815 write 0x87ca2b5 thru 0x87d1fd5 (0x7d21 bytes) 2024-09-12T05:20:24.600 INFO:teuthology.orchestra.run.smithi059.stdout:816 read 0x53eff8b thru 0x53fcbeb (0xcc61 bytes) 2024-09-12T05:20:24.601 INFO:teuthology.orchestra.run.smithi059.stdout:817 punch from 0xae8e1ea to 0xae97e3a, (0x9c50 bytes) 2024-09-12T05:20:24.601 INFO:teuthology.orchestra.run.smithi059.stdout:818 read 0xa269a6e thru 0xa277b92 (0xe125 bytes) 2024-09-12T05:20:24.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:24.603 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.603 INFO:teuthology.orchestra.run.smithi059.stdout:821 writesame 0x9461c5e thru 0x9468f97 data_size 0x56(0x733a bytes) 2024-09-12T05:20:24.620 INFO:teuthology.orchestra.run.smithi059.stdout:822 write 0xeb24f31 thru 0xeb30ba1 (0xbc71 bytes) 2024-09-12T05:20:24.627 INFO:teuthology.orchestra.run.smithi059.stdout:823 read 0xa7ee7fb thru 0xa7f3e11 (0x5617 bytes) 2024-09-12T05:20:24.627 INFO:teuthology.orchestra.run.smithi059.stdout:824 read 0x6375685 thru 0x6378578 (0x2ef4 bytes) 2024-09-12T05:20:24.628 INFO:teuthology.orchestra.run.smithi059.stdout:825 read 0x4ad2503 thru 0x4adc39b (0x9e99 bytes) 2024-09-12T05:20:24.629 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.629 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.629 INFO:teuthology.orchestra.run.smithi059.stdout:831 write 0x5bb311e thru 0x5bc23ae (0xf291 bytes) 2024-09-12T05:20:24.632 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.632 INFO:teuthology.orchestra.run.smithi059.stdout:833 read 0xda7437e thru 0xda77d4b (0x39ce bytes) 2024-09-12T05:20:24.633 INFO:teuthology.orchestra.run.smithi059.stdout:834 punch from 0xe2d9d2e to 0xe2da469, (0x73b bytes) 2024-09-12T05:20:24.633 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.654 INFO:teuthology.orchestra.run.smithi059.stdout:837 trunc from 0xeb30ba2 to 0x4bef18d 2024-09-12T05:20:24.681 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:24.681 INFO:teuthology.orchestra.run.smithi059.stdout:839 writesame 0x2febe59 thru 0x2ff418e data_size 0x5(0x8336 bytes) 2024-09-12T05:20:24.689 INFO:teuthology.orchestra.run.smithi059.stdout:840 read 0x141f495 thru 0x142bde0 (0xc94c bytes) 2024-09-12T05:20:24.690 INFO:teuthology.orchestra.run.smithi059.stdout:841 read 0x3bdd74c thru 0x3be07ae (0x3063 bytes) 2024-09-12T05:20:24.691 INFO:teuthology.orchestra.run.smithi059.stdout:843 read 0x34b1728 thru 0x34bfa73 (0xe34c bytes) 2024-09-12T05:20:24.693 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:24.694+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:24.699 INFO:teuthology.orchestra.run.smithi059.stdout:844 trunc from 0x4bef18d to 0x7f142e8 2024-09-12T05:20:24.710 INFO:teuthology.orchestra.run.smithi059.stdout:846 read 0x5d2e290 thru 0x5d3d480 (0xf1f1 bytes) 2024-09-12T05:20:24.710 INFO:teuthology.orchestra.run.smithi059.stdout:848 read 0x7ab5dec thru 0x7ab7b7a (0x1d8f bytes) 2024-09-12T05:20:24.711 INFO:teuthology.orchestra.run.smithi059.stdout:849 read 0x438b3bf thru 0x4398c1c (0xd85e bytes) 2024-09-12T05:20:24.712 INFO:teuthology.orchestra.run.smithi059.stdout:850 read 0x5d965b thru 0x5d9fbc (0x962 bytes) 2024-09-12T05:20:24.713 INFO:teuthology.orchestra.run.smithi059.stdout:853 read 0x2506272 thru 0x250ed8e (0x8b1d bytes) 2024-09-12T05:20:24.714 INFO:teuthology.orchestra.run.smithi059.stdout:854 punch from 0x4281165 to 0x428ef40, (0xdddb bytes) 2024-09-12T05:20:24.727 INFO:teuthology.orchestra.run.smithi059.stdout:855 trunc from 0x7f142e8 to 0xd880c19 2024-09-12T05:20:24.740 INFO:teuthology.orchestra.run.smithi059.stdout:857 write 0x7165a5f thru 0x716f39a (0x993c bytes) 2024-09-12T05:20:24.743 INFO:teuthology.orchestra.run.smithi059.stdout:858 clone 7 order 19 su 8192 sc 6 2024-09-12T05:20:24.776 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:24.776 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:24.791 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:24.794 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:24.793+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:24.844 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:20:24.895 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:24.893+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:24.920 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:24.920 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:24.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:24.992 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone6 from 0xd880c19 (overlap 0x4bef18d) to 0x44572fe 2024-09-12T05:20:25.028 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:25.029+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:25.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:25.097+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:25.108 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:25.108 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:25.122 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:25.212 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:25.213+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:25.228 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:25.286 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-12T05:20:25.292 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:25.293 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:25.298 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:25.297+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:25.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:25.398 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:25.402+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:25.422 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:25.422 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:25.425 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:25.425 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:25.425 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T05:20:25.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:20:25.441 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:25.451 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:25.452 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:25.452 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:25.452 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:25.460 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:25.460 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:25.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:25.480 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:25.500 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:25.497+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:25.502 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:25.502 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:25.523 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:25.524 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:25.545 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:25.545 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:25.569 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:25.569 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:25.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:25.601+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:25.603 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:25.604 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:25.604 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:25.604 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:25.604 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:25.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:25.702 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:25.701+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:25.763 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 37, 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:20:24.838561+0000", 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:19:51.845158+0000", 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:20:09.718345+0000", 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5806080, 2024-09-12T05:20:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "nodeep-scrub", 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "noscrub", 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 5, 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:20:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "jewel", 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:25.766 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:20:25.767 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:25.770 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.771 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:20:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 2.9900000095367432, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 2.9900000095367432, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2.630000114440918, 2024-09-12T05:20:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2.630000114440918, 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:20:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:20:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "37", 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 9, 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 37, 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.7400000095367432, 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.7400000095367432, 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:20:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 19, 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:20:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:20:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:20:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/2467380900", 2024-09-12T05:20:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/2467380900", 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/2467380900", 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/2467380900", 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 23, 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:20:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:20:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 0, 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 0, 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 23, 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:20:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 65536, 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [], 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [], 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:20:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:20:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:20:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:20:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:20:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:20:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:20:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.840 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:25.841 INFO:teuthology.orchestra.run.smithi059.stdout:859 trunc from 0xd880c19 to 0x630e8a5 2024-09-12T05:20:25.843 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:20:24.838561+0000', 'last_up_change': '2024-09-12T05:19:51.845158+0000', 'last_in_change': '2024-09-12T05:20:09.718345+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 2467380900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 2467380900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 2467380900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 2467380900}]}, 'public_addr': '172.21.15.194:6825/2467380900', 'cluster_addr': '172.21.15.194:6827/2467380900', 'heartbeat_back_addr': '172.21.15.194:6831/2467380900', 'heartbeat_front_addr': '172.21.15.194:6829/2467380900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:20:25.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:20:25.844 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1044 3.1 3:82897231:::rbd_object_map.1118feb697f7:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.512145+0000", 2024-09-12T05:20:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.3052635289999994, 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010806621000000001, 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1044 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512145+0000", 2024-09-12T05:20:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512145+0000", 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512146+0000", 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6599999999999995e-07 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512150+0000", 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1919999999999998e-06 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512159+0000", 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0119999999999994e-06 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512166+0000", 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9160000000000004e-06 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.517697+0000", 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055310170000000001 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.517784+0000", 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7051000000000004e-05 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.518098+0000", 2024-09-12T05:20:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031354400000000002 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.519156+0000", 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001058184 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.522827+0000", 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036711529999999999 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.522898+0000", 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1351000000000002e-05 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.522952+0000", 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3434999999999999e-05 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1045 3.1 3:82897231:::rbd_object_map.1118feb697f7:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.512177+0000", 2024-09-12T05:20:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.3052314690000006, 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010953968999999999, 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1045 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512177+0000", 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512177+0000", 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512178+0000", 2024-09-12T05:20:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512181+0000", 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5769999999999998e-06 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512190+0000", 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.524e-06 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512196+0000", 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5889999999999999e-06 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.518406+0000", 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062099809999999998 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.518461+0000", 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4790000000000002e-05 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.518677+0000", 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021611699999999999 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.520507+0000", 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001829364 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523027+0000", 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025204289999999998 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523087+0000", 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9947000000000001e-05 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523131+0000", 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4085000000000002e-05 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:1046 3.1 3:82897231:::rbd_object_map.1118feb697f7:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:17.512206+0000", 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.3052024899999992, 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011114188000000001, 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1046 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512206+0000", 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512206+0000", 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512207+0000", 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5700000000000002e-07 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512210+0000", 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3780000000000001e-06 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512219+0000", 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5629999999999992e-06 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.512225+0000", 2024-09-12T05:20:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3960000000000003e-06 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.519201+0000", 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0069755160000000002 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.519298+0000", 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7349000000000006e-05 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.519733+0000", 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043519000000000001 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.521265+0000", 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015322650000000001 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523198+0000", 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019322549999999999 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523272+0000", 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4884999999999999e-05 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:17.523320+0000", 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7834000000000003e-05 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3680 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.946596+0000", 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8708129839999996, 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010615968, 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3680 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946596+0000", 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946596+0000", 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946596+0000", 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4300000000000002e-07 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946600+0000", 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9160000000000003e-06 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946610+0000", 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9890000000000004e-06 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.946631+0000", 2024-09-12T05:20:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0701999999999999e-05 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.956867+0000", 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010236357999999999 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.957026+0000", 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015819299999999999 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.957212+0000", 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018606699999999999 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3687 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950056+0000", 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8673526970000003, 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017577545, 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3687 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950056+0000", 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950056+0000", 2024-09-12T05:20:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950056+0000", 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.46e-07 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950107+0000", 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0359999999999999e-05 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950118+0000", 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1042e-05 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950124+0000", 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6239999999999996e-06 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.959145+0000", 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090206279999999993 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.964550+0000", 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054046570000000002 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967633+0000", 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030837880000000001 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3796 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950521+0000", 2024-09-12T05:20:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8668876379999997, 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014658548, 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3796 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950521+0000", 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950521+0000", 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950521+0000", 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6400000000000003e-07 2024-09-12T05:20:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950524+0000", 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3530000000000002e-06 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950531+0000", 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0140000000000001e-06 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950536+0000", 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1320000000000002e-06 2024-09-12T05:20:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.964800+0000", 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014263937000000001 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.964975+0000", 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017517699999999999 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965180+0000", 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020447099999999999 2024-09-12T05:20:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3797 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 589824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950544+0000", 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8668642069999999, 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015040021000000001, 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3797 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950544+0000", 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950544+0000", 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950545+0000", 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8999999999999997e-07 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950547+0000", 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.204e-06 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950553+0000", 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.28e-06 2024-09-12T05:20:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950558+0000", 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8960000000000002e-06 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965238+0000", 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014679721999999999 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965385+0000", 2024-09-12T05:20:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014657099999999999 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965584+0000", 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000199858 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3798 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950570+0000", 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8668390810000002, 2024-09-12T05:20:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015435432000000001, 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3798 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950570+0000", 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950570+0000", 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950570+0000", 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950572+0000", 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2680000000000001e-06 2024-09-12T05:20:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950579+0000", 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5220000000000004e-06 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950607+0000", 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8204e-05 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965642+0000", 2024-09-12T05:20:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015034657 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.965798+0000", 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015634500000000001 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966005+0000", 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020698400000000001 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3799 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950621+0000", 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8667874879999999, 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015797868999999999, 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3799 2024-09-12T05:20:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950621+0000", 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950621+0000", 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950622+0000", 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8699999999999995e-07 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950625+0000", 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9620000000000002e-06 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950634+0000", 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4490000000000005e-06 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950640+0000", 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3799999999999999e-06 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966059+0000", 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015418316 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966221+0000", 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016191 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966419+0000", 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019836499999999999 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3800 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950649+0000", 2024-09-12T05:20:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8667595800000001, 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016124408999999999, 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3800 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950649+0000", 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950649+0000", 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950649+0000", 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4799999999999999e-07 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950652+0000", 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2840000000000001e-06 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950658+0000", 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.72e-06 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950664+0000", 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0649999999999998e-06 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966475+0000", 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015811064999999999 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966610+0000", 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000135597 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966773+0000", 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016322999999999999 2024-09-12T05:20:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3801 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950675+0000", 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8667335720000002, 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016417843000000001, 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3801 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950675+0000", 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950675+0000", 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950675+0000", 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950678+0000", 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7889999999999999e-06 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950686+0000", 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4919999999999996e-06 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950691+0000", 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5060000000000003e-06 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966822+0000", 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016130664999999999 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.966948+0000", 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012579299999999999 2024-09-12T05:20:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967093+0000", 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014515900000000001 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3802 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950699+0000", 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8667095529999997, 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016719632000000002, 2024-09-12T05:20:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3802 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950699+0000", 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950699+0000", 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950699+0000", 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1800000000000001e-07 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950701+0000", 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0169999999999999e-06 2024-09-12T05:20:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950712+0000", 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0804e-05 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950718+0000", 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4369999999999998e-06 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967135+0000", 2024-09-12T05:20:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016417669999999999 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967265+0000", 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000129407 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967419+0000", 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015387899999999999 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3803 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 3735552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.950726+0000", 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8666823990000001, 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016995499000000001, 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3803 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950726+0000", 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950726+0000", 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950727+0000", 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8500000000000002e-07 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950729+0000", 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.305e-06 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950735+0000", 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.19e-06 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.950742+0000", 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4370000000000004e-06 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967462+0000", 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016720499999999999 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967579+0000", 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116407 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967722+0000", 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000143175 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3804 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.953402+0000", 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8640070150000003, 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017858619999999999, 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3804 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953402+0000", 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953402+0000", 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953402+0000", 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2900000000000002e-07 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953410+0000", 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2439999999999996e-06 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953420+0000", 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0345e-05 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953427+0000", 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3470000000000001e-06 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967857+0000", 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014429365 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.967979+0000", 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012214699999999999 2024-09-12T05:20:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.971260+0000", 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032813429999999999 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3805 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.953439+0000", 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8639700359999996, 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015072868, 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3805 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953439+0000", 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953439+0000", 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953439+0000", 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8699999999999995e-07 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953443+0000", 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4070000000000002e-06 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953450+0000", 2024-09-12T05:20:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4919999999999996e-06 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953456+0000", 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7379999999999999e-06 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968240+0000", 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014783848 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968358+0000", 2024-09-12T05:20:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118371 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968511+0000", 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000153425 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3806 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 5308416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.953465+0000", 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8639438610000001, 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015342853, 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3806 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953465+0000", 2024-09-12T05:20:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953465+0000", 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953465+0000", 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953473+0000", 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3699999999999997e-06 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953480+0000", 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8159999999999994e-06 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953486+0000", 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4310000000000002e-06 2024-09-12T05:20:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968555+0000", 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015069333000000001 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968670+0000", 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114795 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968808+0000", 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013757900000000001 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3807 3.1b 3:df91fec7:::rbd_data.1118feb697f7.0000000000000009:5 [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.953494+0000", 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8639142060000005, 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015608149, 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3807 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953494+0000", 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953494+0000", 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953495+0000", 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3900000000000005e-07 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953497+0000", 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2199999999999999e-06 2024-09-12T05:20:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953504+0000", 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0899999999999999e-06 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.953509+0000", 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.113e-06 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968850+0000", 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015340885 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.968965+0000", 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114392 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969103+0000", 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013791000000000001 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3941 3.6 3:67a3fa36:::rbd_data.1118a362a851.0000000000000002:head [delete] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.980614+0000", 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.836794576, 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0105237, 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3941 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980614+0000", 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980614+0000", 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980615+0000", 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.92e-07 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980619+0000", 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4819999999999996e-06 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980630+0000", 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.112e-05 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.980639+0000", 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4500000000000004e-06 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.982496+0000", 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001857425 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.982569+0000", 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3112000000000001e-05 2024-09-12T05:20:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.982746+0000", 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017691300000000001 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986798+0000", 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040520790000000001 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.991037+0000", 2024-09-12T05:20:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004238393 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.991092+0000", 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5247999999999997e-05 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.991138+0000", 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5686000000000003e-05 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:4406 3.1b 3:dc7217c3:::rbd_data.1118e5842253.0000000000000067:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:21.851323+0000", 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9660852850000001, 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014558827999999999, 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 4406 2024-09-12T05:20:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.851323+0000", 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.851323+0000", 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.851324+0000", 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.108e-06 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.851330+0000", 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2630000000000003e-06 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.851341+0000", 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1476e-05 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.851347+0000", 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7479999999999999e-06 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.851416+0000", 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8695999999999994e-05 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.851542+0000", 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012624000000000001 2024-09-12T05:20:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.853745+0000", 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002203029 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.865727+0000", 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011982532000000001 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.865750+0000", 2024-09-12T05:20:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2424000000000001e-05 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.865821+0000", 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0792999999999998e-05 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:21.865882+0000", 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1519000000000005e-05 2024-09-12T05:20:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:4884 3.1 3:83dd21b4:::rbd_data.1118e5842253.000000000000000a:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:22.992837+0000", 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 2.824571545, 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011370246000000001, 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 4884 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.992837+0000", 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.992837+0000", 2024-09-12T05:20:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.992838+0000", 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4799999999999999e-07 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.992840+0000", 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8540000000000001e-06 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.992849+0000", 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8920000000000006e-06 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.992855+0000", 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.996603+0000", 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00374852 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:22.996685+0000", 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2001000000000003e-05 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:23.004207+0000", 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075221039999999999 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:25.941 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:25.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:25.943 INFO:teuthology.orchestra.run.smithi059.stdout:861 writesame 0x6ee5bcc thru 0x6ee86fe data_size 0x1(0x2b33 bytes) 2024-09-12T05:20:25.943 INFO:teuthology.orchestra.run.smithi059.stdout:863 read 0x4199894 thru 0x41a8b72 (0xf2df bytes) 2024-09-12T05:20:25.943 INFO:teuthology.orchestra.run.smithi059.stdout:864 punch from 0x197931d to 0x197c176, (0x2e59 bytes) 2024-09-12T05:20:25.943 INFO:teuthology.orchestra.run.smithi059.stdout:865 writesame 0x675b83d thru 0x6760a8e data_size 0x2(0x5252 bytes) 2024-09-12T05:20:25.943 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:25.842+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:25.944 INFO:teuthology.orchestra.run.smithi059.stdout:867 trunc from 0x6ee86ff to 0x52f9b97 2024-09-12T05:20:25.945 INFO:teuthology.orchestra.run.smithi059.stdout:868 writesame 0x73f521e thru 0x73f970d data_size 0x8(0x44f0 bytes) 2024-09-12T05:20:25.945 INFO:teuthology.orchestra.run.smithi059.stdout:871 write 0xbeb57dd thru 0xbeb9d95 (0x45b9 bytes) 2024-09-12T05:20:25.945 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:25.945+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:25.952 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:25.952 INFO:teuthology.orchestra.run.smithi059.stdout:874 read 0xba5bf58 thru 0xba68ef5 (0xcf9e bytes) 2024-09-12T05:20:25.961 INFO:teuthology.orchestra.run.smithi059.stdout:875 write 0xbeda20f thru 0xbee27c7 (0x85b9 bytes) 2024-09-12T05:20:25.975 INFO:teuthology.orchestra.run.smithi059.stdout:879 trunc from 0xbee27c8 to 0xd2f180a 2024-09-12T05:20:25.988 INFO:teuthology.orchestra.run.smithi059.stdout:880 trunc from 0xd2f180a to 0xea9f150 2024-09-12T05:20:26.021 INFO:teuthology.orchestra.run.smithi059.stdout:881 trunc from 0xea9f150 to 0x1099b88 2024-09-12T05:20:26.047 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:26.046+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:26.113 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:26.113 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:26.113 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:26.113 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:26.117 INFO:teuthology.orchestra.run.smithi059.stdout:884 write 0xced247e thru 0xced6129 (0x3cac bytes) 2024-09-12T05:20:26.126 INFO:teuthology.orchestra.run.smithi059.stdout:885 write 0x7057b01 thru 0x70639a7 (0xbea7 bytes) 2024-09-12T05:20:26.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:26.138 INFO:teuthology.orchestra.run.smithi059.stdout:887 punch from 0x9ce6a5 to 0x9db2f7, (0xcc52 bytes) 2024-09-12T05:20:26.138 INFO:teuthology.orchestra.run.smithi059.stdout:888 read 0x2ceac88 thru 0x2cf11e4 (0x655d bytes) 2024-09-12T05:20:26.138 INFO:teuthology.orchestra.run.smithi059.stdout:889 punch from 0x227b20e to 0x227ee37, (0x3c29 bytes) 2024-09-12T05:20:26.138 INFO:teuthology.orchestra.run.smithi059.stdout:890 writesame 0xa04d15c thru 0xa0556f1 data_size 0x1(0x8596 bytes) 2024-09-12T05:20:26.147 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:26.145+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:26.163 INFO:teuthology.orchestra.run.smithi059.stdout:891 read 0x641ac3a thru 0x641bfd1 (0x1398 bytes) 2024-09-12T05:20:26.165 INFO:teuthology.orchestra.run.smithi059.stdout:892 trunc from 0xced612a to 0xb88e0a1 2024-09-12T05:20:26.181 INFO:teuthology.orchestra.run.smithi059.stdout:893 write 0xa5e4a7a thru 0xa5eac22 (0x61a9 bytes) 2024-09-12T05:20:26.190 INFO:teuthology.orchestra.run.smithi059.stdout:894 punch from 0x7306ac6 to 0x730e6a8, (0x7be2 bytes) 2024-09-12T05:20:26.190 INFO:teuthology.orchestra.run.smithi059.stdout:895 read 0x4aa8290 thru 0x4ab606f (0xdde0 bytes) 2024-09-12T05:20:26.190 INFO:teuthology.orchestra.run.smithi059.stdout:897 read 0x94abb04 thru 0x94aebce (0x30cb bytes) 2024-09-12T05:20:26.190 INFO:teuthology.orchestra.run.smithi059.stdout:898 write 0xc79a94 thru 0xc80be6 (0x7153 bytes) 2024-09-12T05:20:26.229 INFO:teuthology.orchestra.run.smithi059.stdout:899 trunc from 0xb88e0a1 to 0xa739cc1 2024-09-12T05:20:26.248 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:26.249+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:26.255 INFO:teuthology.orchestra.run.smithi059.stdout:902 writesame 0xc491194 thru 0xc495b28 data_size 0x17(0x4995 bytes) 2024-09-12T05:20:26.255 INFO:teuthology.orchestra.run.smithi059.stdout:903 punch from 0xa5067a6 to 0xa50e0da, (0x7934 bytes) 2024-09-12T05:20:26.255 INFO:teuthology.orchestra.run.smithi059.stdout:904 punch from 0xa145086 to 0xa146725, (0x169f bytes) 2024-09-12T05:20:26.255 INFO:teuthology.orchestra.run.smithi059.stdout:906 read 0xdcef94 thru 0xddd074 (0xe0e1 bytes) 2024-09-12T05:20:26.256 INFO:teuthology.orchestra.run.smithi059.stdout:907 write 0x3c4cd59 thru 0x3c53559 (0x6801 bytes) 2024-09-12T05:20:26.265 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:26.266 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:26.266 INFO:teuthology.orchestra.run.smithi059.stdout:910 read 0x3c5d311 thru 0x3c682ed (0xafdd bytes) 2024-09-12T05:20:26.266 INFO:teuthology.orchestra.run.smithi059.stdout:912 writesame 0x5b5ae03 thru 0x5b5fb66 data_size 0x4e(0x4d64 bytes) 2024-09-12T05:20:26.273 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:26.274 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:26.274 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:26.274 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:26.274 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:26.279 INFO:teuthology.orchestra.run.smithi059.stdout:913 read 0x5265a09 thru 0x5271ae4 (0xc0dc bytes) 2024-09-12T05:20:26.289 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:26.290 INFO:teuthology.orchestra.run.smithi059.stdout:914 write 0xd2bc43d thru 0xd2cbf51 (0xfb15 bytes) 2024-09-12T05:20:26.302 INFO:teuthology.orchestra.run.smithi059.stdout:915 writesame 0x624a8b thru 0x626375 data_size 0x1(0x18eb bytes) 2024-09-12T05:20:26.319 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:26.319 INFO:teuthology.orchestra.run.smithi059.stdout:918 read 0xcdf9582 thru 0xce01694 (0x8113 bytes) 2024-09-12T05:20:26.319 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:26.328 INFO:teuthology.orchestra.run.smithi059.stdout:921 trunc from 0xd2cbf52 to 0x57a9dce 2024-09-12T05:20:26.337 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:26.338 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:20:26.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:26.349+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:26.356 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-12T05:20:24.902545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83189941,"num_objects":142,"num_object_clones":28,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":45,"num_read":7508,"num_read_kb":11188,"num_write":1493,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1251,"ondisk_log_size":1251,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":215720,"kb_used_data":14024,"kb_used_omap":10,"kb_used_meta":201525,"kb_avail":660387160,"statfs":{"total":676457349120,"available":676236451840,"internally_reserved":0,"allocated":14360576,"data_stored":12444624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11158,"internal_metadata":206361706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69771473,"num_objects":89,"num_object_clones":21,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":27,"num_read":5298,"num_read_kb":9269,"num_write":924,"num_write_kb":11992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000921"},"pg_stats":[{"pgid":"3.1f","version":"34'45","reported_seq":274,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.898227+0000","last_change":"2024-09-12T05:20:11.762958+0000","last_active":"2024-09-12T05:20:21.898227+0000","last_peered":"2024-09-12T05:20:21.898227+0000","last_clean":"2024-09-12T05:20:21.898227+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:20:21.898227+0000","last_undegraded":"2024-09-12T05:20:21.898227+0000","last_fullsized":"2024-09-12T05:20:21.898227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:46.689671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036800549999999998,"stat_sum":{"num_bytes":5158015,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":544,"num_read_kb":483,"num_write":41,"num_write_kb":472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'13","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.899888+0000","last_change":"2024-09-12T05:20:11.787773+0000","last_active":"2024-09-12T05:20:21.899888+0000","last_peered":"2024-09-12T05:20:21.899888+0000","last_clean":"2024-09-12T05:20:21.899888+0000","last_became_active":"2024-09-12T05:20:10.734941+0000","last_became_peered":"2024-09-12T05:20:10.734941+0000","last_unstale":"2024-09-12T05:20:21.899888+0000","last_undegraded":"2024-09-12T05:20:21.899888+0000","last_fullsized":"2024-09-12T05:20:21.899888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:58.008162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015371499999999999,"stat_sum":{"num_bytes":5046272,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":2,"num_read":24,"num_read_kb":0,"num_write":10,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"34'82","reported_seq":256,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:22.032020+0000","last_change":"2024-09-12T05:20:11.737126+0000","last_active":"2024-09-12T05:20:22.032020+0000","last_peered":"2024-09-12T05:20:22.032020+0000","last_clean":"2024-09-12T05:20:22.032020+0000","last_became_active":"2024-09-12T05:20:09.751607+0000","last_became_peered":"2024-09-12T05:20:09.751607+0000","last_unstale":"2024-09-12T05:20:22.032020+0000","last_undegraded":"2024-09-12T05:20:22.032020+0000","last_fullsized":"2024-09-12T05:20:22.032020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:51.693828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098006399999999989,"stat_sum":{"num_bytes":1048667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":255,"num_write":128,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"33'13","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.817425+0000","last_change":"2024-09-12T05:20:11.736070+0000","last_active":"2024-09-12T05:20:21.817425+0000","last_peered":"2024-09-12T05:20:21.817425+0000","last_clean":"2024-09-12T05:20:21.817425+0000","last_became_active":"2024-09-12T05:20:09.751421+0000","last_became_peered":"2024-09-12T05:20:09.751421+0000","last_unstale":"2024-09-12T05:20:21.817425+0000","last_undegraded":"2024-09-12T05:20:21.817425+0000","last_fullsized":"2024-09-12T05:20:21.817425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:00.177441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087905899999999996,"stat_sum":{"num_bytes":549698,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":35,"num_read_kb":77,"num_write":10,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"34'31","reported_seq":244,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.904008+0000","last_change":"2024-09-12T05:20:11.763552+0000","last_active":"2024-09-12T05:20:21.904008+0000","last_peered":"2024-09-12T05:20:21.904008+0000","last_clean":"2024-09-12T05:20:21.904008+0000","last_became_active":"2024-09-12T05:20:09.757210+0000","last_became_peered":"2024-09-12T05:20:09.757210+0000","last_unstale":"2024-09-12T05:20:21.904008+0000","last_undegraded":"2024-09-12T05:20:21.904008+0000","last_fullsized":"2024-09-12T05:20:21.904008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:11.450203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040909680000000004,"stat_sum":{"num_bytes":6700049,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":188,"num_read_kb":246,"num_write":28,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"34'78","reported_seq":671,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.987693+0000","last_change":"2024-09-12T05:20:11.747238+0000","last_active":"2024-09-12T05:20:21.987693+0000","last_peered":"2024-09-12T05:20:21.987693+0000","last_clean":"2024-09-12T05:20:21.987693+0000","last_became_active":"2024-09-12T05:20:09.748122+0000","last_became_peered":"2024-09-12T05:20:09.748122+0000","last_unstale":"2024-09-12T05:20:21.987693+0000","last_undegraded":"2024-09-12T05:20:21.987693+0000","last_fullsized":"2024-09-12T05:20:21.987693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:25.341409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014130220000000001,"stat_sum":{"num_bytes":655379,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":1342,"num_read_kb":1186,"num_write":74,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"34'46","reported_seq":357,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.997770+0000","last_change":"2024-09-12T05:20:11.741831+0000","last_active":"2024-09-12T05:20:21.997770+0000","last_peered":"2024-09-12T05:20:21.997770+0000","last_clean":"2024-09-12T05:20:21.997770+0000","last_became_active":"2024-09-12T05:20:09.736422+0000","last_became_peered":"2024-09-12T05:20:09.736422+0000","last_unstale":"2024-09-12T05:20:21.997770+0000","last_undegraded":"2024-09-12T05:20:21.997770+0000","last_fullsized":"2024-09-12T05:20:21.997770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:37.218648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001296167,"stat_sum":{"num_bytes":2228224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":1048,"num_write":46,"num_write_kb":1911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"33'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.818390+0000","last_change":"2024-09-12T05:20:11.786941+0000","last_active":"2024-09-12T05:20:21.818390+0000","last_peered":"2024-09-12T05:20:21.818390+0000","last_clean":"2024-09-12T05:20:21.818390+0000","last_became_active":"2024-09-12T05:20:09.740953+0000","last_became_peered":"2024-09-12T05:20:09.740953+0000","last_unstale":"2024-09-12T05:20:21.818390+0000","last_undegraded":"2024-09-12T05:20:21.818390+0000","last_fullsized":"2024-09-12T05:20:21.818390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:26.341039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085336099999999996,"stat_sum":{"num_bytes":221556,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":6,"num_write":4,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'41","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.934860+0000","last_change":"2024-09-12T05:20:11.763561+0000","last_active":"2024-09-12T05:20:21.934860+0000","last_peered":"2024-09-12T05:20:21.934860+0000","last_clean":"2024-09-12T05:20:21.934860+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:20:21.934860+0000","last_undegraded":"2024-09-12T05:20:21.934860+0000","last_fullsized":"2024-09-12T05:20:21.934860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:22.867563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041487850000000003,"stat_sum":{"num_bytes":393262,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":121,"num_read_kb":89,"num_write":50,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.817538+0000","last_change":"2024-09-12T05:20:11.737024+0000","last_active":"2024-09-12T05:20:21.817538+0000","last_peered":"2024-09-12T05:20:21.817538+0000","last_clean":"2024-09-12T05:20:21.817538+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:20:21.817538+0000","last_undegraded":"2024-09-12T05:20:21.817538+0000","last_fullsized":"2024-09-12T05:20:21.817538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:20.094057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015614439999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"34'21","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.824849+0000","last_change":"2024-09-12T05:20:11.785121+0000","last_active":"2024-09-12T05:20:21.824849+0000","last_peered":"2024-09-12T05:20:21.824849+0000","last_clean":"2024-09-12T05:20:21.824849+0000","last_became_active":"2024-09-12T05:20:09.749618+0000","last_became_peered":"2024-09-12T05:20:09.749618+0000","last_unstale":"2024-09-12T05:20:21.824849+0000","last_undegraded":"2024-09-12T05:20:21.824849+0000","last_fullsized":"2024-09-12T05:20:21.824849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:56.719777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000920377,"stat_sum":{"num_bytes":131072,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":20,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"34'74","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:22.025293+0000","last_change":"2024-09-12T05:20:11.747630+0000","last_active":"2024-09-12T05:20:22.025293+0000","last_peered":"2024-09-12T05:20:22.025293+0000","last_clean":"2024-09-12T05:20:22.025293+0000","last_became_active":"2024-09-12T05:20:09.751770+0000","last_became_peered":"2024-09-12T05:20:09.751770+0000","last_unstale":"2024-09-12T05:20:22.025293+0000","last_undegraded":"2024-09-12T05:20:22.025293+0000","last_fullsized":"2024-09-12T05:20:22.025293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:08.626161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013351109999999999,"stat_sum":{"num_bytes":10964696,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":417,"num_read_kb":2425,"num_write":70,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.825059+0000","last_change":"2024-09-12T05:20:10.739695+0000","last_active":"2024-09-12T05:20:21.825059+0000","last_peered":"2024-09-12T05:20:21.825059+0000","last_clean":"2024-09-12T05:20:21.825059+0000","last_became_active":"2024-09-12T05:20:10.738772+0000","last_became_peered":"2024-09-12T05:20:10.738772+0000","last_unstale":"2024-09-12T05:20:21.825059+0000","last_undegraded":"2024-09-12T05:20:21.825059+0000","last_fullsized":"2024-09-12T05:20:21.825059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:37:27.905397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"34'132","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.898592+0000","last_change":"2024-09-12T05:20:11.760826+0000","last_active":"2024-09-12T05:20:21.898592+0000","last_peered":"2024-09-12T05:20:21.898592+0000","last_clean":"2024-09-12T05:20:21.898592+0000","last_became_active":"2024-09-12T05:20:09.741300+0000","last_became_peered":"2024-09-12T05:20:09.741300+0000","last_unstale":"2024-09-12T05:20:21.898592+0000","last_undegraded":"2024-09-12T05:20:21.898592+0000","last_fullsized":"2024-09-12T05:20:21.898592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:03.501110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015825539999999999,"stat_sum":{"num_bytes":983089,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":621,"num_read_kb":521,"num_write":214,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.819327+0000","last_change":"2024-09-12T05:20:10.742188+0000","last_active":"2024-09-12T05:20:21.819327+0000","last_peered":"2024-09-12T05:20:21.819327+0000","last_clean":"2024-09-12T05:20:21.819327+0000","last_became_active":"2024-09-12T05:20:10.741090+0000","last_became_peered":"2024-09-12T05:20:10.741090+0000","last_unstale":"2024-09-12T05:20:21.819327+0000","last_undegraded":"2024-09-12T05:20:21.819327+0000","last_fullsized":"2024-09-12T05:20:21.819327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:01.606810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.818648+0000","last_change":"2024-09-12T05:20:11.787746+0000","last_active":"2024-09-12T05:20:21.818648+0000","last_peered":"2024-09-12T05:20:21.818648+0000","last_clean":"2024-09-12T05:20:21.818648+0000","last_became_active":"2024-09-12T05:20:09.747558+0000","last_became_peered":"2024-09-12T05:20:09.747558+0000","last_unstale":"2024-09-12T05:20:21.818648+0000","last_undegraded":"2024-09-12T05:20:21.818648+0000","last_fullsized":"2024-09-12T05:20:21.818648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:25.029477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001514325,"stat_sum":{"num_bytes":1429360,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":10,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.824909+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:20:21.824909+0000","last_peered":"2024-09-12T05:20:21.824909+0000","last_clean":"2024-09-12T05:20:21.824909+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:20:21.824909+0000","last_undegraded":"2024-09-12T05:20:21.824909+0000","last_fullsized":"2024-09-12T05:20:21.824909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"33'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.819184+0000","last_change":"2024-09-12T05:20:11.742399+0000","last_active":"2024-09-12T05:20:21.819184+0000","last_peered":"2024-09-12T05:20:21.819184+0000","last_clean":"2024-09-12T05:20:21.819184+0000","last_became_active":"2024-09-12T05:20:09.731594+0000","last_became_peered":"2024-09-12T05:20:09.731594+0000","last_unstale":"2024-09-12T05:20:21.819184+0000","last_undegraded":"2024-09-12T05:20:21.819184+0000","last_fullsized":"2024-09-12T05:20:21.819184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:57.171900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109662,"stat_sum":{"num_bytes":193496,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":3,"num_read":36,"num_read_kb":147,"num_write":24,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.819290+0000","last_change":"2024-09-12T05:20:01.939452+0000","last_active":"2024-09-12T05:20:21.819290+0000","last_peered":"2024-09-12T05:20:21.819290+0000","last_clean":"2024-09-12T05:20:21.819290+0000","last_became_active":"2024-09-12T05:19:59.911858+0000","last_became_peered":"2024-09-12T05:19:59.911858+0000","last_unstale":"2024-09-12T05:20:21.819290+0000","last_undegraded":"2024-09-12T05:20:21.819290+0000","last_fullsized":"2024-09-12T05:20:21.819290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:52.544225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'40","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.818007+0000","last_change":"2024-09-12T05:20:11.737386+0000","last_active":"2024-09-12T05:20:21.818007+0000","last_peered":"2024-09-12T05:20:21.818007+0000","last_clean":"2024-09-12T05:20:21.818007+0000","last_became_active":"2024-09-12T05:20:09.734285+0000","last_became_peered":"2024-09-12T05:20:09.734285+0000","last_unstale":"2024-09-12T05:20:21.818007+0000","last_undegraded":"2024-09-12T05:20:21.818007+0000","last_fullsized":"2024-09-12T05:20:21.818007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:15.267715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093432200000000002,"stat_sum":{"num_bytes":6347886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":276,"num_write":59,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"33'36","reported_seq":211,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.818960+0000","last_change":"2024-09-12T05:20:11.747323+0000","last_active":"2024-09-12T05:20:21.818960+0000","last_peered":"2024-09-12T05:20:21.818960+0000","last_clean":"2024-09-12T05:20:21.818960+0000","last_became_active":"2024-09-12T05:20:09.749854+0000","last_became_peered":"2024-09-12T05:20:09.749854+0000","last_unstale":"2024-09-12T05:20:21.818960+0000","last_undegraded":"2024-09-12T05:20:21.818960+0000","last_fullsized":"2024-09-12T05:20:21.818960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:19.834380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011274589999999999,"stat_sum":{"num_bytes":1889758,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":3,"num_read":147,"num_read_kb":55,"num_write":33,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.817412+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:20:21.817412+0000","last_peered":"2024-09-12T05:20:21.817412+0000","last_clean":"2024-09-12T05:20:21.817412+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:20:21.817412+0000","last_undegraded":"2024-09-12T05:20:21.817412+0000","last_fullsized":"2024-09-12T05:20:21.817412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'24","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.819059+0000","last_change":"2024-09-12T05:20:11.741593+0000","last_active":"2024-09-12T05:20:21.819059+0000","last_peered":"2024-09-12T05:20:21.819059+0000","last_clean":"2024-09-12T05:20:21.819059+0000","last_became_active":"2024-09-12T05:20:09.732988+0000","last_became_peered":"2024-09-12T05:20:09.732988+0000","last_unstale":"2024-09-12T05:20:21.819059+0000","last_undegraded":"2024-09-12T05:20:21.819059+0000","last_fullsized":"2024-09-12T05:20:21.819059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:06.337174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011707810000000001,"stat_sum":{"num_bytes":1784615,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":3,"num_read":153,"num_read_kb":19,"num_write":21,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.814807+0000","last_change":"2024-09-12T05:20:01.936885+0000","last_active":"2024-09-12T05:20:21.814807+0000","last_peered":"2024-09-12T05:20:21.814807+0000","last_clean":"2024-09-12T05:20:21.814807+0000","last_became_active":"2024-09-12T05:20:00.049870+0000","last_became_peered":"2024-09-12T05:20:00.049870+0000","last_unstale":"2024-09-12T05:20:21.814807+0000","last_undegraded":"2024-09-12T05:20:21.814807+0000","last_fullsized":"2024-09-12T05:20:21.814807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011022810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"34'174","reported_seq":366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.999355+0000","last_change":"2024-09-12T05:20:11.760952+0000","last_active":"2024-09-12T05:20:21.999355+0000","last_peered":"2024-09-12T05:20:21.999355+0000","last_clean":"2024-09-12T05:20:21.999355+0000","last_became_active":"2024-09-12T05:20:09.757484+0000","last_became_peered":"2024-09-12T05:20:09.757484+0000","last_unstale":"2024-09-12T05:20:21.999355+0000","last_undegraded":"2024-09-12T05:20:21.999355+0000","last_fullsized":"2024-09-12T05:20:21.999355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:52.812176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002046291,"stat_sum":{"num_bytes":2060011,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":899,"num_read_kb":630,"num_write":273,"num_write_kb":713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.824476+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:20:21.824476+0000","last_peered":"2024-09-12T05:20:21.824476+0000","last_clean":"2024-09-12T05:20:21.824476+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:20:21.824476+0000","last_undegraded":"2024-09-12T05:20:21.824476+0000","last_fullsized":"2024-09-12T05:20:21.824476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"34'30","reported_seq":232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.898809+0000","last_change":"2024-09-12T05:20:11.787268+0000","last_active":"2024-09-12T05:20:21.898809+0000","last_peered":"2024-09-12T05:20:21.898809+0000","last_clean":"2024-09-12T05:20:21.898809+0000","last_became_active":"2024-09-12T05:20:09.747825+0000","last_became_peered":"2024-09-12T05:20:09.747825+0000","last_unstale":"2024-09-12T05:20:21.898809+0000","last_undegraded":"2024-09-12T05:20:21.898809+0000","last_fullsized":"2024-09-12T05:20:21.898809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:12.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010361979999999999,"stat_sum":{"num_bytes":7276047,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":176,"num_read_kb":201,"num_write":30,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.817415+0000","last_change":"2024-09-12T05:20:01.936472+0000","last_active":"2024-09-12T05:20:21.817415+0000","last_peered":"2024-09-12T05:20:21.817415+0000","last_clean":"2024-09-12T05:20:21.817415+0000","last_became_active":"2024-09-12T05:19:59.915991+0000","last_became_peered":"2024-09-12T05:19:59.915991+0000","last_unstale":"2024-09-12T05:20:21.817415+0000","last_undegraded":"2024-09-12T05:20:21.817415+0000","last_fullsized":"2024-09-12T05:20:21.817415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:23.065491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.824477+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:20:21.824477+0000","last_peered":"2024-09-12T05:20:21.824477+0000","last_clean":"2024-09-12T05:20:21.824477+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:20:21.824477+0000","last_undegraded":"2024-09-12T05:20:21.824477+0000","last_fullsized":"2024-09-12T05:20:21.824477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"34'79","reported_seq":548,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.999922+0000","last_change":"2024-09-12T05:20:11.786966+0000","last_active":"2024-09-12T05:20:21.999922+0000","last_peered":"2024-09-12T05:20:21.999922+0000","last_clean":"2024-09-12T05:20:21.999922+0000","last_became_active":"2024-09-12T05:20:09.735109+0000","last_became_peered":"2024-09-12T05:20:09.735109+0000","last_unstale":"2024-09-12T05:20:21.999922+0000","last_undegraded":"2024-09-12T05:20:21.999922+0000","last_fullsized":"2024-09-12T05:20:21.999922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:27.386633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088249400000000005,"stat_sum":{"num_bytes":2305927,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":957,"num_read_kb":1713,"num_write":83,"num_write_kb":1940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"34'6","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.818718+0000","last_change":"2024-09-12T05:20:11.746609+0000","last_active":"2024-09-12T05:20:21.818718+0000","last_peered":"2024-09-12T05:20:21.818718+0000","last_clean":"2024-09-12T05:20:21.818718+0000","last_became_active":"2024-09-12T05:20:09.753860+0000","last_became_peered":"2024-09-12T05:20:09.753860+0000","last_unstale":"2024-09-12T05:20:21.818718+0000","last_undegraded":"2024-09-12T05:20:21.818718+0000","last_fullsized":"2024-09-12T05:20:21.818718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:42.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083728800000000005,"stat_sum":{"num_bytes":1342255,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":69,"num_read_kb":103,"num_write":5,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'27","reported_seq":208,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.845199+0000","last_change":"2024-09-12T05:20:11.746900+0000","last_active":"2024-09-12T05:20:21.845199+0000","last_peered":"2024-09-12T05:20:21.845199+0000","last_clean":"2024-09-12T05:20:21.845199+0000","last_became_active":"2024-09-12T05:20:10.739601+0000","last_became_peered":"2024-09-12T05:20:10.739601+0000","last_unstale":"2024-09-12T05:20:21.845199+0000","last_undegraded":"2024-09-12T05:20:21.845199+0000","last_fullsized":"2024-09-12T05:20:21.845199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:29.949259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001140198,"stat_sum":{"num_bytes":8192000,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":156,"num_read_kb":20,"num_write":25,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'13","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.899342+0000","last_change":"2024-09-12T05:20:11.787356+0000","last_active":"2024-09-12T05:20:21.899342+0000","last_peered":"2024-09-12T05:20:21.899342+0000","last_clean":"2024-09-12T05:20:21.899342+0000","last_became_active":"2024-09-12T05:20:09.741117+0000","last_became_peered":"2024-09-12T05:20:09.741117+0000","last_unstale":"2024-09-12T05:20:21.899342+0000","last_undegraded":"2024-09-12T05:20:21.899342+0000","last_fullsized":"2024-09-12T05:20:21.899342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:01.998026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011192330000000001,"stat_sum":{"num_bytes":1475412,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":2,"num_read":20,"num_read_kb":0,"num_write":13,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"34'19","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.817704+0000","last_change":"2024-09-12T05:20:11.736226+0000","last_active":"2024-09-12T05:20:21.817704+0000","last_peered":"2024-09-12T05:20:21.817704+0000","last_clean":"2024-09-12T05:20:21.817704+0000","last_became_active":"2024-09-12T05:20:09.734742+0000","last_became_peered":"2024-09-12T05:20:09.734742+0000","last_unstale":"2024-09-12T05:20:21.817704+0000","last_undegraded":"2024-09-12T05:20:21.817704+0000","last_fullsized":"2024-09-12T05:20:21.817704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:20.830232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085690600000000005,"stat_sum":{"num_bytes":655360,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":3,"num_read":6,"num_read_kb":0,"num_write":16,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"33'18","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.824616+0000","last_change":"2024-09-12T05:20:11.785456+0000","last_active":"2024-09-12T05:20:21.824616+0000","last_peered":"2024-09-12T05:20:21.824616+0000","last_clean":"2024-09-12T05:20:21.824616+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:20:21.824616+0000","last_undegraded":"2024-09-12T05:20:21.824616+0000","last_fullsized":"2024-09-12T05:20:21.824616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:13.262742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011734079999999999,"stat_sum":{"num_bytes":782847,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":3,"num_read":9,"num_read_kb":33,"num_write":15,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"33'21","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.825992+0000","last_change":"2024-09-12T05:20:11.785295+0000","last_active":"2024-09-12T05:20:21.825992+0000","last_peered":"2024-09-12T05:20:21.825992+0000","last_clean":"2024-09-12T05:20:21.825992+0000","last_became_active":"2024-09-12T05:20:09.756211+0000","last_became_peered":"2024-09-12T05:20:09.756211+0000","last_unstale":"2024-09-12T05:20:21.825992+0000","last_undegraded":"2024-09-12T05:20:21.825992+0000","last_fullsized":"2024-09-12T05:20:21.825992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:52.641095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010563930000000001,"stat_sum":{"num_bytes":2819912,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":161,"num_read_kb":1227,"num_write":21,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.934433+0000","last_change":"2024-09-12T05:20:11.785653+0000","last_active":"2024-09-12T05:20:21.934433+0000","last_peered":"2024-09-12T05:20:21.934433+0000","last_clean":"2024-09-12T05:20:21.934433+0000","last_became_active":"2024-09-12T05:20:09.756342+0000","last_became_peered":"2024-09-12T05:20:09.756342+0000","last_unstale":"2024-09-12T05:20:21.934433+0000","last_undegraded":"2024-09-12T05:20:21.934433+0000","last_fullsized":"2024-09-12T05:20:21.934433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:29.500618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072867899999999998,"stat_sum":{"num_bytes":352019,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":3,"num_read_kb":0,"num_write":8,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"33'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.898260+0000","last_change":"2024-09-12T05:20:11.760232+0000","last_active":"2024-09-12T05:20:21.898260+0000","last_peered":"2024-09-12T05:20:21.898260+0000","last_clean":"2024-09-12T05:20:21.898260+0000","last_became_active":"2024-09-12T05:20:10.740359+0000","last_became_peered":"2024-09-12T05:20:10.740359+0000","last_unstale":"2024-09-12T05:20:21.898260+0000","last_undegraded":"2024-09-12T05:20:21.898260+0000","last_fullsized":"2024-09-12T05:20:21.898260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:06.087305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387196,"stat_sum":{"num_bytes":4885439,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":20,"num_read_kb":0,"num_write":3,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"31'22","reported_seq":199,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.824628+0000","last_change":"2024-09-12T05:20:11.784843+0000","last_active":"2024-09-12T05:20:21.824628+0000","last_peered":"2024-09-12T05:20:21.824628+0000","last_clean":"2024-09-12T05:20:21.824628+0000","last_became_active":"2024-09-12T05:20:09.758738+0000","last_became_peered":"2024-09-12T05:20:09.758738+0000","last_unstale":"2024-09-12T05:20:21.824628+0000","last_undegraded":"2024-09-12T05:20:21.824628+0000","last_fullsized":"2024-09-12T05:20:21.824628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:37:38.007261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074458300000000005,"stat_sum":{"num_bytes":1078621,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":140,"num_read_kb":137,"num_write":21,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"34'25","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.840711+0000","last_change":"2024-09-12T05:20:11.760226+0000","last_active":"2024-09-12T05:20:21.840711+0000","last_peered":"2024-09-12T05:20:21.840711+0000","last_clean":"2024-09-12T05:20:21.840711+0000","last_became_active":"2024-09-12T05:20:09.743276+0000","last_became_peered":"2024-09-12T05:20:09.743276+0000","last_unstale":"2024-09-12T05:20:21.840711+0000","last_undegraded":"2024-09-12T05:20:21.840711+0000","last_fullsized":"2024-09-12T05:20:21.840711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:17.074253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347827,"stat_sum":{"num_bytes":3319627,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":289,"num_read_kb":226,"num_write":22,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"34'14","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T05:20:21.886193+0000","last_change":"2024-09-12T05:20:11.784970+0000","last_active":"2024-09-12T05:20:21.886193+0000","last_peered":"2024-09-12T05:20:21.886193+0000","last_clean":"2024-09-12T05:20:21.886193+0000","last_became_active":"2024-09-12T05:20:09.759997+0000","last_became_peered":"2024-09-12T05:20:09.759997+0000","last_unstale":"2024-09-12T05:20:21.886193+0000","last_undegraded":"2024-09-12T05:20:21.886193+0000","last_fullsized":"2024-09-12T05:20:21.886193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:22.132872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076674600000000001,"stat_sum":{"num_bytes":328983,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":3,"num_read":6,"num_read_kb":0,"num_write":11,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":82599554,"num_objects":138,"num_object_clones":28,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":45,"num_read":7442,"num_read_kb":11133,"num_write":1390,"num_write_kb":13848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10878976,"data_stored":10469978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1176,"ondisk_log_size":1176,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29816,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342024,"statfs":{"total":96636764160,"available":96606232576,"internally_reserved":0,"allocated":2850816,"data_stored":2571619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":0,"seq":60129542152,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1224704,"data_stored":937625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":2688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":2752512,"data_stored":2458882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29516,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342324,"statfs":{"total":96636764160,"available":96606539776,"internally_reserved":0,"allocated":2547712,"data_stored":2264988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":499712,"data_stored":259727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33252,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338588,"statfs":{"total":96636764160,"available":96602714112,"internally_reserved":0,"allocated":2113536,"data_stored":1857072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33508,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338332,"statfs":{"total":96636764160,"available":96602451968,"internally_reserved":0,"allocated":2371584,"data_stored":2094711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1449984,"data_stored":1384956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1818624,"data_stored":1775706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":116401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2269184,"data_stored":2190782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2437120,"data_stored":2357749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":880640,"data_stored":811060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1884160,"data_stored":1833324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:20:26.359 INFO:tasks.thrashosds.thrasher:Setting 3.d to [2, 0, 4, 6] 2024-09-12T05:20:26.359 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.d', '2', '0', '4', '6'] 2024-09-12T05:20:26.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.d 2 0 4 6 2024-09-12T05:20:26.362 INFO:teuthology.orchestra.run.smithi059.stdout:922 trunc from 0x57a9dce to 0x2b9fd62 2024-09-12T05:20:26.388 INFO:teuthology.orchestra.run.smithi059.stdout:923 trunc from 0x2b9fd62 to 0xaa90113 2024-09-12T05:20:26.410 INFO:teuthology.orchestra.run.smithi059.stdout:925 write 0xc9c02e0 thru 0xc9cf882 (0xf5a3 bytes) 2024-09-12T05:20:26.420 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:26.420 INFO:teuthology.orchestra.run.smithi059.stdout:928 writesame 0xc83f17e thru 0xc84922d data_size 0x6(0xa0b0 bytes) 2024-09-12T05:20:26.427 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:26.427 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:26.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:26.427 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:26.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.428 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3779 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.428 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:26.428 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.460722595, 2024-09-12T05:20:26.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015428234000000001, 2024-09-12T05:20:26.428 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.428 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.428 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3779 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:26.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969069+0000", 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969078+0000", 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2229999999999996e-06 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969089+0000", 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0536999999999999e-05 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969097+0000", 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7780000000000007e-06 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984386+0000", 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01528902 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984436+0000", 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0577e-05 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984497+0000", 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0386000000000001e-05 2024-09-12T05:20:26.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3780 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4606780969999997, 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015612325, 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3780 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969114+0000", 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8899999999999999e-07 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969117+0000", 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2090000000000001e-06 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969127+0000", 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0315e-05 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969135+0000", 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599999999999998e-06 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984543+0000", 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015407403 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984617+0000", 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4270999999999994e-05 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984725+0000", 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108278 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3781 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.460644158, 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792308999999998, 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.438 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3781 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969148+0000", 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8700000000000005e-07 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969151+0000", 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0120000000000001e-06 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969161+0000", 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0181e-05 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969179+0000", 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8057999999999999e-05 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985705+0000", 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016525623 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985800+0000", 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5298999999999997e-05 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985939+0000", 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013934900000000001 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.442 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3782 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5046272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4605995519999997, 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016995278999999999, 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3782 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1399999999999996e-07 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969196+0000", 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4350000000000001e-06 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969206+0000", 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0593e-05 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969214+0000", 2024-09-12T05:20:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6380000000000004e-06 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985979+0000", 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016764658000000002 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986091+0000", 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112662 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986187+0000", 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5579000000000001e-05 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3783 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4605658220000004, 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017209842, 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3783 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:26.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969226+0000", 2024-09-12T05:20:26.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:26.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969229+0000", 2024-09-12T05:20:26.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.585e-06 2024-09-12T05:20:26.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969265+0000", 2024-09-12T05:20:26.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5884999999999999e-05 2024-09-12T05:20:26.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969274+0000", 2024-09-12T05:20:26.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6070000000000008e-06 2024-09-12T05:20:26.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986237+0000", 2024-09-12T05:20:26.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016962755999999999 2024-09-12T05:20:26.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986323+0000", 2024-09-12T05:20:26.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5902000000000005e-05 2024-09-12T05:20:26.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986435+0000", 2024-09-12T05:20:26.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011246700000000001 2024-09-12T05:20:26.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.454 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.456 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3866 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.456 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:26.456 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4603072489999995, 2024-09-12T05:20:26.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017196439000000001, 2024-09-12T05:20:26.456 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3866 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:26.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:26.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0699999999999997e-07 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969488+0000", 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1e-06 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969498+0000", 2024-09-12T05:20:26.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0468e-05 2024-09-12T05:20:26.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969505+0000", 2024-09-12T05:20:26.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.452e-06 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986467+0000", 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016961092000000001 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986563+0000", 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6010999999999999e-05 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986680+0000", 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011770899999999999 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3867 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4602730289999997, 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017352149000000001, 2024-09-12T05:20:26.462 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3867 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:26.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969519+0000", 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6700000000000003e-07 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969522+0000", 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.123e-06 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969532+0000", 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0112000000000001e-05 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969540+0000", 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986711+0000", 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017171285000000001 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986781+0000", 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0072000000000003e-05 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986870+0000", 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.468 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3868 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.468 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:26.468 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4602393459999998, 2024-09-12T05:20:26.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017560494999999999, 2024-09-12T05:20:26.468 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.468 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3868 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969553+0000", 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4200000000000005e-07 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969556+0000", 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9730000000000002e-06 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969566+0000", 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0387999999999999e-05 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969585+0000", 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8604e-05 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986945+0000", 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017360197000000001 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987016+0000", 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1130000000000005e-05 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987112+0000", 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6360999999999994e-05 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3869 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4601933679999997, 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017730589000000001, 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3869 2024-09-12T05:20:26.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969608+0000", 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4490000000000005e-06 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969619+0000", 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0781999999999999e-05 2024-09-12T05:20:26.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969636+0000", 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7218e-05 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987143+0000", 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017506799 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987247+0000", 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010446900000000001 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987328+0000", 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1100999999999995e-05 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3870 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.477 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4601425670000001, 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017855591000000001, 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3870 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5499999999999998e-07 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969653+0000", 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5499999999999999e-06 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969663+0000", 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.005e-05 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969670+0000", 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.43e-06 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987362+0000", 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017691521000000002 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987426+0000", 2024-09-12T05:20:26.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4204999999999999e-05 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987504+0000", 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.818e-05 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.482 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3871 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4601110940000002, 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018082318, 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3871 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969681+0000", 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969683+0000", 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6350000000000002e-06 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969693+0000", 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4169999999999998e-06 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969700+0000", 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1350000000000003e-06 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987538+0000", 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017838166999999999 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987609+0000", 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1316999999999995e-05 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987762+0000", 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015310200000000001 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3872 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7995392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4600815560000004, 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018277057999999999, 2024-09-12T05:20:26.487 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3872 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000002e-07 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969713+0000", 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5830000000000001e-06 2024-09-12T05:20:26.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969722+0000", 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2240000000000001e-06 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969752+0000", 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0142e-05 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987828+0000", 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018076297000000002 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987901+0000", 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2767000000000003e-05 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987987+0000", 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5474000000000002e-05 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3883 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6291456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.459964083, 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018349118000000001, 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.492 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3883 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:26.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969828+0000", 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7800000000000001e-07 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969839+0000", 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1779e-05 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969851+0000", 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1573000000000001e-05 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969859+0000", 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8320000000000006e-06 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988018+0000", 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018158819999999999 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988085+0000", 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7366000000000005e-05 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988176+0000", 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1169999999999996e-05 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.496 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3884 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7012352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4599198720000004, 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018487955, 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.497 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3884 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969872+0000", 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2500000000000005e-07 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969875+0000", 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3950000000000001e-06 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969885+0000", 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9399999999999997e-06 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969893+0000", 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4930000000000001e-06 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988206+0000", 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018312910000000002 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988276+0000", 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0198999999999997e-05 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988359+0000", 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3293000000000004e-05 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3885 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.459886419, 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019004607999999999, 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3885 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7400000000000003e-07 2024-09-12T05:20:26.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969908+0000", 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0529999999999998e-06 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969918+0000", 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.009e-05 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969939+0000", 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0797000000000001e-05 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988391+0000", 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018452177 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988462+0000", 2024-09-12T05:20:26.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0154999999999995e-05 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988909+0000", 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00044776199999999999 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3886 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7864320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:26.506 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4598383019999996, 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019129604000000001, 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3886 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969954+0000", 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8800000000000001e-07 2024-09-12T05:20:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969958+0000", 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.89e-06 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969971+0000", 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.376e-05 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969979+0000", 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0420000000000003e-06 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988959+0000", 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018980011000000001 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989027+0000", 2024-09-12T05:20:26.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7439000000000003e-05 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989082+0000", 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5574e-05 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3887 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.511 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4597987330000004, 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019321270000000001, 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3887 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969993+0000", 2024-09-12T05:20:26.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969996+0000", 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1870000000000001e-06 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970007+0000", 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0676000000000001e-05 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970016+0000", 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5019999999999998e-06 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989125+0000", 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019108750000000001 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989201+0000", 2024-09-12T05:20:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5852999999999994e-05 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989314+0000", 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112685 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3888 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4597506850000004, 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019523841, 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3888 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:26.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970041+0000", 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-07 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970045+0000", 2024-09-12T05:20:26.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5719999999999999e-06 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970056+0000", 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1107999999999999e-05 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970064+0000", 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0239999999999997e-06 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989388+0000", 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019324108 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989469+0000", 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0958000000000007e-05 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989564+0000", 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5422999999999998e-05 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3889 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4597161999999999, 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019700655000000001, 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.521 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3889 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970076+0000", 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6300000000000004e-07 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970087+0000", 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1449e-05 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970098+0000", 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.042e-05 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970106+0000", 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9209999999999992e-06 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989608+0000", 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019502562000000001 2024-09-12T05:20:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989680+0000", 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1762999999999997e-05 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989776+0000", 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5676999999999999e-05 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3890 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4596730009999996, 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019853272000000002, 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3890 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970119+0000", 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2900000000000003e-07 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970122+0000", 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7420000000000002e-06 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970131+0000", 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7909999999999999e-06 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970138+0000", 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8090000000000004e-06 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989808+0000", 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019669641000000002 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989880+0000", 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2606000000000002e-05 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989971+0000", 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0953999999999997e-05 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.530 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:26.531 INFO:teuthology.orchestra.run.smithi059.stdout:930 write 0x908ab56 thru 0x9098832 (0xdcdd bytes) 2024-09-12T05:20:26.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:26.534 INFO:teuthology.orchestra.run.smithi059.stdout:933 trunc from 0xc9cf883 to 0x8716081 2024-09-12T05:20:26.534 INFO:teuthology.orchestra.run.smithi059.stdout:934 punch from 0x6012b7d to 0x6015261, (0x26e4 bytes) 2024-09-12T05:20:26.534 INFO:teuthology.orchestra.run.smithi059.stdout:935 write 0x2604708 thru 0x2606815 (0x210e bytes) 2024-09-12T05:20:26.534 INFO:teuthology.orchestra.run.smithi059.stdout:936 write 0xc4a6fb2 thru 0xc4b2d6a (0xbdb9 bytes) 2024-09-12T05:20:26.535 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:26.535 INFO:teuthology.orchestra.run.smithi059.stdout:938 read 0x6434bd5 thru 0x6435f5d (0x1389 bytes) 2024-09-12T05:20:26.535 INFO:teuthology.orchestra.run.smithi059.stdout:939 punch from 0x951cd7b to 0x95233ce, (0x6653 bytes) 2024-09-12T05:20:26.535 INFO:teuthology.orchestra.run.smithi059.stdout:940 writesame 0xce9f325 thru 0xcea74fd data_size 0x1(0x81d9 bytes) 2024-09-12T05:20:26.535 INFO:teuthology.orchestra.run.smithi059.stdout:941 punch from 0xa6022a0 to 0xa6095b5, (0x7315 bytes) 2024-09-12T05:20:26.535 INFO:teuthology.orchestra.run.smithi059.stdout:942 read 0x5718657 thru 0x571cbef (0x4599 bytes) 2024-09-12T05:20:26.535 INFO:teuthology.orchestra.run.smithi059.stdout:943 write 0xba12f58 thru 0xba1c5ee (0x9697 bytes) 2024-09-12T05:20:26.535 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:26.534+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:26.543 INFO:teuthology.orchestra.run.smithi059.stdout:944 read 0x1f8f0d4 thru 0x1f931d9 (0x4106 bytes) 2024-09-12T05:20:26.543 INFO:teuthology.orchestra.run.smithi059.stdout:945 write 0x57252c9 thru 0x57274ce (0x2206 bytes) 2024-09-12T05:20:26.550 INFO:teuthology.orchestra.run.smithi059.stdout:946 punch from 0xa143e03 to 0xa1495c9, (0x57c6 bytes) 2024-09-12T05:20:26.550 INFO:teuthology.orchestra.run.smithi059.stdout:948 read 0xb4b1458 thru 0xb4bfaf4 (0xe69d bytes) 2024-09-12T05:20:26.550 INFO:teuthology.orchestra.run.smithi059.stdout:949 read 0xa3e29bb thru 0xa3e3b5a (0x11a0 bytes) 2024-09-12T05:20:26.550 INFO:teuthology.orchestra.run.smithi059.stdout:952 read 0xe92425 thru 0xe95cde (0x38ba bytes) 2024-09-12T05:20:26.564 INFO:teuthology.orchestra.run.smithi059.stdout:953 trunc from 0xcea74fe to 0x4316062 2024-09-12T05:20:26.615 INFO:teuthology.orchestra.run.smithi059.stdout:954 write 0xdcf2036 thru 0xdcf7919 (0x58e4 bytes) 2024-09-12T05:20:26.624 INFO:teuthology.orchestra.run.smithi059.stdout:958 read 0x56b5d9d thru 0x56bda2b (0x7c8f bytes) 2024-09-12T05:20:26.624 INFO:teuthology.orchestra.run.smithi059.stdout:961 read 0xc393928 thru 0xc39e2db (0xa9b4 bytes) 2024-09-12T05:20:26.624 INFO:teuthology.orchestra.run.smithi059.stdout:962 read 0x29830c6 thru 0x2991fc3 (0xeefe bytes) 2024-09-12T05:20:26.624 INFO:teuthology.orchestra.run.smithi059.stdout:964 clone 8 order 25 su 4194304 sc 7 2024-09-12T05:20:26.633 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:26.634+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:26.662 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:26.662 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:26.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:26.733 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:26.733+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:26.834 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:26.834 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:26.834 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:26.834 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:26.834 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:26.835 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:26.838+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:26.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:26.860 INFO:teuthology.orchestra.run.smithi059.stderr:set 3.d pg_upmap_items mapping to [2->0,4->6] 2024-09-12T05:20:26.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:20:26.936 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:26.933+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:26.989 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:26.989 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:26.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:26.989 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:26.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4266.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.0692336, 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045733270000000003, 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922956+0000", 2024-09-12T05:20:26.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922970+0000", 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3633e-05 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922991+0000", 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1449000000000001e-05 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923009+0000", 2024-09-12T05:20:26.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7929999999999999e-05 2024-09-12T05:20:26.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923095+0000", 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6026000000000006e-05 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923129+0000", 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4545000000000002e-05 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.927399+0000", 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042699849999999996 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.927529+0000", 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012922899999999999 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.0129280649999997, 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:26.995 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:20:26.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:26.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8553 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'44, mlcod=37'40)", 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1514325350000001, 2024-09-12T05:20:27.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048787479999999996, 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840757+0000", 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840761+0000", 2024-09-12T05:20:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0790000000000002e-06 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840771+0000", 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0151e-05 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840776+0000", 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9389999999999996e-06 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840826+0000", 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9521999999999998e-05 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840845+0000", 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9360000000000001e-05 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845590+0000", 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004744687 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845635+0000", 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5423999999999997e-05 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8554 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'45, mlcod=37'40)", 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.841359+0000", 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1508298969999999, 2024-09-12T05:20:27.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043049940000000004, 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.841359+0000", 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.841359+0000", 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.841360+0000", 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.61e-07 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.841364+0000", 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7700000000000001e-06 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.841375+0000", 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0278999999999999e-05 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.841380+0000", 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0159999999999999e-06 2024-09-12T05:20:27.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.841426+0000", 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6158000000000001e-05 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.841445+0000", 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9318999999999999e-05 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845638+0000", 2024-09-12T05:20:27.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041927589999999999 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845664+0000", 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6032000000000001e-05 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.1012957480000001, 2024-09-12T05:20:27.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:20:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:20:27.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:20:27.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:20:27.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:20:27.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:20:27.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8996 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'59, mlcod=37'55)", 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0435197599999999, 2024-09-12T05:20:27.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044970280000000001, 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948671+0000", 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4449999999999999e-06 2024-09-12T05:20:27.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948681+0000", 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0635000000000001e-05 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948702+0000", 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0383000000000001e-05 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948712+0000", 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0288e-05 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948771+0000", 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9338e-05 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948794+0000", 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2464e-05 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.953128+0000", 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043340710000000001 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.953166+0000", 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8404e-05 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9013 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'63, mlcod=37'59)", 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:27.023 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0227193189999999, 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051699299999999997, 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6400000000000002e-07 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969476+0000", 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0440000000000001e-06 2024-09-12T05:20:27.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969490+0000", 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3328e-05 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969497+0000", 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2559999999999996e-06 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969563+0000", 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5879999999999999e-05 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969589+0000", 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5972000000000001e-05 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974583+0000", 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049945379999999998 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974640+0000", 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6248000000000001e-05 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9885 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'109, mlcod=37'106)", 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.71935409100000003, 2024-09-12T05:20:27.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051369570000000002, 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272840+0000", 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1559999999999997e-06 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272848+0000", 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-06 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272853+0000", 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4569999999999998e-06 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272896+0000", 2024-09-12T05:20:27.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3441e-05 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272911+0000", 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4484000000000001e-05 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277923+0000", 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050118480000000002 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277972+0000", 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9174e-05 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.71859526399999996, 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:20:27.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9901 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'114, mlcod=37'110)", 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.69492511499999998, 2024-09-12T05:20:27.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048386820000000004, 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297265+0000", 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6700000000000003e-07 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297270+0000", 2024-09-12T05:20:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5759999999999996e-06 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297281+0000", 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1240000000000001e-05 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297288+0000", 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.472e-06 2024-09-12T05:20:27.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297350+0000", 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1625999999999996e-05 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297369+0000", 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9673e-05 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.302000+0000", 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046303610000000004 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.302103+0000", 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010296700000000001 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10139 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'147, mlcod=37'142)", 2024-09-12T05:20:27.043 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.55048735800000004, 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051775290000000002, 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441706+0000", 2024-09-12T05:20:27.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.985e-06 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441716+0000", 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3810000000000005e-06 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441722+0000", 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441772+0000", 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9465999999999997e-05 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441792+0000", 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0560999999999998e-05 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446825+0000", 2024-09-12T05:20:27.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050325259999999998 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446879+0000", 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999999e-05 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10140 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'148, mlcod=37'142)", 2024-09-12T05:20:27.048 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.54982577600000004, 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045454459999999999, 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442364+0000", 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7700000000000004e-07 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442368+0000", 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8970000000000001e-06 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442376+0000", 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5259999999999993e-06 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442382+0000", 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9850000000000003e-06 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442431+0000", 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9076000000000002e-05 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442451+0000", 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9782000000000001e-05 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446883+0000", 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044323740000000002 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446909+0000", 2024-09-12T05:20:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5228999999999998e-05 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.48455161699999999, 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:20:27.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10192 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'159, mlcod=37'154)", 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.483798177, 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048454229999999997, 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508396+0000", 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9219999999999996e-06 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508407+0000", 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0902e-05 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508414+0000", 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8920000000000003e-06 2024-09-12T05:20:27.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508463+0000", 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8829999999999998e-05 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508484+0000", 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.143e-05 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513207+0000", 2024-09-12T05:20:27.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047223289999999999 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513236+0000", 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9403e-05 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10194 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'161, mlcod=37'155)", 2024-09-12T05:20:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.48209883599999998, 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047649629999999997, 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510091+0000", 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8999999999999996e-07 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510096+0000", 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3859999999999998e-06 2024-09-12T05:20:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510109+0000", 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2498e-05 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510115+0000", 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6950000000000003e-06 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510170+0000", 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4752e-05 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510193+0000", 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2572e-05 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.514813+0000", 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046198120000000001 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.514855+0000", 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2558000000000001e-05 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10212 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'166, mlcod=37'162)", 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.45665263900000003, 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004931403, 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535537+0000", 2024-09-12T05:20:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5799999999999999e-07 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535542+0000", 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0159999999999999e-06 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535554+0000", 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2199e-05 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535564+0000", 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7070000000000004e-06 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535606+0000", 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2391999999999997e-05 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535627+0000", 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0503e-05 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540427+0000", 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047999770000000004 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540468+0000", 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0951000000000001e-05 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10213 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'167, mlcod=37'162)", 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.536140+0000", 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.456049172, 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043516609999999997, 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.536140+0000", 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.536140+0000", 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.536140+0000", 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.536145+0000", 2024-09-12T05:20:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8369999999999996e-06 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.536157+0000", 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1562999999999999e-05 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.536164+0000", 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4359999999999996e-06 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.536211+0000", 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949000000000001e-05 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.536233+0000", 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1583e-05 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540470+0000", 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042373899999999997 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540491+0000", 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1279000000000001e-05 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.45442728599999999, 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:20:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:20:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10224 3.0 e37/23 3:058d4c61:::rbd_data.11182c6d9c71.00000000000000ae:head v 37'172, mlcod=37'169)", 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.549763+0000", 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44242619599999999, 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00438354, 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.549763+0000", 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.549763+0000", 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.549763+0000", 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3799999999999996e-07 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.549772+0000", 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9879999999999993e-06 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.549784+0000", 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1600000000000001e-05 2024-09-12T05:20:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.549792+0000", 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6599999999999995e-06 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.549847+0000", 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5424000000000003e-05 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.549870+0000", 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2753000000000001e-05 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.554103+0000", 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042332109999999997 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.554146+0000", 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3166e-05 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10236 3.9 e37/23 3:91b6a2ae:::rbd_data.11182c6d9c71.0000000000000179:head v 37'56, mlcod=37'54)", 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.417713318, 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047699020000000003, 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9100000000000003e-07 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574482+0000", 2024-09-12T05:20:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3519999999999997e-06 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574492+0000", 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0733999999999999e-05 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574498+0000", 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1410000000000004e-06 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574556+0000", 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8403000000000003e-05 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574579+0000", 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319000000000002e-05 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.579173+0000", 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045932000000000004 2024-09-12T05:20:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.579246+0000", 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2961999999999997e-05 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.089 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:27.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:27.091 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone7 2024-09-12T05:20:27.092 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:27.089+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:27.192 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:27.189+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:27.237 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:27.237 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:27.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:27.292 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:27.293+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:27.378 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:27.378 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:27.378 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:27.378 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:27.379 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:27.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:27.393 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:27.394+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:27.434 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-12T05:20:27.494 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:27.493+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:27.535 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:27.535 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:27.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:27.535 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11351 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 278528~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44749013100000001, 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040773482999999999, 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11351 2024-09-12T05:20:27.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7899999999999999e-07 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090442+0000", 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9319999999999999e-06 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090449+0000", 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.781e-06 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090454+0000", 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0440000000000003e-06 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.129625+0000", 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039171428000000001 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.129705+0000", 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0148999999999994e-05 2024-09-12T05:20:27.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131213+0000", 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015077700000000001 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11352 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44746890099999997, 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041165723000000001, 2024-09-12T05:20:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11352 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090463+0000", 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0150000000000002e-06 2024-09-12T05:20:27.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090470+0000", 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5760000000000002e-06 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090475+0000", 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7729999999999999e-06 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131246+0000", 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040771485000000003 2024-09-12T05:20:27.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131331+0000", 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5338000000000002e-05 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131627+0000", 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029515599999999998 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11353 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44744762599999999, 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041566055999999997, 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.545 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11353 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090483+0000", 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4499999999999997e-07 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090484+0000", 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9149999999999999e-06 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090491+0000", 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6170000000000003e-06 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090496+0000", 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.882e-06 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131659+0000", 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041163386000000003 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131740+0000", 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0575999999999996e-05 2024-09-12T05:20:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132048+0000", 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030823500000000002 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11354 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44742678899999999, 2024-09-12T05:20:27.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042063306000000002, 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11354 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090511+0000", 2024-09-12T05:20:27.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8199999999999997e-06 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090518+0000", 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9360000000000002e-06 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090523+0000", 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0490000000000003e-06 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132081+0000", 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041557747999999999 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132166+0000", 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4905000000000001e-05 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132566+0000", 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040041399999999998 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.553 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11355 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44739719500000003, 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042441325000000002, 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11355 2024-09-12T05:20:27.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090533+0000", 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090535+0000", 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.272e-06 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090542+0000", 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0219999999999999e-06 2024-09-12T05:20:27.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090547+0000", 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4710000000000001e-06 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132604+0000", 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042057223999999997 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132696+0000", 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1596999999999997e-05 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132974+0000", 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000278287 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11388 3.18 3:1c5f1393:::rbd_data.1118f6d14695.0000000000000004:9 [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:27.558 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44558144700000002, 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040980874, 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11388 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:27.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092349+0000", 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2899999999999999e-07 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092350+0000", 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.559e-06 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092357+0000", 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.148e-06 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092371+0000", 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4104000000000001e-05 2024-09-12T05:20:27.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133008+0000", 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040637083999999997 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133094+0000", 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5118999999999996e-05 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133329+0000", 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023553100000000001 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11389 3.18 3:1c5f1393:::rbd_data.1118f6d14695.0000000000000004:9 [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44554931800000003, 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041475895999999998, 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.563 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11389 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092381+0000", 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4700000000000002e-07 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092383+0000", 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7799999999999999e-06 2024-09-12T05:20:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092387+0000", 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4830000000000001e-06 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092390+0000", 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.101e-06 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133374+0000", 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040983693000000002 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133458+0000", 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4320000000000006e-05 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133856+0000", 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039817200000000002 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.567 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11390 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.445535656, 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041490103, 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.568 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11390 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5100000000000001e-07 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092396+0000", 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0600000000000002e-06 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092400+0000", 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.456e-06 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092402+0000", 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5799999999999999e-06 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133843+0000", 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041440799 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133884+0000", 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0957000000000001e-05 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11391 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44552378100000001, 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041529139999999999, 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.572 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11391 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2499999999999999e-07 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092407+0000", 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0780000000000001e-06 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092411+0000", 2024-09-12T05:20:27.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1389999999999997e-06 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092416+0000", 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1849999999999997e-06 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133925+0000", 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041509031000000002 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133935+0000", 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0482000000000001e-05 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11392 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44550750900000002, 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041566648999999997, 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11392 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092423+0000", 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092425+0000", 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0959999999999999e-06 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092431+0000", 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3199999999999996e-06 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092436+0000", 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6809999999999997e-06 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133967+0000", 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041531476999999997 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133989+0000", 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1691e-05 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11393 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44548606600000001, 2024-09-12T05:20:27.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041603366000000003, 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11393 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092446+0000", 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092454+0000", 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1450000000000002e-06 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092458+0000", 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.95e-06 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134037+0000", 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041578089999999998 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134047+0000", 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0404999999999999e-05 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11415 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.584 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44532192300000001, 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041482690000000003, 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11415 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.96e-07 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092610+0000", 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.874e-06 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092617+0000", 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.374e-06 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092623+0000", 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:20:27.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134081+0000", 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041458288000000003 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134090+0000", 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4350000000000003e-06 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11416 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44529996799999999, 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041499819, 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11416 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092632+0000", 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9800000000000001e-06 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092638+0000", 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.207e-06 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092643+0000", 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5820000000000003e-06 2024-09-12T05:20:27.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134121+0000", 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041477953999999997 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134130+0000", 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7159999999999992e-06 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11417 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44528008099999999, 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041510551, 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11417 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.593 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:27.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092652+0000", 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8950000000000001e-06 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092658+0000", 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3749999999999999e-06 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092664+0000", 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9159999999999998e-06 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134154+0000", 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041489640000000001 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134160+0000", 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2859999999999996e-06 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11418 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44525841199999999, 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041515682999999998, 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11418 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092672+0000", 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9200000000000002e-07 2024-09-12T05:20:27.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092674+0000", 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9700000000000002e-06 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092681+0000", 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7030000000000006e-06 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092686+0000", 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9649999999999999e-06 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134180+0000", 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041493915999999999 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134187+0000", 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.737e-06 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11419 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.600 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.44523632899999999, 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041519681000000003, 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11419 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092694+0000", 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0600000000000001e-07 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092696+0000", 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.891e-06 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092702+0000", 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.314e-06 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092707+0000", 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6870000000000002e-06 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134206+0000", 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041499825999999997 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134213+0000", 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5570000000000001e-06 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11782 3.8 3:15cf90c5:::rbd_data.11182c6d9c71.000000000000000f:head [write 0~0] snapc a=[a] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.604 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.40044405900000002, 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039417731999999997, 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11782 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7800000000000002e-07 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137489+0000", 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4669999999999998e-06 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137496+0000", 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137501+0000", 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.135e-06 2024-09-12T05:20:27.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173249+0000", 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035747202999999998 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173327+0000", 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8601000000000002e-05 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:27.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173486+0000", 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015863699999999999 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176556+0000", 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030699220000000001 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176819+0000", 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026288100000000002 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176867+0000", 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8786999999999999e-05 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176903+0000", 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5923000000000001e-05 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11833 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 663552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.39822681399999998, 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039526073000000002, 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11833 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.82e-07 2024-09-12T05:20:27.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139706+0000", 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3609999999999999e-06 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139715+0000", 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1970000000000002e-06 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139720+0000", 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2549999999999997e-06 2024-09-12T05:20:27.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.178847+0000", 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039127126999999998 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.178942+0000", 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4652000000000001e-05 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179229+0000", 2024-09-12T05:20:27.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028699900000000002 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11834 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 712704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.39820200300000003, 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039912229, 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.615 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11834 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139730+0000", 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.322e-06 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139737+0000", 2024-09-12T05:20:27.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3799999999999999e-06 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139742+0000", 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9609999999999996e-06 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179273+0000", 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039530869000000003 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179361+0000", 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8683000000000005e-05 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179640+0000", 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027860199999999997 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11835 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:27.619 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.39817988199999998, 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040348751000000002, 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11835 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:27.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139753+0000", 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.497e-06 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139760+0000", 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4749999999999996e-06 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139766+0000", 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179687+0000", 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039921449999999997 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179784+0000", 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6669000000000006e-05 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.180099+0000", 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031458700000000002 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.623 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:27.624 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:27.624 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:27.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:27.627 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:27.628 INFO:teuthology.orchestra.run.smithi059.stdout:965 writesame 0x3bdf78d thru 0x3bed3ce data_size 0x2(0xdc42 bytes) 2024-09-12T05:20:27.628 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:27.626+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:27.668 INFO:teuthology.orchestra.run.smithi059.stdout:967 read 0xb64a760 thru 0xb658a5f (0xe300 bytes) 2024-09-12T05:20:27.668 INFO:teuthology.orchestra.run.smithi059.stdout:969 read 0x72cea85 thru 0x72d0009 (0x1585 bytes) 2024-09-12T05:20:27.686 INFO:teuthology.orchestra.run.smithi059.stdout:971 trunc from 0xdcf791a to 0x394d560 2024-09-12T05:20:27.726 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:27.726+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:27.747 INFO:teuthology.orchestra.run.smithi059.stdout:972 punch from 0x2fd897f to 0x2fe6dbd, (0xe43e bytes) 2024-09-12T05:20:27.758 INFO:teuthology.orchestra.run.smithi059.stdout:974 write 0x3ac395e thru 0x3aceefb (0xb59e bytes) 2024-09-12T05:20:27.761 INFO:teuthology.orchestra.run.smithi059.stdout:976 punch from 0x849196 to 0x8527ab, (0x9615 bytes) 2024-09-12T05:20:27.761 INFO:teuthology.orchestra.run.smithi059.stdout:977 writesame 0x14b918a thru 0x14b934a data_size 0x1(0x1c1 bytes) 2024-09-12T05:20:27.764 INFO:teuthology.orchestra.run.smithi059.stdout:978 punch from 0x10edf0 to 0x11096e, (0x1b7e bytes) 2024-09-12T05:20:27.768 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:27.768 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:27.768 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:27.768 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:27.781 INFO:teuthology.orchestra.run.smithi059.stdout:979 trunc from 0x3aceefc to 0xc24c25d 2024-09-12T05:20:27.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:27.792 INFO:teuthology.orchestra.run.smithi059.stdout:981 read 0x73a6e19 thru 0x73b6cc3 (0xfeab bytes) 2024-09-12T05:20:27.792 INFO:teuthology.orchestra.run.smithi059.stdout:982 write 0x83be944 thru 0x83c23c3 (0x3a80 bytes) 2024-09-12T05:20:27.796 INFO:teuthology.orchestra.run.smithi059.stdout:984 writesame 0x6c18ca6 thru 0x6c19d85 data_size 0x8(0x10e0 bytes) 2024-09-12T05:20:27.809 INFO:teuthology.orchestra.run.smithi059.stdout:986 writesame 0xca781ac thru 0xca8380f data_size 0x12(0xb664 bytes) 2024-09-12T05:20:27.810 INFO:teuthology.orchestra.run.smithi059.stdout:988 write 0xbc98877 thru 0xbca72ca (0xea54 bytes) 2024-09-12T05:20:27.813 INFO:teuthology.orchestra.run.smithi059.stdout:989 read 0x7bf4022 thru 0x7c0196d (0xd94c bytes) 2024-09-12T05:20:27.813 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:27.813 INFO:teuthology.orchestra.run.smithi059.stdout:992 read 0xa9e19bc thru 0xa9e463b (0x2c80 bytes) 2024-09-12T05:20:27.814 INFO:teuthology.orchestra.run.smithi059.stdout:993 read 0x7390d45 thru 0x7396591 (0x584d bytes) 2024-09-12T05:20:27.814 INFO:teuthology.orchestra.run.smithi059.stdout:994 write 0x33eeb99 thru 0x33f046a (0x18d2 bytes) 2024-09-12T05:20:27.816 INFO:teuthology.orchestra.run.smithi059.stdout:995 punch from 0x2ae9919 to 0x2aead8b, (0x1472 bytes) 2024-09-12T05:20:27.816 INFO:teuthology.orchestra.run.smithi059.stdout:996 punch from 0x821b65 to 0x82fc23, (0xe0be bytes) 2024-09-12T05:20:27.827 INFO:teuthology.orchestra.run.smithi059.stdout:997 trunc from 0xca83810 to 0x55a6c5f 2024-09-12T05:20:27.827 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:27.830+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:27.837 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:27.837 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:27.840 INFO:teuthology.orchestra.run.smithi059.stdout:998 punch from 0x2395e3c to 0x239961f, (0x37e3 bytes) 2024-09-12T05:20:27.840 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:27.853 INFO:teuthology.orchestra.run.smithi059.stdout:1001 trunc from 0x55a6c5f to 0xea761a1 2024-09-12T05:20:27.855 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:27.855 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:27.860 INFO:teuthology.orchestra.run.smithi059.stdout:1002 write 0x174646 thru 0x17f1e7 (0xaba2 bytes) 2024-09-12T05:20:27.869 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:20:27.876 INFO:teuthology.orchestra.run.smithi059.stdout:1003 trunc from 0xea761a1 to 0x58c54b5 2024-09-12T05:20:27.878 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:27.878 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:27.903 INFO:teuthology.orchestra.run.smithi059.stdout:1004 trunc from 0x58c54b5 to 0xc333b05 2024-09-12T05:20:27.907 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:27.907 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:27.911 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:27.912 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:27.912 INFO:teuthology.orchestra.run.smithi059.stdout:1005 trunc from 0xc333b05 to 0xc2a9cae 2024-09-12T05:20:27.925 INFO:teuthology.orchestra.run.smithi059.stdout:1006 read 0x414f32f thru 0x4156c6c (0x793e bytes) 2024-09-12T05:20:27.925 INFO:teuthology.orchestra.run.smithi059.stdout:1007 read 0x1629ab5 thru 0x16308c7 (0x6e13 bytes) 2024-09-12T05:20:27.926 INFO:teuthology.orchestra.run.smithi059.stdout:1008 writesame 0xb63b25 thru 0xb70ca9 data_size 0x13(0xd185 bytes) 2024-09-12T05:20:27.928 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:27.929 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:27.930+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:27.930 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:27.930 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:27.930 INFO:teuthology.orchestra.run.smithi059.stdout:1009 read 0x22a7013 thru 0x22b49be (0xd9ac bytes) 2024-09-12T05:20:27.930 INFO:teuthology.orchestra.run.smithi059.stdout:1010 flatten 2024-09-12T05:20:27.938 INFO:teuthology.orchestra.run.smithi059.stdout:1011 punch from 0x5bf73d4 to 0x5c04945, (0xd571 bytes) 2024-09-12T05:20:27.939 INFO:teuthology.orchestra.run.smithi059.stdout:1012 trunc from 0xc2a9cae to 0xca8e4d4 2024-09-12T05:20:27.949 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:27.949 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:27.963 INFO:teuthology.orchestra.run.smithi059.stdout:1013 trunc from 0xca8e4d4 to 0x119e749 2024-09-12T05:20:27.969 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:27.969 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:27.979 INFO:teuthology.orchestra.run.smithi059.stdout:1014 read 0xd78c6c thru 0xd7ebf0 (0x5f85 bytes) 2024-09-12T05:20:27.988 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:27.989 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:27.993 INFO:teuthology.orchestra.run.smithi059.stdout:1015 writesame 0x50496d8 thru 0x504c760 data_size 0x23(0x3089 bytes) 2024-09-12T05:20:27.993 INFO:teuthology.orchestra.run.smithi059.stdout:1017 clone 9 order 21 su 1048576 sc 9 2024-09-12T05:20:28.051 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:28.054+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:28.052 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:28.052 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:28.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:28.130 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:28.134+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:28.189 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:28.189 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:28.203 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:28.232 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:28.234+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:28.325 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:28.326 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:28.333 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:28.334+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:28.339 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:28.433 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:28.434+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:28.461 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:28.462 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:28.475 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:28.534 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:28.534+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:28.597 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:28.597 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:28.612 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:28.634 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:28.638+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:28.730 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:28.731 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:28.735 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:28.738+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:28.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:28.836 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:28.838+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:28.864 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:28.864 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:28.878 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:28.937 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:28.937+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:29.005 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:29.006 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:29.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:29.038 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:29.042+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:29.117 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-12T05:20:29.140 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:29.142+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:29.187 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:29.187 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:29.201 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:29.241 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:29.242+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:29.330 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:29.330 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:29.342 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:29.341+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:29.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:29.443 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:29.446+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:29.476 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:29.477 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:29.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:29.583 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:29.586+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:29.613 INFO:teuthology.orchestra.run.smithi059.stdout:1019 read 0x2244f37 thru 0x22491c7 (0x4291 bytes) 2024-09-12T05:20:29.615 INFO:teuthology.orchestra.run.smithi059.stdout:1020 punch from 0x1ed228a to 0x1ed737a, (0x50f0 bytes) 2024-09-12T05:20:29.644 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:29.646+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:29.649 INFO:teuthology.orchestra.run.smithi059.stdout:1021 write 0xd3f6ef9 thru 0xd40169b (0xa7a3 bytes) 2024-09-12T05:20:29.660 INFO:teuthology.orchestra.run.smithi059.stdout:1022 write 0x4222180 thru 0x422f626 (0xd4a7 bytes) 2024-09-12T05:20:29.669 INFO:teuthology.orchestra.run.smithi059.stdout:1023 read 0x2579237 thru 0x2579aff (0x8c9 bytes) 2024-09-12T05:20:29.670 INFO:teuthology.orchestra.run.smithi059.stdout:1024 writesame 0x1d4e14 thru 0x1df09c data_size 0x1(0xa289 bytes) 2024-09-12T05:20:29.678 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:29.678 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:29.680 INFO:teuthology.orchestra.run.smithi059.stdout:1026 writesame 0x43db66e thru 0x43e7bef data_size 0x35(0xc582 bytes) 2024-09-12T05:20:29.689 INFO:teuthology.orchestra.run.smithi059.stdout:1028 write 0xa034df9 thru 0xa039b45 (0x4d4d bytes) 2024-09-12T05:20:29.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:29.698 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:29.698 INFO:teuthology.orchestra.run.smithi059.stdout:1031 write 0x25b17be thru 0x25b58cf (0x4112 bytes) 2024-09-12T05:20:29.706 INFO:teuthology.orchestra.run.smithi059.stdout:1032 read 0x527126f thru 0x527ffcf (0xed61 bytes) 2024-09-12T05:20:29.706 INFO:teuthology.orchestra.run.smithi059.stdout:1033 write 0x11e9cfb thru 0x11f4833 (0xab39 bytes) 2024-09-12T05:20:29.723 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:29.724 INFO:teuthology.orchestra.run.smithi059.stdout:1036 punch from 0x921f49c to 0x922ef1f, (0xfa83 bytes) 2024-09-12T05:20:29.724 INFO:teuthology.orchestra.run.smithi059.stdout:1037 write 0x2ef33aa thru 0x2f01786 (0xe3dd bytes) 2024-09-12T05:20:29.732 INFO:teuthology.orchestra.run.smithi059.stdout:1038 writesame 0x50ba24e thru 0x50c2918 data_size 0x1(0x86cb bytes) 2024-09-12T05:20:29.746 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:29.746+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:29.762 INFO:teuthology.orchestra.run.smithi059.stdout:1039 writesame 0x26f50ca thru 0x270482c data_size 0x1(0xf763 bytes) 2024-09-12T05:20:29.793 INFO:teuthology.orchestra.run.smithi059.stdout:1040 write 0x336ca3e thru 0x3379e3e (0xd401 bytes) 2024-09-12T05:20:29.802 INFO:teuthology.orchestra.run.smithi059.stdout:1041 write 0x629c731 thru 0x629f7ac (0x307c bytes) 2024-09-12T05:20:29.809 INFO:teuthology.orchestra.run.smithi059.stdout:1042 punch from 0x31f3b85 to 0x31f4196, (0x611 bytes) 2024-09-12T05:20:29.809 INFO:teuthology.orchestra.run.smithi059.stdout:1044 write 0x27949c1 thru 0x2795977 (0xfb7 bytes) 2024-09-12T05:20:29.813 INFO:teuthology.orchestra.run.smithi059.stdout:1047 write 0xcee49e6 thru 0xcef3b75 (0xf190 bytes) 2024-09-12T05:20:29.821 INFO:teuthology.orchestra.run.smithi059.stdout:1048 punch from 0x6a8842d to 0x6a9632a, (0xdefd bytes) 2024-09-12T05:20:29.821 INFO:teuthology.orchestra.run.smithi059.stdout:1051 read 0xac9f6ce thru 0xacaa278 (0xabab bytes) 2024-09-12T05:20:29.823 INFO:teuthology.orchestra.run.smithi059.stdout:1052 trunc from 0xd40169c to 0xc5ddbd0 2024-09-12T05:20:29.836 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:29.836 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:29.847 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:29.845+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:29.850 INFO:teuthology.orchestra.run.smithi059.stdout:1053 write 0x803c7ba thru 0x804b7ff (0xf046 bytes) 2024-09-12T05:20:29.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:29.857 INFO:teuthology.orchestra.run.smithi059.stdout:1054 write 0x12bf757 thru 0x12c11a9 (0x1a53 bytes) 2024-09-12T05:20:29.871 INFO:teuthology.orchestra.run.smithi059.stdout:1055 trunc from 0xc5ddbd0 to 0x822d113 2024-09-12T05:20:29.899 INFO:teuthology.orchestra.run.smithi059.stdout:1056 punch from 0x46a0556 to 0x46ad71c, (0xd1c6 bytes) 2024-09-12T05:20:29.899 INFO:teuthology.orchestra.run.smithi059.stdout:1057 punch from 0x79ea615 to 0x79f17be, (0x71a9 bytes) 2024-09-12T05:20:29.899 INFO:teuthology.orchestra.run.smithi059.stdout:1058 read 0x6858bcd thru 0x685fbc1 (0x6ff5 bytes) 2024-09-12T05:20:29.899 INFO:teuthology.orchestra.run.smithi059.stdout:1059 write 0x30fc738 thru 0x3107b76 (0xb43f bytes) 2024-09-12T05:20:29.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:20:29.907 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:29.929 INFO:teuthology.orchestra.run.smithi059.stdout:1062 write 0xeb8ec60 thru 0xeb99fb4 (0xb355 bytes) 2024-09-12T05:20:29.939 INFO:teuthology.orchestra.run.smithi059.stdout:1063 trunc from 0xeb99fb5 to 0xcabea4a 2024-09-12T05:20:29.948 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:29.949+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:29.963 INFO:teuthology.orchestra.run.smithi059.stdout:1064 read 0xb284fcf thru 0xb29309d (0xe0cf bytes) 2024-09-12T05:20:29.963 INFO:teuthology.orchestra.run.smithi059.stdout:1065 read 0xa7352f5 thru 0xa73ebaa (0x98b6 bytes) 2024-09-12T05:20:29.963 INFO:teuthology.orchestra.run.smithi059.stdout:1067 write 0x6fb3d6c thru 0x6fc37a1 (0xfa36 bytes) 2024-09-12T05:20:29.971 INFO:teuthology.orchestra.run.smithi059.stdout:1068 punch from 0xb6c9df8 to 0xb6cd406, (0x360e bytes) 2024-09-12T05:20:29.971 INFO:teuthology.orchestra.run.smithi059.stdout:1069 read 0x72a30aa thru 0x72ab1a5 (0x80fc bytes) 2024-09-12T05:20:29.971 INFO:teuthology.orchestra.run.smithi059.stdout:1070 punch from 0x4de393b to 0x4de8353, (0x4a18 bytes) 2024-09-12T05:20:29.971 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:29.971 INFO:teuthology.orchestra.run.smithi059.stdout:1072 read 0x7cb833a thru 0x7cb8d23 (0x9ea bytes) 2024-09-12T05:20:29.972 INFO:teuthology.orchestra.run.smithi059.stdout:1073 trunc from 0xcabea4a to 0xdc444ad 2024-09-12T05:20:29.984 INFO:teuthology.orchestra.run.smithi059.stdout:1074 read 0xec4d49 thru 0xec8186 (0x343e bytes) 2024-09-12T05:20:29.994 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:29.994 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:29.994 INFO:teuthology.orchestra.run.smithi059.stdout:1075 trunc from 0xdc444ad to 0x89734f3 2024-09-12T05:20:30.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:30.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:30.032 INFO:teuthology.orchestra.run.smithi059.stdout:1076 write 0xe9e3144 thru 0xe9edd17 (0xabd4 bytes) 2024-09-12T05:20:30.038 INFO:teuthology.orchestra.run.smithi059.stdout:1078 write 0xc09b07e thru 0xc0a4d55 (0x9cd8 bytes) 2024-09-12T05:20:30.049 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:30.049+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:30.068 INFO:teuthology.orchestra.run.smithi059.stdout:1079 trunc from 0xe9edd18 to 0x56d950 2024-09-12T05:20:30.150 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:30.150+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:30.153 INFO:teuthology.orchestra.run.smithi059.stdout:1080 writesame 0x8e07047 thru 0x8e14f5b data_size 0x17(0xdf15 bytes) 2024-09-12T05:20:30.153 INFO:teuthology.orchestra.run.smithi059.stdout:1083 clone 10 order 21 su 16384 sc 14 2024-09-12T05:20:30.167 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:30.168 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:30.173 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:30.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:30.190 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:30.190 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:30.208 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:30.225 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:30.245 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:30.246 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:30.251 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:30.249+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:30.266 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:30.288 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:30.289 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:30.308 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:30.308 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:30.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:30.309 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:30.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.309 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3779 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.309 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:30.309 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3416941179999995, 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015428234000000001, 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3779 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969069+0000", 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969078+0000", 2024-09-12T05:20:30.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2229999999999996e-06 2024-09-12T05:20:30.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969089+0000", 2024-09-12T05:20:30.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0536999999999999e-05 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969097+0000", 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7780000000000007e-06 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984386+0000", 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01528902 2024-09-12T05:20:30.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984436+0000", 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0577e-05 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984497+0000", 2024-09-12T05:20:30.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0386000000000001e-05 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3780 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3416496200000001, 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015612325, 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.315 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3780 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:30.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969114+0000", 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8899999999999999e-07 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969117+0000", 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2090000000000001e-06 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969127+0000", 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0315e-05 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969135+0000", 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599999999999998e-06 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984543+0000", 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015407403 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984617+0000", 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4270999999999994e-05 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984725+0000", 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108278 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3781 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.319 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:30.320 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3416156810000004, 2024-09-12T05:20:30.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792308999999998, 2024-09-12T05:20:30.320 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.320 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3781 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969148+0000", 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8700000000000005e-07 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969151+0000", 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0120000000000001e-06 2024-09-12T05:20:30.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969161+0000", 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0181e-05 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969179+0000", 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8057999999999999e-05 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985705+0000", 2024-09-12T05:20:30.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016525623 2024-09-12T05:20:30.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985800+0000", 2024-09-12T05:20:30.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5298999999999997e-05 2024-09-12T05:20:30.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985939+0000", 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013934900000000001 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.325 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3782 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5046272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3415710749999992, 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016995278999999999, 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.326 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3782 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:30.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1399999999999996e-07 2024-09-12T05:20:30.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969196+0000", 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4350000000000001e-06 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969206+0000", 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0593e-05 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969214+0000", 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6380000000000004e-06 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985979+0000", 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016764658000000002 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986091+0000", 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112662 2024-09-12T05:20:30.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986187+0000", 2024-09-12T05:20:30.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5579000000000001e-05 2024-09-12T05:20:30.332 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.332 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3783 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3415373450000008, 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017209842, 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.333 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3783 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:30.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969226+0000", 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969229+0000", 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.585e-06 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969265+0000", 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5884999999999999e-05 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969274+0000", 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6070000000000008e-06 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986237+0000", 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016962755999999999 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986323+0000", 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5902000000000005e-05 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986435+0000", 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011246700000000001 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3866 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3412787720000008, 2024-09-12T05:20:30.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017196439000000001, 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3866 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:30.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0699999999999997e-07 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969488+0000", 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1e-06 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969498+0000", 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0468e-05 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969505+0000", 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.452e-06 2024-09-12T05:20:30.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986467+0000", 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016961092000000001 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986563+0000", 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6010999999999999e-05 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986680+0000", 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011770899999999999 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3867 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3412445519999991, 2024-09-12T05:20:30.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017352149000000001, 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3867 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969519+0000", 2024-09-12T05:20:30.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6700000000000003e-07 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969522+0000", 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.123e-06 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969532+0000", 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0112000000000001e-05 2024-09-12T05:20:30.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969540+0000", 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986711+0000", 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017171285000000001 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986781+0000", 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0072000000000003e-05 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986870+0000", 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.350 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3868 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3412108689999993, 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017560494999999999, 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.351 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3868 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969553+0000", 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4200000000000005e-07 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969556+0000", 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9730000000000002e-06 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969566+0000", 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0387999999999999e-05 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969585+0000", 2024-09-12T05:20:30.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8604e-05 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986945+0000", 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017360197000000001 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987016+0000", 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1130000000000005e-05 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987112+0000", 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6360999999999994e-05 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3869 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:30.356 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.341164891, 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017730589000000001, 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3869 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969608+0000", 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4490000000000005e-06 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969619+0000", 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0781999999999999e-05 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969636+0000", 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7218e-05 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987143+0000", 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017506799 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987247+0000", 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010446900000000001 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987328+0000", 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1100999999999995e-05 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.361 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3870 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3411140899999996, 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017855591000000001, 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3870 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5499999999999998e-07 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969653+0000", 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5499999999999999e-06 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969663+0000", 2024-09-12T05:20:30.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.005e-05 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969670+0000", 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.43e-06 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987362+0000", 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017691521000000002 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987426+0000", 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4204999999999999e-05 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987504+0000", 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.818e-05 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3871 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3410826169999996, 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018082318, 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.367 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3871 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:30.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969681+0000", 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969683+0000", 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6350000000000002e-06 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969693+0000", 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4169999999999998e-06 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969700+0000", 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1350000000000003e-06 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987538+0000", 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017838166999999999 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987609+0000", 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1316999999999995e-05 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987762+0000", 2024-09-12T05:20:30.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015310200000000001 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3872 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7995392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3410530789999999, 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018277057999999999, 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3872 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000002e-07 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969713+0000", 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5830000000000001e-06 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969722+0000", 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2240000000000001e-06 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969752+0000", 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0142e-05 2024-09-12T05:20:30.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987828+0000", 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018076297000000002 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987901+0000", 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2767000000000003e-05 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987987+0000", 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5474000000000002e-05 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3883 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6291456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3409356060000004, 2024-09-12T05:20:30.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018349118000000001, 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3883 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969828+0000", 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7800000000000001e-07 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969839+0000", 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1779e-05 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969851+0000", 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1573000000000001e-05 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969859+0000", 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8320000000000006e-06 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988018+0000", 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018158819999999999 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988085+0000", 2024-09-12T05:20:30.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7366000000000005e-05 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988176+0000", 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1169999999999996e-05 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3884 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7012352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3408913949999999, 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018487955, 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3884 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969872+0000", 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2500000000000005e-07 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969875+0000", 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3950000000000001e-06 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969885+0000", 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9399999999999997e-06 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969893+0000", 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4930000000000001e-06 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988206+0000", 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018312910000000002 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988276+0000", 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0198999999999997e-05 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988359+0000", 2024-09-12T05:20:30.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3293000000000004e-05 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3885 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3408579419999995, 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019004607999999999, 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.388 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.389 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.389 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.389 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.389 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3885 2024-09-12T05:20:30.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.389 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7400000000000003e-07 2024-09-12T05:20:30.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969908+0000", 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0529999999999998e-06 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969918+0000", 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.009e-05 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969939+0000", 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0797000000000001e-05 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988391+0000", 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018452177 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988462+0000", 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0154999999999995e-05 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988909+0000", 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00044776199999999999 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3886 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7864320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3408098250000009, 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019129604000000001, 2024-09-12T05:20:30.393 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3886 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:30.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969954+0000", 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8800000000000001e-07 2024-09-12T05:20:30.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969958+0000", 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.89e-06 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969971+0000", 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.376e-05 2024-09-12T05:20:30.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969979+0000", 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0420000000000003e-06 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988959+0000", 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018980011000000001 2024-09-12T05:20:30.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989027+0000", 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7439000000000003e-05 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989082+0000", 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5574e-05 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.398 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3887 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3407702560000008, 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019321270000000001, 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.399 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3887 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969993+0000", 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969996+0000", 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1870000000000001e-06 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970007+0000", 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0676000000000001e-05 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970016+0000", 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5019999999999998e-06 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989125+0000", 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019108750000000001 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989201+0000", 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5852999999999994e-05 2024-09-12T05:20:30.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989314+0000", 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112685 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.404 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3888 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3407222080000007, 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019523841, 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3888 2024-09-12T05:20:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970041+0000", 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-07 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970045+0000", 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5719999999999999e-06 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970056+0000", 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1107999999999999e-05 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970064+0000", 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0239999999999997e-06 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989388+0000", 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019324108 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989469+0000", 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0958000000000007e-05 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989564+0000", 2024-09-12T05:20:30.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5422999999999998e-05 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3889 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3406877230000003, 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019700655000000001, 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3889 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:30.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970076+0000", 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6300000000000004e-07 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970087+0000", 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1449e-05 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970098+0000", 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.042e-05 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970106+0000", 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9209999999999992e-06 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989608+0000", 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019502562000000001 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989680+0000", 2024-09-12T05:20:30.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1762999999999997e-05 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989776+0000", 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5676999999999999e-05 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3890 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:30.415 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.340644524, 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019853272000000002, 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3890 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.416 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970119+0000", 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2900000000000003e-07 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970122+0000", 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7420000000000002e-06 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970131+0000", 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7909999999999999e-06 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970138+0000", 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8090000000000004e-06 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989808+0000", 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019669641000000002 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989880+0000", 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2606000000000002e-05 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989971+0000", 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0953999999999997e-05 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.421 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.421 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.421 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:30.422 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:30.422 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:30.423 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:30.424 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:30.421+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:30.523 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:30.521+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:30.598 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:30.598 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:30.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:30.624 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:30.625+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:30.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:30.725+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:30.739 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:30.739 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:30.739 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:30.739 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:30.739 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:30.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:30.826 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:30.825+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:30.884 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:30.884 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:30.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:30.884 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:30.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4266.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.962767841000002, 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045733270000000003, 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922956+0000", 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922970+0000", 2024-09-12T05:20:30.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3633e-05 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922991+0000", 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1449000000000001e-05 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923009+0000", 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7929999999999999e-05 2024-09-12T05:20:30.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923095+0000", 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6026000000000006e-05 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923129+0000", 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4545000000000002e-05 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.927399+0000", 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042699849999999996 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.927529+0000", 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012922899999999999 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:20:30.889 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.9064623059999999, 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8553 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'44, mlcod=37'40)", 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.0449667759999999, 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048787479999999996, 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.894 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840757+0000", 2024-09-12T05:20:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840761+0000", 2024-09-12T05:20:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0790000000000002e-06 2024-09-12T05:20:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840771+0000", 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0151e-05 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840776+0000", 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9389999999999996e-06 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840826+0000", 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9521999999999998e-05 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840845+0000", 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9360000000000001e-05 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845590+0000", 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004744687 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845635+0000", 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5423999999999997e-05 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9948299890000003, 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:20:30.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:20:30.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:20:30.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:20:30.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:20:30.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:20:30.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8996 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'59, mlcod=37'55)", 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9370540009999999, 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044970280000000001, 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.905 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948671+0000", 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4449999999999999e-06 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948681+0000", 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0635000000000001e-05 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948702+0000", 2024-09-12T05:20:30.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0383000000000001e-05 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948712+0000", 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0288e-05 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948771+0000", 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9338e-05 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948794+0000", 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2464e-05 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.953128+0000", 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043340710000000001 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.953166+0000", 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8404e-05 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.909 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9013 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'63, mlcod=37'59)", 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9162535600000004, 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051699299999999997, 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6400000000000002e-07 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969476+0000", 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0440000000000001e-06 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969490+0000", 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3328e-05 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969497+0000", 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2559999999999996e-06 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969563+0000", 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5879999999999999e-05 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969589+0000", 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5972000000000001e-05 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974583+0000", 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049945379999999998 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974640+0000", 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6248000000000001e-05 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9885 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'109, mlcod=37'106)", 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:30.914 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.6128883319999998, 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051369570000000002, 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272840+0000", 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1559999999999997e-06 2024-09-12T05:20:30.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272848+0000", 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-06 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272853+0000", 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4569999999999998e-06 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272896+0000", 2024-09-12T05:20:30.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3441e-05 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272911+0000", 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4484000000000001e-05 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277923+0000", 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050118480000000002 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277972+0000", 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9174e-05 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.6121295050000004, 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.919 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:30.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:20:30.923 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9901 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'114, mlcod=37'110)", 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.5884593559999995, 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048386820000000004, 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297265+0000", 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6700000000000003e-07 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297270+0000", 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5759999999999996e-06 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297281+0000", 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1240000000000001e-05 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297288+0000", 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.472e-06 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297350+0000", 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1625999999999996e-05 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297369+0000", 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9673e-05 2024-09-12T05:20:30.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.302000+0000", 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046303610000000004 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.302103+0000", 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010296700000000001 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.928 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10139 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'147, mlcod=37'142)", 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.444021599, 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051775290000000002, 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441706+0000", 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.985e-06 2024-09-12T05:20:30.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441716+0000", 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3810000000000005e-06 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441722+0000", 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441772+0000", 2024-09-12T05:20:30.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9465999999999997e-05 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441792+0000", 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0560999999999998e-05 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446825+0000", 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050325259999999998 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446879+0000", 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999999e-05 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10140 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'148, mlcod=37'142)", 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4433600169999998, 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045454459999999999, 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442364+0000", 2024-09-12T05:20:30.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7700000000000004e-07 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442368+0000", 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8970000000000001e-06 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442376+0000", 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5259999999999993e-06 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442382+0000", 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9850000000000003e-06 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442431+0000", 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9076000000000002e-05 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442451+0000", 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9782000000000001e-05 2024-09-12T05:20:30.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446883+0000", 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044323740000000002 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446909+0000", 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5228999999999998e-05 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3780858580000004, 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10192 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'159, mlcod=37'154)", 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3773324179999999, 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048454229999999997, 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.942 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508396+0000", 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9219999999999996e-06 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508407+0000", 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0902e-05 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508414+0000", 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8920000000000003e-06 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508463+0000", 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8829999999999998e-05 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508484+0000", 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.143e-05 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513207+0000", 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047223289999999999 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513236+0000", 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9403e-05 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.947 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10194 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'161, mlcod=37'155)", 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3756330769999998, 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047649629999999997, 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:30.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510091+0000", 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8999999999999996e-07 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510096+0000", 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3859999999999998e-06 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510109+0000", 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2498e-05 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510115+0000", 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6950000000000003e-06 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510170+0000", 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4752e-05 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510193+0000", 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2572e-05 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.514813+0000", 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046198120000000001 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.514855+0000", 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2558000000000001e-05 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10212 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'166, mlcod=37'162)", 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3501868799999999, 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004931403, 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.952 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535537+0000", 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5799999999999999e-07 2024-09-12T05:20:30.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535542+0000", 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0159999999999999e-06 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535554+0000", 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2199e-05 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535564+0000", 2024-09-12T05:20:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7070000000000004e-06 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535606+0000", 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2391999999999997e-05 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535627+0000", 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0503e-05 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540427+0000", 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047999770000000004 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540468+0000", 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0951000000000001e-05 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:20:30.956 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3479615269999998, 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:20:30.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:20:30.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10236 3.9 e37/23 3:91b6a2ae:::rbd_data.11182c6d9c71.0000000000000179:head v 37'56, mlcod=37'54)", 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:30.961 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3112475589999999, 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047699020000000003, 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9100000000000003e-07 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574482+0000", 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3519999999999997e-06 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574492+0000", 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0733999999999999e-05 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574498+0000", 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1410000000000004e-06 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574556+0000", 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8403000000000003e-05 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574579+0000", 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319000000000002e-05 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.579173+0000", 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045932000000000004 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.579246+0000", 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2961999999999997e-05 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.965 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.785873746, 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:20:30.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.970 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.7839195280000002, 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:20:30.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:20:30.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11437 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'65, mlcod=38'62)", 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.7810384159999999, 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049658940000000002, 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:30.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:30.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104691+0000", 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0979999999999999e-06 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104702+0000", 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0611999999999999e-05 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104711+0000", 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107402+0000", 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026907889999999999 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107423+0000", 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1035000000000001e-05 2024-09-12T05:20:30.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109616+0000", 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021936870000000002 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109651+0000", 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4434999999999998e-05 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.980 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:30.981 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:30.981 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:30.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:20:30.984 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:30.981+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:31.049 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone9 2024-09-12T05:20:31.083 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:31.086+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:31.164 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:31.164 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:31.164 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:31.164 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:31.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:31.218 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-12T05:20:31.218 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:31.218+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:31.285 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:31.285+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:31.358 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:31.359 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:31.375 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:31.385 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:31.385+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:31.395 INFO:teuthology.orchestra.run.smithi059.stdout:1084 writesame 0x6068ce2 thru 0x6077b20 data_size 0x1(0xee3f bytes) 2024-09-12T05:20:31.457 INFO:teuthology.orchestra.run.smithi059.stdout:1085 writesame 0xe269a0a thru 0xe2757a3 data_size 0x7(0xbd9a bytes) 2024-09-12T05:20:31.458 INFO:teuthology.orchestra.run.smithi059.stdout:1086 writesame 0x67824c9 thru 0x6784ff2 data_size 0x41(0x2b2a bytes) 2024-09-12T05:20:31.469 INFO:teuthology.orchestra.run.smithi059.stdout:1087 read 0xcf1efc1 thru 0xcf2e562 (0xf5a2 bytes) 2024-09-12T05:20:31.469 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:31.469 INFO:teuthology.orchestra.run.smithi059.stdout:1089 read 0x6f2f7a8 thru 0x6f37571 (0x7dca bytes) 2024-09-12T05:20:31.470 INFO:teuthology.orchestra.run.smithi059.stdout:1090 write 0x7c6314e thru 0x7c68021 (0x4ed4 bytes) 2024-09-12T05:20:31.487 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:31.490+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:31.494 INFO:teuthology.orchestra.run.smithi059.stdout:1091 trunc from 0xe2757a4 to 0x6f4f175 2024-09-12T05:20:31.525 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:31.525 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:31.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:31.525 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:31.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.525 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11351 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 278528~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4357083990000001, 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040773482999999999, 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11351 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.526 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7899999999999999e-07 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090442+0000", 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9319999999999999e-06 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090449+0000", 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.781e-06 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090454+0000", 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0440000000000003e-06 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.129625+0000", 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039171428000000001 2024-09-12T05:20:31.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.129705+0000", 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0148999999999994e-05 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131213+0000", 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015077700000000001 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11352 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4356871690000004, 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041165723000000001, 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11352 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.531 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090463+0000", 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0150000000000002e-06 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090470+0000", 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5760000000000002e-06 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090475+0000", 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7729999999999999e-06 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131246+0000", 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040771485000000003 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131331+0000", 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5338000000000002e-05 2024-09-12T05:20:31.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131627+0000", 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029515599999999998 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11353 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:31.535 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4356658939999996, 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041566055999999997, 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11353 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090483+0000", 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4499999999999997e-07 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090484+0000", 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9149999999999999e-06 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090491+0000", 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6170000000000003e-06 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090496+0000", 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.882e-06 2024-09-12T05:20:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131659+0000", 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041163386000000003 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131740+0000", 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0575999999999996e-05 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132048+0000", 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030823500000000002 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11354 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4356450570000003, 2024-09-12T05:20:31.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042063306000000002, 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11354 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:31.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090511+0000", 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8199999999999997e-06 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090518+0000", 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9360000000000002e-06 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090523+0000", 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0490000000000003e-06 2024-09-12T05:20:31.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132081+0000", 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041557747999999999 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132166+0000", 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4905000000000001e-05 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132566+0000", 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040041399999999998 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11355 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4356154629999995, 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042441325000000002, 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.545 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11355 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090533+0000", 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090535+0000", 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.272e-06 2024-09-12T05:20:31.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090542+0000", 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0219999999999999e-06 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090547+0000", 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4710000000000001e-06 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132604+0000", 2024-09-12T05:20:31.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042057223999999997 2024-09-12T05:20:31.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132696+0000", 2024-09-12T05:20:31.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1596999999999997e-05 2024-09-12T05:20:31.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132974+0000", 2024-09-12T05:20:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000278287 2024-09-12T05:20:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11388 3.18 3:1c5f1393:::rbd_data.1118f6d14695.0000000000000004:9 [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4337997150000001, 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040980874, 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11388 2024-09-12T05:20:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092349+0000", 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2899999999999999e-07 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092350+0000", 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.559e-06 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092357+0000", 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.148e-06 2024-09-12T05:20:31.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092371+0000", 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4104000000000001e-05 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133008+0000", 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040637083999999997 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133094+0000", 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5118999999999996e-05 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133329+0000", 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023553100000000001 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11389 3.18 3:1c5f1393:::rbd_data.1118f6d14695.0000000000000004:9 [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:31.643 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4337675860000001, 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041475895999999998, 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11389 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092381+0000", 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4700000000000002e-07 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092383+0000", 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7799999999999999e-06 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092387+0000", 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4830000000000001e-06 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092390+0000", 2024-09-12T05:20:31.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.101e-06 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133374+0000", 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040983693000000002 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133458+0000", 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4320000000000006e-05 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133856+0000", 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039817200000000002 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11390 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4337539240000003, 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041490103, 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11390 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5100000000000001e-07 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092396+0000", 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0600000000000002e-06 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092400+0000", 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.456e-06 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092402+0000", 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5799999999999999e-06 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133843+0000", 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041440799 2024-09-12T05:20:31.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133884+0000", 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0957000000000001e-05 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11391 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4337420490000001, 2024-09-12T05:20:31.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041529139999999999, 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11391 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:31.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2499999999999999e-07 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092407+0000", 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0780000000000001e-06 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092411+0000", 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1389999999999997e-06 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092416+0000", 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1849999999999997e-06 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133925+0000", 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041509031000000002 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133935+0000", 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0482000000000001e-05 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.656 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11392 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4337257770000003, 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041566648999999997, 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11392 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092423+0000", 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092425+0000", 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0959999999999999e-06 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092431+0000", 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3199999999999996e-06 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092436+0000", 2024-09-12T05:20:31.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6809999999999997e-06 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133967+0000", 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041531476999999997 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133989+0000", 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1691e-05 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11393 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4337043339999997, 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041603366000000003, 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11393 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.661 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092446+0000", 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092454+0000", 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1450000000000002e-06 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092458+0000", 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.95e-06 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134037+0000", 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041578089999999998 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134047+0000", 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0404999999999999e-05 2024-09-12T05:20:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11415 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4335401909999996, 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041482690000000003, 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.665 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11415 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.96e-07 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092610+0000", 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.874e-06 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092617+0000", 2024-09-12T05:20:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.374e-06 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092623+0000", 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134081+0000", 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041458288000000003 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134090+0000", 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4350000000000003e-06 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11416 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4335182360000003, 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041499819, 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.669 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11416 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:31.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092632+0000", 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9800000000000001e-06 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092638+0000", 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.207e-06 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092643+0000", 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5820000000000003e-06 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134121+0000", 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041477953999999997 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134130+0000", 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7159999999999992e-06 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11417 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4334983489999997, 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041510551, 2024-09-12T05:20:31.673 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11417 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092652+0000", 2024-09-12T05:20:31.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8950000000000001e-06 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092658+0000", 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3749999999999999e-06 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092664+0000", 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9159999999999998e-06 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134154+0000", 2024-09-12T05:20:31.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041489640000000001 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134160+0000", 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2859999999999996e-06 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11418 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4334766800000001, 2024-09-12T05:20:31.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041515682999999998, 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11418 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:31.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092672+0000", 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9200000000000002e-07 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092674+0000", 2024-09-12T05:20:31.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9700000000000002e-06 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092681+0000", 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7030000000000006e-06 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092686+0000", 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9649999999999999e-06 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134180+0000", 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041493915999999999 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134187+0000", 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.737e-06 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11419 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.681 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4334545969999999, 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041519681000000003, 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11419 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092694+0000", 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0600000000000001e-07 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092696+0000", 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.891e-06 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092702+0000", 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.314e-06 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092707+0000", 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6870000000000002e-06 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134206+0000", 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041499825999999997 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134213+0000", 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5570000000000001e-06 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11782 3.8 3:15cf90c5:::rbd_data.11182c6d9c71.000000000000000f:head [write 0~0] snapc a=[a] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3886623269999996, 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039417731999999997, 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11782 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7800000000000002e-07 2024-09-12T05:20:31.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137489+0000", 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4669999999999998e-06 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137496+0000", 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137501+0000", 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.135e-06 2024-09-12T05:20:31.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173249+0000", 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035747202999999998 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173327+0000", 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8601000000000002e-05 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173486+0000", 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015863699999999999 2024-09-12T05:20:31.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176556+0000", 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030699220000000001 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176819+0000", 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026288100000000002 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176867+0000", 2024-09-12T05:20:31.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8786999999999999e-05 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176903+0000", 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5923000000000001e-05 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11833 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 663552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3864450819999998, 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039526073000000002, 2024-09-12T05:20:31.691 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11833 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.82e-07 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139706+0000", 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3609999999999999e-06 2024-09-12T05:20:31.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139715+0000", 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1970000000000002e-06 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139720+0000", 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2549999999999997e-06 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.178847+0000", 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039127126999999998 2024-09-12T05:20:31.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.178942+0000", 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4652000000000001e-05 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179229+0000", 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028699900000000002 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.695 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11834 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 712704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3864202710000004, 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039912229, 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11834 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139730+0000", 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.322e-06 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139737+0000", 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3799999999999999e-06 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139742+0000", 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9609999999999996e-06 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179273+0000", 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039530869000000003 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179361+0000", 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8683000000000005e-05 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179640+0000", 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027860199999999997 2024-09-12T05:20:31.699 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11835 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3863981499999998, 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040348751000000002, 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:31.700 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11835 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139753+0000", 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.497e-06 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139760+0000", 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4749999999999996e-06 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139766+0000", 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179687+0000", 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039921449999999997 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179784+0000", 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6669000000000006e-05 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:31.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.180099+0000", 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031458700000000002 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:31.704 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:31.706 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:31.707 INFO:teuthology.orchestra.run.smithi059.stdout:1092 read 0x3f93ae3 thru 0x3f97774 (0x3c92 bytes) 2024-09-12T05:20:31.707 INFO:teuthology.orchestra.run.smithi059.stdout:1093 writesame 0x386a630 thru 0x38771eb data_size 0x76(0xcbbc bytes) 2024-09-12T05:20:31.707 INFO:teuthology.orchestra.run.smithi059.stdout:1094 writesame 0x369bcd4 thru 0x36a46f5 data_size 0x1(0x8a22 bytes) 2024-09-12T05:20:31.707 INFO:teuthology.orchestra.run.smithi059.stdout:1095 trunc from 0x6f4f175 to 0xb6e2565 2024-09-12T05:20:31.707 INFO:teuthology.orchestra.run.smithi059.stdout:1096 punch from 0xa10df6 to 0xa1eeac, (0xe0b6 bytes) 2024-09-12T05:20:31.707 INFO:teuthology.orchestra.run.smithi059.stdout:1097 write 0xbf0db42 thru 0xbf1b775 (0xdc34 bytes) 2024-09-12T05:20:31.707 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:31.708 INFO:teuthology.orchestra.run.smithi059.stdout:1101 write 0xb586f47 thru 0xb596993 (0xfa4d bytes) 2024-09-12T05:20:31.708 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:31.708 INFO:teuthology.orchestra.run.smithi059.stdout:1103 punch from 0x78a1607 to 0x78af059, (0xda52 bytes) 2024-09-12T05:20:31.708 INFO:teuthology.orchestra.run.smithi059.stdout:1104 read 0x562dd51 thru 0x563d526 (0xf7d6 bytes) 2024-09-12T05:20:31.708 INFO:teuthology.orchestra.run.smithi059.stdout:1105 trunc from 0xbf1b776 to 0x2b8eadb 2024-09-12T05:20:31.708 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:31.706+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:31.773 INFO:teuthology.orchestra.run.smithi059.stdout:1106 writesame 0xe056220 thru 0xe05a749 data_size 0x27(0x452a bytes) 2024-09-12T05:20:31.773 INFO:teuthology.orchestra.run.smithi059.stdout:1107 write 0x988ac0f thru 0x98986e4 (0xdad6 bytes) 2024-09-12T05:20:31.792 INFO:teuthology.orchestra.run.smithi059.stdout:1108 read 0x892a7f9 thru 0x892b8cf (0x10d7 bytes) 2024-09-12T05:20:31.792 INFO:teuthology.orchestra.run.smithi059.stdout:1109 read 0xda56bd5 thru 0xda5bd81 (0x51ad bytes) 2024-09-12T05:20:31.793 INFO:teuthology.orchestra.run.smithi059.stdout:1110 writesame 0x7a51310 thru 0x7a5e310 data_size 0x1(0xd001 bytes) 2024-09-12T05:20:31.806 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:31.806+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:31.830 INFO:teuthology.orchestra.run.smithi059.stdout:1111 punch from 0xb0e16c9 to 0xb0e2776, (0x10ad bytes) 2024-09-12T05:20:31.847 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:31.847 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:31.847 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:31.847 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:31.857 INFO:teuthology.orchestra.run.smithi059.stdout:1112 trunc from 0xe05a74a to 0x3f926b5 2024-09-12T05:20:31.862 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:31.884 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:31.884 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:31.884 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-09-12T05:20:31.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 6 2024-09-12T05:20:31.888 INFO:teuthology.orchestra.run.smithi059.stdout:1113 read 0x3238e46 thru 0x323b811 (0x29cc bytes) 2024-09-12T05:20:31.912 INFO:teuthology.orchestra.run.smithi059.stdout:1115 write 0xa0ab903 thru 0xa0b9e32 (0xe530 bytes) 2024-09-12T05:20:31.912 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:31.914+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:31.926 INFO:teuthology.orchestra.run.smithi059.stdout:1117 read 0x33001ff thru 0x330302d (0x2e2f bytes) 2024-09-12T05:20:31.926 INFO:teuthology.orchestra.run.smithi059.stdout:1118 punch from 0xc7cb0e to 0xc86aed, (0x9fdf bytes) 2024-09-12T05:20:31.926 INFO:teuthology.orchestra.run.smithi059.stdout:1119 read 0x64ce2d7 thru 0x64d4a9c (0x67c6 bytes) 2024-09-12T05:20:31.927 INFO:teuthology.orchestra.run.smithi059.stdout:1120 punch from 0x2a6fd7c to 0x2a720d0, (0x2354 bytes) 2024-09-12T05:20:31.942 INFO:teuthology.orchestra.run.smithi059.stdout:1121 writesame 0xc7abb6c thru 0xc7b89b3 data_size 0xa4(0xce48 bytes) 2024-09-12T05:20:31.952 INFO:teuthology.orchestra.run.smithi059.stdout:1122 trunc from 0xc7b89b4 to 0x660aa72 2024-09-12T05:20:31.970 INFO:teuthology.orchestra.run.smithi059.stdout:1123 punch from 0x26339a9 to 0x263888d, (0x4ee4 bytes) 2024-09-12T05:20:31.970 INFO:teuthology.orchestra.run.smithi059.stdout:1124 read 0x2723b98 thru 0x27336c4 (0xfb2d bytes) 2024-09-12T05:20:31.988 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:31.988 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:31.988 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:31.988 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:31.988 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:31.989 INFO:teuthology.orchestra.run.smithi059.stdout:1125 write 0xa7d9f01 thru 0xa7e1fa5 (0x80a5 bytes) 2024-09-12T05:20:31.997 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:32.003 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:32.013 INFO:teuthology.orchestra.run.smithi059.stdout:1127 writesame 0xc4b40f0 thru 0xc4c3de5 data_size 0x56(0xfcf6 bytes) 2024-09-12T05:20:32.013 INFO:teuthology.orchestra.run.smithi059.stdout:1128 read 0xafa6930 thru 0xafb4cbf (0xe390 bytes) 2024-09-12T05:20:32.013 INFO:teuthology.orchestra.run.smithi059.stdout:1129 read 0x8cbfd9d thru 0x8cc6a08 (0x6c6c bytes) 2024-09-12T05:20:32.014 INFO:teuthology.orchestra.run.smithi059.stdout:1131 write 0x2f89d2f thru 0x2f95eb7 (0xc189 bytes) 2024-09-12T05:20:32.018 INFO:teuthology.orchestra.run.smithi059.stdout:1133 punch from 0x71293e3 to 0x712dcba, (0x48d7 bytes) 2024-09-12T05:20:32.019 INFO:teuthology.orchestra.run.smithi059.stdout:1134 write 0x2ed1c2e thru 0x2edf7e2 (0xdbb5 bytes) 2024-09-12T05:20:32.022 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:32.029 INFO:teuthology.orchestra.run.smithi059.stdout:1138 trunc from 0xc4c3de6 to 0x7fd910c 2024-09-12T05:20:32.041 INFO:teuthology.orchestra.run.smithi059.stdout:1139 clone 11 order 19 su 8192 sc 5 2024-09-12T05:20:32.048 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:32.049+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:32.109 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:32.109+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:32.128 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:32.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4630 3.1a 3:5ebba714:::rbd_data.1118e5842253.0000000000000077:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9907880819999999, 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039742162999999997, 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4630 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138451+0000", 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9570000000000001e-06 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138461+0000", 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9760000000000007e-06 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138489+0000", 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7742999999999998e-05 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138504+0000", 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4960000000000001e-05 2024-09-12T05:20:32.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138608+0000", 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104053 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138815+0000", 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000206832 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.145988+0000", 2024-09-12T05:20:32.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071735109999999996 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.177998+0000", 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032009700000000002 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178028+0000", 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0209000000000002e-05 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:32.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178118+0000", 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9365999999999998e-05 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178191+0000", 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3856000000000006e-05 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10843 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.056947+0000", 2024-09-12T05:20:32.134 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0722899569999997, 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029482554000000001, 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10843 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056947+0000", 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056947+0000", 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056949+0000", 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.53e-06 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056954+0000", 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8770000000000001e-06 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056975+0000", 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0985999999999999e-05 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056989+0000", 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.438e-05 2024-09-12T05:20:32.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.085647+0000", 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028658006999999999 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.085867+0000", 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021989899999999999 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.086430+0000", 2024-09-12T05:20:32.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056287500000000001 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10907 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.060847+0000", 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0683899739999996, 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029492616999999999, 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.139 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10907 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060847+0000", 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060847+0000", 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060849+0000", 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7570000000000001e-06 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060854+0000", 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2530000000000004e-06 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060872+0000", 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.789e-05 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060887+0000", 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4263999999999999e-05 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.089562+0000", 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028675407 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.089775+0000", 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021315900000000001 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.090340+0000", 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056488700000000003 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10967 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 294912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.060917+0000", 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0683204010000003, 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031039906999999999, 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10967 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060917+0000", 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060917+0000", 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060918+0000", 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2899999999999999e-06 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060924+0000", 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060942+0000", 2024-09-12T05:20:32.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8283000000000001e-05 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060955+0000", 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3196999999999999e-05 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.090417+0000", 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029461560000000001 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.090613+0000", 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019550700000000001 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.091957+0000", 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013443000000000001 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10968 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 344064~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.060977+0000", 2024-09-12T05:20:32.148 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0682608250000003, 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031831350000000001, 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10968 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060977+0000", 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060977+0000", 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060978+0000", 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.254e-06 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060983+0000", 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061001+0000", 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8357000000000001e-05 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061015+0000", 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3806e-05 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.092034+0000", 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031018885999999999 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.092249+0000", 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000215107 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.092808+0000", 2024-09-12T05:20:32.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00055870699999999998 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10969 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 393216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061034+0000", 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0682035350000003, 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032757221000000003, 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10969 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061034+0000", 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061034+0000", 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061035+0000", 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4300000000000001e-06 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061041+0000", 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4260000000000002e-06 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061058+0000", 2024-09-12T05:20:32.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7640000000000001e-05 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061072+0000", 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3557000000000001e-05 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.092884+0000", 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031811697999999999 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093153+0000", 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000269855 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093791+0000", 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063761500000000001 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10970 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0681474890000002, 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033399048000000001, 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10970 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061091+0000", 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1230000000000001e-06 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061096+0000", 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1000000000000003e-06 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061113+0000", 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7227e-05 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061127+0000", 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3793e-05 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093864+0000", 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032736994999999998 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094052+0000", 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018771799999999999 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094489+0000", 2024-09-12T05:20:32.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043709199999999998 2024-09-12T05:20:32.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.162 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.162 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10971 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.162 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.068092826, 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033948741999999997, 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10971 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061146+0000", 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.167e-06 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061151+0000", 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8899999999999998e-06 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061167+0000", 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6578999999999998e-05 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061181+0000", 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3587000000000001e-05 2024-09-12T05:20:32.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094538+0000", 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033357568999999997 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094672+0000", 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133323 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095093+0000", 2024-09-12T05:20:32.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042162699999999999 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11031 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 303104~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.067680019, 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034486665, 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11031 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:32.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061559+0000", 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061568+0000", 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5329999999999994e-06 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061598+0000", 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0395999999999998e-05 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061618+0000", 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000001e-05 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095169+0000", 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033551105999999997 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095379+0000", 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021028999999999999 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096044+0000", 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00066456000000000002 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11032 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 352256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.171 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0675874529999998, 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035279433999999998, 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11032 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061651+0000", 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.44e-06 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061658+0000", 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4529999999999999e-06 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061678+0000", 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0460000000000001e-05 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061693+0000", 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.468e-05 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096100+0000", 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034407364000000003 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096256+0000", 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015584799999999999 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096929+0000", 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067318900000000004 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.175 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11033 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 401408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0675234739999997, 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036054468999999999, 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.176 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11033 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061715+0000", 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061722+0000", 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5740000000000001e-06 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061741+0000", 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:32.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061754+0000", 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3257e-05 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096997+0000", 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035242809 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097165+0000", 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000168839 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097768+0000", 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00060290099999999998 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.180 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11034 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 450560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0674647940000002, 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036605824000000002, 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11034 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061774+0000", 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.13e-06 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061779+0000", 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9169999999999997e-06 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061797+0000", 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7995999999999998e-05 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061810+0000", 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3753e-05 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097821+0000", 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036010845 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097958+0000", 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137188 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098378+0000", 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041999499999999999 2024-09-12T05:20:32.184 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11035 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 499712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0674069050000004, 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037210007000000003, 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.185 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11035 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061832+0000", 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.243e-06 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061842+0000", 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0067e-05 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061860+0000", 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7923000000000001e-05 2024-09-12T05:20:32.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061873+0000", 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3277e-05 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098443+0000", 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036569628999999999 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098601+0000", 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015857800000000001 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099040+0000", 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043929 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11095 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 262144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071019+0000", 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0582183279999997, 2024-09-12T05:20:32.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029211827999999999, 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11095 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071019+0000", 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071019+0000", 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071022+0000", 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8370000000000001e-06 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071035+0000", 2024-09-12T05:20:32.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3606e-05 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071069+0000", 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3074000000000002e-05 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071087+0000", 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8657000000000001e-05 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099101+0000", 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028013672999999999 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099781+0000", 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068001800000000001 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100231+0000", 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000449963 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.193 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11096 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 311296~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071117+0000", 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0581203400000003, 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029594869999999999, 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.194 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11096 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071117+0000", 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071117+0000", 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071118+0000", 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071124+0000", 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0340000000000002e-06 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071143+0000", 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8794e-05 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071157+0000", 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3786e-05 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100318+0000", 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029161016000000001 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100407+0000", 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9411000000000002e-05 2024-09-12T05:20:32.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100712+0000", 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030446899999999997 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11097 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 360448~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071183+0000", 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0580546030000004, 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030088387000000001, 2024-09-12T05:20:32.198 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11097 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071183+0000", 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071183+0000", 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071184+0000", 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3939999999999999e-06 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071189+0000", 2024-09-12T05:20:32.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071224+0000", 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4897000000000001e-05 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071238+0000", 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3831e-05 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100755+0000", 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029516923 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100874+0000", 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119188 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101271+0000", 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039707099999999998 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11098 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 409600~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071258+0000", 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0579792499999998, 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030624607000000002, 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11098 2024-09-12T05:20:32.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071258+0000", 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071258+0000", 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071259+0000", 2024-09-12T05:20:32.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2860000000000001e-06 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071265+0000", 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1259999999999997e-06 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071282+0000", 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7538999999999999e-05 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071295+0000", 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101353+0000", 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030058449000000001 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101504+0000", 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015117799999999999 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101883+0000", 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037834300000000001 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11099 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 458752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071312+0000", 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0579253389999996, 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031176991000000001, 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.207 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11099 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071312+0000", 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071312+0000", 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071313+0000", 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.266e-06 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071318+0000", 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-12T05:20:32.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071335+0000", 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6934000000000001e-05 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071348+0000", 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2680000000000001e-05 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101932+0000", 2024-09-12T05:20:32.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030584094999999999 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102052+0000", 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000120365 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102489+0000", 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043673099999999999 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11100 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 507904~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071365+0000", 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0578726759999997, 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031595102999999999, 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11100 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.212 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071365+0000", 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071365+0000", 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071366+0000", 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1739999999999999e-06 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071371+0000", 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.809e-06 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071387+0000", 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6796999999999999e-05 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071400+0000", 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2687999999999999e-05 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102539+0000", 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031139314000000001 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102652+0000", 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112577 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102960+0000", 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030774399999999999 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11164 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 516096~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.077944+0000", 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0512932030000002, 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028937213999999999, 2024-09-12T05:20:32.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11164 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077944+0000", 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077944+0000", 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077945+0000", 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0049999999999999e-06 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077949+0000", 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.822e-06 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077962+0000", 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2628e-05 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077971+0000", 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6420000000000002e-06 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.106361+0000", 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028389761999999999 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.106515+0000", 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015405599999999999 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.106881+0000", 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000366299 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.221 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:32.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:32.223 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:32.222+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:32.226 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-12T05:20:32.226+0000 7f6402832640 -1 mon.a@0(leader).osd e41 definitely_dead 0 2024-09-12T05:20:32.323 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:32.326+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:32.390 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:32.390 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:32.390 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:32.390 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:32.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:32.424 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:32.426+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:32.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:32.523 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:32.523 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:32.523 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:32.523 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:32.524 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:32.525 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:32.526+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:32.537 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:32.582 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:32.582 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:32.598 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:32.615 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:32.615 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:32.626 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:32.625+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:32.631 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:32.632 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:32.652 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:32.653 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:32.657 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:32.657 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:32.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:32.657 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:32.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.657 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4530 3.1d 3:b845397b:::rbd_object_map.1118e5842253:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.758750794000001, 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034828258000000001, 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4530 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898325+0000", 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898333+0000", 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3200000000000002e-06 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898372+0000", 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9403000000000002e-05 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898403+0000", 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1282999999999998e-05 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925774+0000", 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027371126999999999 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925885+0000", 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110536 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.926372+0000", 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048729900000000001 2024-09-12T05:20:32.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.931755+0000", 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053824099999999998 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.932970+0000", 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012150799999999999 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:32.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933079+0000", 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108736 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933152+0000", 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3910000000000002e-05 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10924 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 278528~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062093+0000", 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5949823649999999, 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033766996000000001, 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10924 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.664 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062093+0000", 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062093+0000", 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062094+0000", 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.173e-06 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062099+0000", 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1970000000000004e-06 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062117+0000", 2024-09-12T05:20:32.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8332999999999999e-05 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062131+0000", 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4167e-05 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095052+0000", 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032920387000000002 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095258+0000", 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020573299999999999 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095860+0000", 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00060200599999999998 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5949251289999999, 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:20:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5948291059999997, 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:20:32.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5947698030000002, 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:20:32.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:20:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5947130969999996, 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.682 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:20:32.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5936857589999995, 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.687 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:20:32.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:20:32.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5936259020000003, 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:20:32.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5935380959999996, 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:20:32.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:20:32.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:32.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5928556579999995, 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:20:32.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5927690459999999, 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.706 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.710 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11053 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 294912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070689+0000", 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5863864589999999, 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.03328221, 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11053 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070689+0000", 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070689+0000", 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070691+0000", 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.469e-06 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070702+0000", 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1334e-05 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070727+0000", 2024-09-12T05:20:32.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5131e-05 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070763+0000", 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5234000000000002e-05 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103489+0000", 2024-09-12T05:20:32.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032726606999999998 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103627+0000", 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013767599999999999 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103971+0000", 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00034375900000000001 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11054 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 344064~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070795+0000", 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5862799540000001, 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033674177, 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11054 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070795+0000", 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070795+0000", 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070796+0000", 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3489999999999999e-06 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070815+0000", 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8227999999999999e-05 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070835+0000", 2024-09-12T05:20:32.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0837000000000001e-05 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070850+0000", 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4776999999999999e-05 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104013+0000", 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033163087000000001 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104122+0000", 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010825200000000001 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104469+0000", 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00034764699999999997 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11055 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 393216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.720 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070874+0000", 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.586201043, 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034136239999999998, 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11055 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070874+0000", 2024-09-12T05:20:32.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070874+0000", 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070875+0000", 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.426e-06 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070881+0000", 2024-09-12T05:20:32.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9569999999999999e-06 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070897+0000", 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6147999999999999e-05 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070911+0000", 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3662999999999999e-05 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104515+0000", 2024-09-12T05:20:32.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033603715999999999 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104640+0000", 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012482500000000001 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105010+0000", 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037050499999999998 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11056 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070931+0000", 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5861441689999998, 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034562506, 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11056 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.725 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070931+0000", 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070931+0000", 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070932+0000", 2024-09-12T05:20:32.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070940+0000", 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6939999999999995e-06 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070957+0000", 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6962000000000001e-05 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070969+0000", 2024-09-12T05:20:32.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2031999999999999e-05 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105063+0000", 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034094363000000003 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105158+0000", 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5122000000000002e-05 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105493+0000", 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00033526999999999998 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11057 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5860869639999997, 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034782517999999998, 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11057 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:32.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070989+0000", 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.268e-06 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071050+0000", 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0294000000000002e-05 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071068+0000", 2024-09-12T05:20:32.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8683000000000001e-05 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071083+0000", 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5167999999999999e-05 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105540+0000", 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034457039000000002 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105657+0000", 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116248 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105771+0000", 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113818 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11183 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 655360~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.076889+0000", 2024-09-12T05:20:32.733 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5801856059999997, 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033440448999999997, 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11183 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076889+0000", 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076889+0000", 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076891+0000", 2024-09-12T05:20:32.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3170000000000001e-06 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076896+0000", 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6999999999999996e-06 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076915+0000", 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8845999999999999e-05 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076929+0000", 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4207e-05 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.109666+0000", 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032736563000000003 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.109806+0000", 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013991900000000001 2024-09-12T05:20:32.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110330+0000", 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00052389699999999995 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11184 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 704512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.076949+0000", 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5801259429999996, 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033865792999999998, 2024-09-12T05:20:32.738 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11184 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076949+0000", 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076949+0000", 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076950+0000", 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1400000000000001e-06 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076970+0000", 2024-09-12T05:20:32.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0230000000000001e-05 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076992+0000", 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1325999999999999e-05 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077008+0000", 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6509999999999999e-05 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110380+0000", 2024-09-12T05:20:32.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033371425000000003 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110493+0000", 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011322 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110815+0000", 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032194199999999997 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11185 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 753664~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.077028+0000", 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5800466740000001, 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034400746000000003, 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11185 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077028+0000", 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077028+0000", 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077030+0000", 2024-09-12T05:20:32.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4339999999999999e-06 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077036+0000", 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2430000000000002e-06 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077054+0000", 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8219999999999998e-05 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077071+0000", 2024-09-12T05:20:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6665999999999999e-05 2024-09-12T05:20:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110887+0000", 2024-09-12T05:20:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033816484000000001 2024-09-12T05:20:32.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.111033+0000", 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145902 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.111429+0000", 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039579699999999998 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11249 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.080857+0000", 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5762182960000004, 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034131901999999999, 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11249 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:32.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080857+0000", 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080857+0000", 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080858+0000", 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3e-06 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080881+0000", 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3237000000000001e-05 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080900+0000", 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8617000000000001e-05 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080914+0000", 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3691e-05 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.113676+0000", 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032762566999999999 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.114667+0000", 2024-09-12T05:20:32.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099052600000000004 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.114989+0000", 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321964 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:32.753 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:32.754 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:32.755 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:32.755 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:32.756 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:32.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:32.757 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:32.758 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:32.758+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:32.855 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:32.853+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:32.928 INFO:teuthology.orchestra.run.smithi059.stderr:marked in osd.6. 2024-09-12T05:20:32.930 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:32.930 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:32.949 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:32.956 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:32.958+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:32.958 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-09-12T05:20:32.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:20:33.058 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:33.058+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:33.126 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:33.158 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:33.158+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:33.249 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:33.249 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:33.260 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:33.257+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:33.263 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:33.360 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:33.361+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:33.426 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:33.427 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:33.440 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:33.462 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:33.462+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:33.562 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:33.561+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:33.611 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:33.612 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:33.625 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:33.668 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:33.669+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:33.764 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:33.766+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:33.793 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:33.793 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:33.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:33.864 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:33.866+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:33.923 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:20:33.948 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:33.948 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:33.965 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone10 from 0x7fd910c (overlap 0x2b8eadb) to 0x1e7d799 2024-09-12T05:20:33.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:33.966 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:33.965+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:34.066 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:34.065+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:34.106 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-12T05:20:34.139 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:34.139 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:34.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:34.203 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:34.205+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:34.268 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:34.269+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:34.341 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:34.341 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:34.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:34.369 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:34.369+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:34.445 INFO:teuthology.orchestra.run.smithi059.stdout:1140 read 0x6b2e4c1 thru 0x6b3274e (0x428e bytes) 2024-09-12T05:20:34.446 INFO:teuthology.orchestra.run.smithi059.stdout:1141 read 0x75872eb thru 0x758f5ff (0x8315 bytes) 2024-09-12T05:20:34.447 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:34.447 INFO:teuthology.orchestra.run.smithi059.stdout:1144 write 0xf2b392 thru 0xf3924b (0xdeba bytes) 2024-09-12T05:20:34.470 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:34.469+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:34.471 INFO:teuthology.orchestra.run.smithi059.stdout:1145 write 0x4ce197e thru 0x4ce365e (0x1ce1 bytes) 2024-09-12T05:20:34.481 INFO:teuthology.orchestra.run.smithi059.stdout:1147 read 0x14178f4 thru 0x1422550 (0xac5d bytes) 2024-09-12T05:20:34.481 INFO:teuthology.orchestra.run.smithi059.stdout:1148 punch from 0x2af6772 to 0x2afb632, (0x4ec0 bytes) 2024-09-12T05:20:34.481 INFO:teuthology.orchestra.run.smithi059.stdout:1152 write 0xeefc52 thru 0xefc016 (0xc3c5 bytes) 2024-09-12T05:20:34.544 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:34.544 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:34.558 INFO:teuthology.orchestra.run.smithi059.stdout:1153 write 0xa591492 thru 0xa59fb94 (0xe703 bytes) 2024-09-12T05:20:34.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:34.570 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:34.569+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:34.596 INFO:teuthology.orchestra.run.smithi059.stdout:1154 write 0xbc15cfc thru 0xbc24114 (0xe419 bytes) 2024-09-12T05:20:34.611 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:34.612 INFO:teuthology.orchestra.run.smithi059.stdout:1156 write 0x3401018 thru 0x3404449 (0x3432 bytes) 2024-09-12T05:20:34.637 INFO:teuthology.orchestra.run.smithi059.stdout:1157 write 0x287a871 thru 0x28873cd (0xcb5d bytes) 2024-09-12T05:20:34.671 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:34.673+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:34.675 INFO:teuthology.orchestra.run.smithi059.stdout:1159 read 0x94b6d1 thru 0x95ab84 (0xf4b4 bytes) 2024-09-12T05:20:34.678 INFO:teuthology.orchestra.run.smithi059.stdout:1160 flatten 2024-09-12T05:20:34.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:34.774 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:34.775 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:34.775 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:34.777+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:34.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:34.873 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:34.873+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:34.894 INFO:teuthology.orchestra.run.smithi059.stdout:1161 write 0x8f1c684 thru 0x8f27ec6 (0xb843 bytes) 2024-09-12T05:20:34.905 INFO:teuthology.orchestra.run.smithi059.stdout:1162 trunc from 0xbc24115 to 0xaee211a 2024-09-12T05:20:34.915 INFO:teuthology.orchestra.run.smithi059.stdout:1163 punch from 0x9c3c409 to 0x9c474c8, (0xb0bf bytes) 2024-09-12T05:20:34.916 INFO:teuthology.orchestra.run.smithi059.stdout:1164 punch from 0x616d060 to 0x616fe62, (0x2e02 bytes) 2024-09-12T05:20:34.916 INFO:teuthology.orchestra.run.smithi059.stdout:1165 read 0x582c0f4 thru 0x582fb9d (0x3aaa bytes) 2024-09-12T05:20:34.916 INFO:teuthology.orchestra.run.smithi059.stdout:1168 write 0x64caf2b thru 0x64cdd50 (0x2e26 bytes) 2024-09-12T05:20:34.920 INFO:teuthology.orchestra.run.smithi059.stdout:1169 writesame 0x1f8e033 thru 0x1f97eab data_size 0x1(0x9e79 bytes) 2024-09-12T05:20:34.964 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:34.964 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:34.974 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:34.973+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:34.981 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:34.982 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3779 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027772582000001, 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015428234000000001, 2024-09-12T05:20:34.995 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3779 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:34.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969069+0000", 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:34.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969078+0000", 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2229999999999996e-06 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969089+0000", 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0536999999999999e-05 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969097+0000", 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7780000000000007e-06 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984386+0000", 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01528902 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984436+0000", 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0577e-05 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984497+0000", 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0386000000000001e-05 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:34.999 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3780 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027728084, 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015612325, 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.000 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3780 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969114+0000", 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8899999999999999e-07 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969117+0000", 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2090000000000001e-06 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969127+0000", 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0315e-05 2024-09-12T05:20:35.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969135+0000", 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599999999999998e-06 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984543+0000", 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015407403 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984617+0000", 2024-09-12T05:20:35.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4270999999999994e-05 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984725+0000", 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108278 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3781 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027694145, 2024-09-12T05:20:35.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792308999999998, 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3781 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969148+0000", 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8700000000000005e-07 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969151+0000", 2024-09-12T05:20:35.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0120000000000001e-06 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969161+0000", 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0181e-05 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969179+0000", 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8057999999999999e-05 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985705+0000", 2024-09-12T05:20:35.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016525623 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985800+0000", 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5298999999999997e-05 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985939+0000", 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013934900000000001 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3782 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5046272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027649539, 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016995278999999999, 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3782 2024-09-12T05:20:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1399999999999996e-07 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969196+0000", 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4350000000000001e-06 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969206+0000", 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0593e-05 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969214+0000", 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6380000000000004e-06 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985979+0000", 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016764658000000002 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986091+0000", 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112662 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986187+0000", 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5579000000000001e-05 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3783 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027615809, 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017209842, 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.013 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3783 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969226+0000", 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969229+0000", 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.585e-06 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969265+0000", 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5884999999999999e-05 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969274+0000", 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6070000000000008e-06 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986237+0000", 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016962755999999999 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986323+0000", 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5902000000000005e-05 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986435+0000", 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011246700000000001 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.017 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3866 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027357236, 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017196439000000001, 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.018 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3866 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0699999999999997e-07 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969488+0000", 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1e-06 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969498+0000", 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0468e-05 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969505+0000", 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.452e-06 2024-09-12T05:20:35.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986467+0000", 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016961092000000001 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986563+0000", 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6010999999999999e-05 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986680+0000", 2024-09-12T05:20:35.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011770899999999999 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3867 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027323016, 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017352149000000001, 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.023 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3867 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:35.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969519+0000", 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6700000000000003e-07 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969522+0000", 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.123e-06 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969532+0000", 2024-09-12T05:20:35.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0112000000000001e-05 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969540+0000", 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986711+0000", 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017171285000000001 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986781+0000", 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0072000000000003e-05 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986870+0000", 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3868 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.027 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027289333000001, 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017560494999999999, 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3868 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969553+0000", 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4200000000000005e-07 2024-09-12T05:20:35.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969556+0000", 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9730000000000002e-06 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969566+0000", 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0387999999999999e-05 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969585+0000", 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8604e-05 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986945+0000", 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017360197000000001 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987016+0000", 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1130000000000005e-05 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987112+0000", 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6360999999999994e-05 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3869 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:35.032 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027243355, 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017730589000000001, 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3869 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:35.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969608+0000", 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4490000000000005e-06 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969619+0000", 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0781999999999999e-05 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969636+0000", 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7218e-05 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987143+0000", 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017506799 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987247+0000", 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010446900000000001 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987328+0000", 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1100999999999995e-05 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3870 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027192554000001, 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017855591000000001, 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3870 2024-09-12T05:20:35.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5499999999999998e-07 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969653+0000", 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5499999999999999e-06 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969663+0000", 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.005e-05 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969670+0000", 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.43e-06 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987362+0000", 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017691521000000002 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987426+0000", 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4204999999999999e-05 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987504+0000", 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.818e-05 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3871 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:35.041 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027161080999999, 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018082318, 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3871 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969681+0000", 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969683+0000", 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6350000000000002e-06 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969693+0000", 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4169999999999998e-06 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969700+0000", 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1350000000000003e-06 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987538+0000", 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017838166999999999 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987609+0000", 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1316999999999995e-05 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987762+0000", 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015310200000000001 2024-09-12T05:20:35.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3872 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7995392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.027131542999999, 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018277057999999999, 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.046 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3872 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000002e-07 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969713+0000", 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5830000000000001e-06 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969722+0000", 2024-09-12T05:20:35.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2240000000000001e-06 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969752+0000", 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0142e-05 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987828+0000", 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018076297000000002 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987901+0000", 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2767000000000003e-05 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987987+0000", 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5474000000000002e-05 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3883 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6291456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.02701407, 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018349118000000001, 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3883 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969828+0000", 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7800000000000001e-07 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969839+0000", 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1779e-05 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969851+0000", 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1573000000000001e-05 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969859+0000", 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8320000000000006e-06 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988018+0000", 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018158819999999999 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988085+0000", 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7366000000000005e-05 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988176+0000", 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1169999999999996e-05 2024-09-12T05:20:35.054 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3884 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7012352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.026969858999999, 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018487955, 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.055 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3884 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969872+0000", 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2500000000000005e-07 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969875+0000", 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3950000000000001e-06 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969885+0000", 2024-09-12T05:20:35.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9399999999999997e-06 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969893+0000", 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4930000000000001e-06 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988206+0000", 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018312910000000002 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988276+0000", 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0198999999999997e-05 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988359+0000", 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3293000000000004e-05 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3885 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.026936406000001, 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019004607999999999, 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.060 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3885 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7400000000000003e-07 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969908+0000", 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0529999999999998e-06 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969918+0000", 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.009e-05 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969939+0000", 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0797000000000001e-05 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988391+0000", 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018452177 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988462+0000", 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0154999999999995e-05 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988909+0000", 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00044776199999999999 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.064 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3886 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7864320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.026888289, 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019129604000000001, 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3886 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969954+0000", 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8800000000000001e-07 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969958+0000", 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.89e-06 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969971+0000", 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.376e-05 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969979+0000", 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0420000000000003e-06 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988959+0000", 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018980011000000001 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989027+0000", 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7439000000000003e-05 2024-09-12T05:20:35.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989082+0000", 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5574e-05 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3887 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.02684872, 2024-09-12T05:20:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019321270000000001, 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3887 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969993+0000", 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969996+0000", 2024-09-12T05:20:35.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1870000000000001e-06 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970007+0000", 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0676000000000001e-05 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970016+0000", 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5019999999999998e-06 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989125+0000", 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019108750000000001 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989201+0000", 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5852999999999994e-05 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989314+0000", 2024-09-12T05:20:35.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112685 2024-09-12T05:20:35.074 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.074 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.074 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.074 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3888 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.075 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:35.075 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.026800672, 2024-09-12T05:20:35.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019523841, 2024-09-12T05:20:35.075 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.075 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.076 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.076 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.076 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.076 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3888 2024-09-12T05:20:35.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.077 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:35.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:35.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970041+0000", 2024-09-12T05:20:35.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-07 2024-09-12T05:20:35.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970045+0000", 2024-09-12T05:20:35.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5719999999999999e-06 2024-09-12T05:20:35.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970056+0000", 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1107999999999999e-05 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970064+0000", 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0239999999999997e-06 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989388+0000", 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019324108 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989469+0000", 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0958000000000007e-05 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989564+0000", 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5422999999999998e-05 2024-09-12T05:20:35.082 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3889 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.026766187, 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019700655000000001, 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.083 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3889 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970076+0000", 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6300000000000004e-07 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970087+0000", 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1449e-05 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970098+0000", 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.042e-05 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970106+0000", 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9209999999999992e-06 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989608+0000", 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019502562000000001 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989680+0000", 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1762999999999997e-05 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989776+0000", 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5676999999999999e-05 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3890 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:35.087 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.026722988, 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019853272000000002, 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3890 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970119+0000", 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2900000000000003e-07 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970122+0000", 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7420000000000002e-06 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970131+0000", 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7909999999999999e-06 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970138+0000", 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8090000000000004e-06 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989808+0000", 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019669641000000002 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989880+0000", 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2606000000000002e-05 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989971+0000", 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0953999999999997e-05 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.091 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.092 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.092 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:35.092 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:35.093 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:35.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:35.094 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:35.094 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:35.095 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:35.095 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:35.096 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:35.096 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:35.093+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:35.100 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:35.100 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:35.141 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.141 INFO:teuthology.orchestra.run.smithi059.stdout:1171 read 0x5b9613f thru 0x5b9a9e1 (0x48a3 bytes) 2024-09-12T05:20:35.141 INFO:teuthology.orchestra.run.smithi059.stdout:1174 read 0x7ccb20a thru 0x7cd5f3b (0xad32 bytes) 2024-09-12T05:20:35.142 INFO:teuthology.orchestra.run.smithi059.stdout:1175 punch from 0x148275e to 0x1484b60, (0x2402 bytes) 2024-09-12T05:20:35.142 INFO:teuthology.orchestra.run.smithi059.stdout:1176 read 0x7aa8bee thru 0x7aad182 (0x4595 bytes) 2024-09-12T05:20:35.153 INFO:teuthology.orchestra.run.smithi059.stdout:1177 write 0xce8ec95 thru 0xce97867 (0x8bd3 bytes) 2024-09-12T05:20:35.173 INFO:teuthology.orchestra.run.smithi059.stdout:1178 write 0x4a6aa34 thru 0x4a70170 (0x573d bytes) 2024-09-12T05:20:35.189 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.189 INFO:teuthology.orchestra.run.smithi059.stdout:1180 punch from 0x5e0fe57 to 0x5e1d77c, (0xd925 bytes) 2024-09-12T05:20:35.189 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.189 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.193 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:35.193+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:35.199 INFO:teuthology.orchestra.run.smithi059.stdout:1183 trunc from 0xce97868 to 0x6454109 2024-09-12T05:20:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:35.242 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:35.242 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:1184 writesame 0xaa8f6bb thru 0xaa9e266 data_size 0x2(0xebac bytes) 2024-09-12T05:20:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:1185 write 0x51e954b thru 0x51f8731 (0xf1e7 bytes) 2024-09-12T05:20:35.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:35.275 INFO:teuthology.orchestra.run.smithi059.stdout:1187 writesame 0x57d54af thru 0x57dae3f data_size 0x1(0x5991 bytes) 2024-09-12T05:20:35.298 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.298 INFO:teuthology.orchestra.run.smithi059.stdout:1189 write 0x25fcdfd thru 0x26002c5 (0x34c9 bytes) 2024-09-12T05:20:35.299 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:35.297+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:35.312 INFO:teuthology.orchestra.run.smithi059.stdout:1190 punch from 0x6a3117e to 0x6a356ea, (0x456c bytes) 2024-09-12T05:20:35.312 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.312 INFO:teuthology.orchestra.run.smithi059.stdout:1192 read 0x9c87296 thru 0x9c889f0 (0x175b bytes) 2024-09-12T05:20:35.312 INFO:teuthology.orchestra.run.smithi059.stdout:1193 punch from 0x3276360 to 0x327ef94, (0x8c34 bytes) 2024-09-12T05:20:35.312 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.329 INFO:teuthology.orchestra.run.smithi059.stdout:1195 write 0xd174ddf thru 0xd17ef3e (0xa160 bytes) 2024-09-12T05:20:35.347 INFO:teuthology.orchestra.run.smithi059.stdout:1196 write 0x9ebe836 thru 0x9ec1ef6 (0x36c1 bytes) 2024-09-12T05:20:35.360 INFO:teuthology.orchestra.run.smithi059.stdout:1197 trunc from 0xd17ef3f to 0xbd2ce96 2024-09-12T05:20:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:1198 read 0xab22ec7 thru 0xab317c6 (0xe900 bytes) 2024-09-12T05:20:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:1200 punch from 0xcf8709 to 0xd00b3c, (0x8433 bytes) 2024-09-12T05:20:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:1201 write 0x4da55e7 thru 0x4da5b9c (0x5b6 bytes) 2024-09-12T05:20:35.390 INFO:teuthology.orchestra.run.smithi059.stdout:1202 write 0x1da63b8 thru 0x1db3b54 (0xd79d bytes) 2024-09-12T05:20:35.395 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:35.397+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:35.408 INFO:teuthology.orchestra.run.smithi059.stdout:1203 writesame 0x488e7cb thru 0x4895c33 data_size 0x1(0x7469 bytes) 2024-09-12T05:20:35.409 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:35.410 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:35.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:35.432 INFO:teuthology.orchestra.run.smithi059.stdout:1205 trunc from 0xbd2ce96 to 0x76ecb75 2024-09-12T05:20:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:1206 punch from 0x5a7d484 to 0x5a8c567, (0xf0e3 bytes) 2024-09-12T05:20:35.463 INFO:teuthology.orchestra.run.smithi059.stdout:1208 write 0x9a719f9 thru 0x9a736d2 (0x1cda bytes) 2024-09-12T05:20:35.476 INFO:teuthology.orchestra.run.smithi059.stdout:1209 trunc from 0x9a736d3 to 0x786b66f 2024-09-12T05:20:35.495 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:35.497+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:35.515 INFO:teuthology.orchestra.run.smithi059.stdout:1210 write 0xe104110 thru 0xe1126e3 (0xe5d4 bytes) 2024-09-12T05:20:35.535 INFO:teuthology.orchestra.run.smithi059.stdout:1211 trunc from 0xe1126e4 to 0xd878750 2024-09-12T05:20:35.558 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.559 INFO:teuthology.orchestra.run.smithi059.stdout:1214 write 0x61ae09d thru 0x61b232f (0x4293 bytes) 2024-09-12T05:20:35.561 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:35.561 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4266.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.639757887000002, 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045733270000000003, 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922955+0000", 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922956+0000", 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922970+0000", 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3633e-05 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.922991+0000", 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1449000000000001e-05 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923009+0000", 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7929999999999999e-05 2024-09-12T05:20:35.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923095+0000", 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6026000000000006e-05 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.923129+0000", 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4545000000000002e-05 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.927399+0000", 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042699849999999996 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:19:59.927529+0000", 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012922899999999999 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:35.566 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.583452352, 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:20:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8553 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'44, mlcod=37'40)", 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.7219568219999992, 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048787479999999996, 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:35.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840757+0000", 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840761+0000", 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0790000000000002e-06 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840771+0000", 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0151e-05 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840776+0000", 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9389999999999996e-06 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840826+0000", 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9521999999999998e-05 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840845+0000", 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9360000000000001e-05 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845590+0000", 2024-09-12T05:20:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004744687 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845635+0000", 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5423999999999997e-05 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6718200349999996, 2024-09-12T05:20:35.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:35.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:20:35.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8996 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'59, mlcod=37'55)", 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6140440470000001, 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044970280000000001, 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948669+0000", 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948671+0000", 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4449999999999999e-06 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948681+0000", 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0635000000000001e-05 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948702+0000", 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0383000000000001e-05 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948712+0000", 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0288e-05 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948771+0000", 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9338e-05 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.948794+0000", 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2464e-05 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.953128+0000", 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043340710000000001 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.953166+0000", 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8404e-05 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9013 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'63, mlcod=37'59)", 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5932436059999997, 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051699299999999997, 2024-09-12T05:20:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6400000000000002e-07 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969476+0000", 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0440000000000001e-06 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969490+0000", 2024-09-12T05:20:35.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3328e-05 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969497+0000", 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2559999999999996e-06 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969563+0000", 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5879999999999999e-05 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969589+0000", 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5972000000000001e-05 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974583+0000", 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049945379999999998 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974640+0000", 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6248000000000001e-05 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.588 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9885 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'109, mlcod=37'106)", 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.2898783779999992, 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051369570000000002, 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272840+0000", 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1559999999999997e-06 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272848+0000", 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-06 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272853+0000", 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4569999999999998e-06 2024-09-12T05:20:35.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272896+0000", 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3441e-05 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272911+0000", 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4484000000000001e-05 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277923+0000", 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050118480000000002 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277972+0000", 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9174e-05 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:20:35.593 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.2891195510000006, 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:20:35.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:20:35.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9901 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'114, mlcod=37'110)", 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.2654494019999998, 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048386820000000004, 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297265+0000", 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6700000000000003e-07 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297270+0000", 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5759999999999996e-06 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297281+0000", 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1240000000000001e-05 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297288+0000", 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.472e-06 2024-09-12T05:20:35.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297350+0000", 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1625999999999996e-05 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297369+0000", 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9673e-05 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.302000+0000", 2024-09-12T05:20:35.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046303610000000004 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.302103+0000", 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010296700000000001 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10139 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'147, mlcod=37'142)", 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.1210116449999994, 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051775290000000002, 2024-09-12T05:20:35.602 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441706+0000", 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.985e-06 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441716+0000", 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3810000000000005e-06 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441722+0000", 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441772+0000", 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9465999999999997e-05 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441792+0000", 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0560999999999998e-05 2024-09-12T05:20:35.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446825+0000", 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050325259999999998 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446879+0000", 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999999e-05 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10140 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'148, mlcod=37'142)", 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.1203500630000001, 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045454459999999999, 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442363+0000", 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442364+0000", 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7700000000000004e-07 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442368+0000", 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8970000000000001e-06 2024-09-12T05:20:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442376+0000", 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5259999999999993e-06 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442382+0000", 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9850000000000003e-06 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442431+0000", 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9076000000000002e-05 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.442451+0000", 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9782000000000001e-05 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446883+0000", 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044323740000000002 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446909+0000", 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5228999999999998e-05 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0550759040000006, 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:20:35.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.615 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10192 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'159, mlcod=37'154)", 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0543224640000002, 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048454229999999997, 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508396+0000", 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9219999999999996e-06 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508407+0000", 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0902e-05 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508414+0000", 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8920000000000003e-06 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508463+0000", 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8829999999999998e-05 2024-09-12T05:20:35.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508484+0000", 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.143e-05 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513207+0000", 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047223289999999999 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513236+0000", 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9403e-05 2024-09-12T05:20:35.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10194 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'161, mlcod=37'155)", 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.052623123, 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047649629999999997, 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510090+0000", 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510091+0000", 2024-09-12T05:20:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8999999999999996e-07 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510096+0000", 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3859999999999998e-06 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510109+0000", 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2498e-05 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510115+0000", 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6950000000000003e-06 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510170+0000", 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4752e-05 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.510193+0000", 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2572e-05 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.514813+0000", 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046198120000000001 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.514855+0000", 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2558000000000001e-05 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.624 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10212 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'166, mlcod=37'162)", 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0271769259999992, 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004931403, 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535537+0000", 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5799999999999999e-07 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535542+0000", 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0159999999999999e-06 2024-09-12T05:20:35.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535554+0000", 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2199e-05 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535564+0000", 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7070000000000004e-06 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535606+0000", 2024-09-12T05:20:35.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2391999999999997e-05 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535627+0000", 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0503e-05 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540427+0000", 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047999770000000004 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540468+0000", 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0951000000000001e-05 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0249515729999992, 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.633 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10236 3.9 e37/23 3:91b6a2ae:::rbd_data.11182c6d9c71.0000000000000179:head v 37'56, mlcod=37'54)", 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.9882376050000001, 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047699020000000003, 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9100000000000003e-07 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574482+0000", 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3519999999999997e-06 2024-09-12T05:20:35.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574492+0000", 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0733999999999999e-05 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574498+0000", 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1410000000000004e-06 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574556+0000", 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8403000000000003e-05 2024-09-12T05:20:35.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574579+0000", 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319000000000002e-05 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.579173+0000", 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045932000000000004 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.579246+0000", 2024-09-12T05:20:35.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2961999999999997e-05 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.4628637920000003, 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:20:35.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:20:35.642 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.4609095740000004, 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:20:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11437 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'65, mlcod=38'62)", 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.4580284619999997, 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049658940000000002, 2024-09-12T05:20:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104691+0000", 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0979999999999999e-06 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:35.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104702+0000", 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0611999999999999e-05 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104711+0000", 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107402+0000", 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026907889999999999 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107423+0000", 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1035000000000001e-05 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109616+0000", 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021936870000000002 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109651+0000", 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4434999999999998e-05 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.651 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:35.652 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:35.652 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:35.653 INFO:teuthology.orchestra.run.smithi059.stdout:1215 write 0x95467a8 thru 0x9550c39 (0xa492 bytes) 2024-09-12T05:20:35.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:35.654 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.654 INFO:teuthology.orchestra.run.smithi059.stdout:1217 writesame 0x7b14694 thru 0x7b202ca data_size 0x1(0xbc37 bytes) 2024-09-12T05:20:35.654 INFO:teuthology.orchestra.run.smithi059.stdout:1219 write 0x8a6f708 thru 0x8a7246a (0x2d63 bytes) 2024-09-12T05:20:35.655 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:35.653+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:35.661 INFO:teuthology.orchestra.run.smithi059.stdout:1220 trunc from 0xd878750 to 0x59e9319 2024-09-12T05:20:35.705 INFO:teuthology.orchestra.run.smithi059.stdout:1221 writesame 0x5a000aa thru 0x5a0d810 data_size 0x9(0xd767 bytes) 2024-09-12T05:20:35.705 INFO:teuthology.orchestra.run.smithi059.stdout:1222 read 0x2ed403d thru 0x2ede89f (0xa863 bytes) 2024-09-12T05:20:35.723 INFO:teuthology.orchestra.run.smithi059.stdout:1224 write 0x97424bc thru 0x97507d4 (0xe319 bytes) 2024-09-12T05:20:35.738 INFO:teuthology.orchestra.run.smithi059.stdout:1225 punch from 0x476ffc0 to 0x477880a, (0x884a bytes) 2024-09-12T05:20:35.738 INFO:teuthology.orchestra.run.smithi059.stdout:1226 read 0x507e1d3 thru 0x50864cd (0x82fb bytes) 2024-09-12T05:20:35.739 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.739 INFO:teuthology.orchestra.run.smithi059.stdout:1228 read 0x5cb95a5 thru 0x5cc2f45 (0x99a1 bytes) 2024-09-12T05:20:35.740 INFO:teuthology.orchestra.run.smithi059.stdout:1229 write 0x73ded21 thru 0x73ea760 (0xba40 bytes) 2024-09-12T05:20:35.754 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:35.753+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:35.756 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.756 INFO:teuthology.orchestra.run.smithi059.stdout:1232 read 0x5c92b18 thru 0x5c9496c (0x1e55 bytes) 2024-09-12T05:20:35.756 INFO:teuthology.orchestra.run.smithi059.stdout:1233 punch from 0x9134d4e to 0x9136196, (0x1448 bytes) 2024-09-12T05:20:35.766 INFO:teuthology.orchestra.run.smithi059.stdout:1234 trunc from 0x97507d5 to 0xe3159e4 2024-09-12T05:20:35.777 INFO:teuthology.orchestra.run.smithi059.stdout:1236 write 0x58d5562 thru 0x58e143c (0xbedb bytes) 2024-09-12T05:20:35.786 INFO:teuthology.orchestra.run.smithi059.stdout:1237 writesame 0xbbe3598 thru 0xbbe4371 data_size 0x9(0xdda bytes) 2024-09-12T05:20:35.796 INFO:teuthology.orchestra.run.smithi059.stdout:1238 punch from 0x8114902 to 0x8123162, (0xe860 bytes) 2024-09-12T05:20:35.797 INFO:teuthology.orchestra.run.smithi059.stdout:1240 read 0x76f6334 thru 0x76fb86e (0x553b bytes) 2024-09-12T05:20:35.797 INFO:teuthology.orchestra.run.smithi059.stdout:1241 read 0xb60c987 thru 0xb619317 (0xc991 bytes) 2024-09-12T05:20:35.797 INFO:teuthology.orchestra.run.smithi059.stdout:1242 read 0x92dfbee thru 0x92e673b (0x6b4e bytes) 2024-09-12T05:20:35.797 INFO:teuthology.orchestra.run.smithi059.stdout:1245 write 0xaeec349 thru 0xaeef9f3 (0x36ab bytes) 2024-09-12T05:20:35.807 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.807 INFO:teuthology.orchestra.run.smithi059.stdout:1249 read 0x75c2b41 thru 0x75ca765 (0x7c25 bytes) 2024-09-12T05:20:35.807 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.807 INFO:teuthology.orchestra.run.smithi059.stdout:1251 read 0x78f4e04 thru 0x78ffca4 (0xaea1 bytes) 2024-09-12T05:20:35.807 INFO:teuthology.orchestra.run.smithi059.stdout:1252 read 0x4ee017b thru 0x4eebb2a (0xb9b0 bytes) 2024-09-12T05:20:35.807 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:35.807 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:35.808 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:35.808 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:35.808 INFO:teuthology.orchestra.run.smithi059.stdout:1253 read 0x29fddd0 thru 0x2a06d68 (0x8f99 bytes) 2024-09-12T05:20:35.808 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.808 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.809 INFO:teuthology.orchestra.run.smithi059.stdout:1258 write 0x134533 thru 0x138401 (0x3ecf bytes) 2024-09-12T05:20:35.812 INFO:teuthology.orchestra.run.smithi059.stdout:1259 read 0x38fea38 thru 0x39099a2 (0xaf6b bytes) 2024-09-12T05:20:35.813 INFO:teuthology.orchestra.run.smithi059.stdout:1260 punch from 0x8efa07 to 0x8f92d1, (0x98ca bytes) 2024-09-12T05:20:35.813 INFO:teuthology.orchestra.run.smithi059.stdout:1261 read 0x302a65b thru 0x30393ac (0xed52 bytes) 2024-09-12T05:20:35.813 INFO:teuthology.orchestra.run.smithi059.stdout:1263 writesame 0x237c0d6 thru 0x237fd74 data_size 0x7(0x3c9f bytes) 2024-09-12T05:20:35.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:35.825 INFO:teuthology.orchestra.run.smithi059.stdout:1267 read 0x2dc2fec thru 0x2dc3afb (0xb10 bytes) 2024-09-12T05:20:35.827 INFO:teuthology.orchestra.run.smithi059.stdout:1268 read 0x57a5483 thru 0x57b11c4 (0xbd42 bytes) 2024-09-12T05:20:35.827 INFO:teuthology.orchestra.run.smithi059.stdout:1269 read 0x29cd265 thru 0x29d70e8 (0x9e84 bytes) 2024-09-12T05:20:35.828 INFO:teuthology.orchestra.run.smithi059.stdout:1270 read 0x88d9e70 thru 0x88de007 (0x4198 bytes) 2024-09-12T05:20:35.828 INFO:teuthology.orchestra.run.smithi059.stdout:1271 writesame 0xaceb8f6 thru 0xacfb58c data_size 0x1(0xfc97 bytes) 2024-09-12T05:20:35.855 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:35.853+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:35.865 INFO:teuthology.orchestra.run.smithi059.stdout:1272 writesame 0x61ce65f thru 0x61dd2b5 data_size 0x1(0xec57 bytes) 2024-09-12T05:20:35.902 INFO:teuthology.orchestra.run.smithi059.stdout:1273 writesame 0x6bbf7e3 thru 0x6bbfc52 data_size 0x8(0x470 bytes) 2024-09-12T05:20:35.909 INFO:teuthology.orchestra.run.smithi059.stdout:1274 write 0x1fcb1c8 thru 0x1fd1492 (0x62cb bytes) 2024-09-12T05:20:35.924 INFO:teuthology.orchestra.run.smithi059.stdout:1275 trunc from 0xe3159e4 to 0x845a8dc 2024-09-12T05:20:35.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:20:35.954 INFO:teuthology.orchestra.run.smithi059.stdout:1277 writesame 0x2ebd6da thru 0x2ec98ef data_size 0xa9(0xc216 bytes) 2024-09-12T05:20:35.956 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:35.953+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:35.957 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:35.957 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:35.958 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:35.958 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:35.958 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:35.960 INFO:teuthology.orchestra.run.smithi059.stdout:1278 read 0x5f12fd5 thru 0x5f1368b (0x6b7 bytes) 2024-09-12T05:20:35.960 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:35.974 INFO:teuthology.orchestra.run.smithi059.stdout:1280 write 0xb26097d thru 0xb2632dc (0x2960 bytes) 2024-09-12T05:20:35.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:35.984 INFO:teuthology.orchestra.run.smithi059.stdout:1282 read 0x9075863 thru 0x90826ea (0xce88 bytes) 2024-09-12T05:20:35.984 INFO:teuthology.orchestra.run.smithi059.stdout:1283 punch from 0xa14dac1 to 0xa15a9d3, (0xcf12 bytes) 2024-09-12T05:20:35.984 INFO:teuthology.orchestra.run.smithi059.stdout:1284 write 0x615812c thru 0x6163a29 (0xb8fe bytes) 2024-09-12T05:20:36.002 INFO:teuthology.orchestra.run.smithi059.stdout:1285 write 0xaf2425c thru 0xaf326b5 (0xe45a bytes) 2024-09-12T05:20:36.020 INFO:teuthology.orchestra.run.smithi059.stdout:1286 punch from 0x302fcbf to 0x303eff8, (0xf339 bytes) 2024-09-12T05:20:36.031 INFO:teuthology.orchestra.run.smithi059.stdout:1288 trunc from 0xb2632dd to 0x381f063 2024-09-12T05:20:36.056 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:36.057+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:36.075 INFO:teuthology.orchestra.run.smithi059.stdout:1291 read 0x153a343 thru 0x15409a8 (0x6666 bytes) 2024-09-12T05:20:36.078 INFO:teuthology.orchestra.run.smithi059.stdout:1293 trunc from 0x381f063 to 0x553df8d 2024-09-12T05:20:36.086 INFO:teuthology.orchestra.run.smithi059.stdout:1294 punch from 0x387f7b to 0x3964ea, (0xe56f bytes) 2024-09-12T05:20:36.096 INFO:teuthology.orchestra.run.smithi059.stdout:1295 writesame 0x594fd7e thru 0x595c55b data_size 0x1(0xc7de bytes) 2024-09-12T05:20:36.108 INFO:teuthology.orchestra.run.smithi059.stdout:1296 trunc from 0x595c55c to 0xd3b457d 2024-09-12T05:20:36.117 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:36.117 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:36.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11351 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 278528~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0288596800000001, 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040773482999999999, 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11351 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7899999999999999e-07 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090442+0000", 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9319999999999999e-06 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090449+0000", 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.781e-06 2024-09-12T05:20:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090454+0000", 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0440000000000003e-06 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.129625+0000", 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039171428000000001 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.129705+0000", 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0148999999999994e-05 2024-09-12T05:20:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131213+0000", 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015077700000000001 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11352 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0288384500000003, 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041165723000000001, 2024-09-12T05:20:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11352 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090463+0000", 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0150000000000002e-06 2024-09-12T05:20:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090470+0000", 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5760000000000002e-06 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090475+0000", 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7729999999999999e-06 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131246+0000", 2024-09-12T05:20:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040771485000000003 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131331+0000", 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5338000000000002e-05 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131627+0000", 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029515599999999998 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11353 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0288171750000004, 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041566055999999997, 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11353 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090483+0000", 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4499999999999997e-07 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090484+0000", 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9149999999999999e-06 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090491+0000", 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6170000000000003e-06 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090496+0000", 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.882e-06 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131659+0000", 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041163386000000003 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131740+0000", 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0575999999999996e-05 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132048+0000", 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030823500000000002 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11354 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0287963379999994, 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042063306000000002, 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11354 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090511+0000", 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8199999999999997e-06 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090518+0000", 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9360000000000002e-06 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090523+0000", 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0490000000000003e-06 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132081+0000", 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041557747999999999 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132166+0000", 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4905000000000001e-05 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132566+0000", 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040041399999999998 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11355 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0287667440000003, 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042441325000000002, 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11355 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090533+0000", 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090535+0000", 2024-09-12T05:20:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.272e-06 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090542+0000", 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0219999999999999e-06 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090547+0000", 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4710000000000001e-06 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132604+0000", 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042057223999999997 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132696+0000", 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1596999999999997e-05 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132974+0000", 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000278287 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11388 3.18 3:1c5f1393:::rbd_data.1118f6d14695.0000000000000004:9 [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0269509960000001, 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040980874, 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11388 2024-09-12T05:20:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092349+0000", 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2899999999999999e-07 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092350+0000", 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.559e-06 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092357+0000", 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.148e-06 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092371+0000", 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4104000000000001e-05 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133008+0000", 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040637083999999997 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133094+0000", 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5118999999999996e-05 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133329+0000", 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023553100000000001 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11389 3.18 3:1c5f1393:::rbd_data.1118f6d14695.0000000000000004:9 [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0269188669999991, 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041475895999999998, 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11389 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092381+0000", 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4700000000000002e-07 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092383+0000", 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7799999999999999e-06 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092387+0000", 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4830000000000001e-06 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092390+0000", 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.101e-06 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133374+0000", 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040983693000000002 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133458+0000", 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4320000000000006e-05 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133856+0000", 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039817200000000002 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11390 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0269052050000003, 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041490103, 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11390 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5100000000000001e-07 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092396+0000", 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0600000000000002e-06 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092400+0000", 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.456e-06 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092402+0000", 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5799999999999999e-06 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133843+0000", 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041440799 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133884+0000", 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0957000000000001e-05 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11391 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.02689333, 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041529139999999999, 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11391 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2499999999999999e-07 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092407+0000", 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0780000000000001e-06 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092411+0000", 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1389999999999997e-06 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092416+0000", 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1849999999999997e-06 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133925+0000", 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041509031000000002 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133935+0000", 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0482000000000001e-05 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11392 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0268770580000002, 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041566648999999997, 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11392 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092423+0000", 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092425+0000", 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0959999999999999e-06 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092431+0000", 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3199999999999996e-06 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092436+0000", 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6809999999999997e-06 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133967+0000", 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041531476999999997 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133989+0000", 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1691e-05 2024-09-12T05:20:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11393 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0268556150000006, 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041603366000000003, 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11393 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092446+0000", 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092454+0000", 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1450000000000002e-06 2024-09-12T05:20:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092458+0000", 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.95e-06 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134037+0000", 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041578089999999998 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134047+0000", 2024-09-12T05:20:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0404999999999999e-05 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11415 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0266914719999995, 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041482690000000003, 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11415 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.96e-07 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092610+0000", 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.874e-06 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092617+0000", 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.374e-06 2024-09-12T05:20:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092623+0000", 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134081+0000", 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041458288000000003 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134090+0000", 2024-09-12T05:20:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4350000000000003e-06 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11416 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0266695170000002, 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041499819, 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11416 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092632+0000", 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9800000000000001e-06 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092638+0000", 2024-09-12T05:20:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.207e-06 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092643+0000", 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5820000000000003e-06 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134121+0000", 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041477953999999997 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134130+0000", 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7159999999999992e-06 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11417 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0266496299999996, 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041510551, 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11417 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092652+0000", 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8950000000000001e-06 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092658+0000", 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3749999999999999e-06 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092664+0000", 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9159999999999998e-06 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134154+0000", 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041489640000000001 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134160+0000", 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2859999999999996e-06 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11418 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0266279610000009, 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041515682999999998, 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11418 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092672+0000", 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9200000000000002e-07 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092674+0000", 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9700000000000002e-06 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092681+0000", 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7030000000000006e-06 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092686+0000", 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9649999999999999e-06 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134180+0000", 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041493915999999999 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134187+0000", 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.737e-06 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11419 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0266058779999998, 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041519681000000003, 2024-09-12T05:20:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11419 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092694+0000", 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0600000000000001e-07 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092696+0000", 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.891e-06 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092702+0000", 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.314e-06 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092707+0000", 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6870000000000002e-06 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134206+0000", 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041499825999999997 2024-09-12T05:20:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134213+0000", 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5570000000000001e-06 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11782 3.8 3:15cf90c5:::rbd_data.11182c6d9c71.000000000000000f:head [write 0~0] snapc a=[a] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.9818136079999995, 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039417731999999997, 2024-09-12T05:20:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11782 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7800000000000002e-07 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137489+0000", 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4669999999999998e-06 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137496+0000", 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137501+0000", 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.135e-06 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173249+0000", 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035747202999999998 2024-09-12T05:20:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173327+0000", 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8601000000000002e-05 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173486+0000", 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015863699999999999 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176556+0000", 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030699220000000001 2024-09-12T05:20:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176819+0000", 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026288100000000002 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176867+0000", 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8786999999999999e-05 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176903+0000", 2024-09-12T05:20:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5923000000000001e-05 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11833 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 663552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.9795963630000006, 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039526073000000002, 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11833 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.82e-07 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139706+0000", 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3609999999999999e-06 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139715+0000", 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1970000000000002e-06 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139720+0000", 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2549999999999997e-06 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.178847+0000", 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039127126999999998 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.178942+0000", 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4652000000000001e-05 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179229+0000", 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028699900000000002 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11834 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 712704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.9795715519999995, 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039912229, 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11834 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139730+0000", 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.322e-06 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139737+0000", 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3799999999999999e-06 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139742+0000", 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9609999999999996e-06 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179273+0000", 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039530869000000003 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179361+0000", 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8683000000000005e-05 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179640+0000", 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027860199999999997 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11835 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.9795494310000006, 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040348751000000002, 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11835 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139753+0000", 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.497e-06 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139760+0000", 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4749999999999996e-06 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139766+0000", 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179687+0000", 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039921449999999997 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179784+0000", 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6669000000000006e-05 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.180099+0000", 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031458700000000002 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:36.204 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:36.204 INFO:teuthology.orchestra.run.smithi059.stdout:1298 writesame 0xb34b200 thru 0xb354ea6 data_size 0x1(0x9ca7 bytes) 2024-09-12T05:20:36.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:36.206 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:36.206 INFO:teuthology.orchestra.run.smithi059.stdout:1300 read 0x2f95393 thru 0x2f977d8 (0x2446 bytes) 2024-09-12T05:20:36.206 INFO:teuthology.orchestra.run.smithi059.stdout:1301 write 0x581d012 thru 0x582c9ad (0xf99c bytes) 2024-09-12T05:20:36.206 INFO:teuthology.orchestra.run.smithi059.stdout:1303 trunc from 0xd3b457d to 0x9ff6247 2024-09-12T05:20:36.206 INFO:teuthology.orchestra.run.smithi059.stdout:1304 write 0x909d01 thru 0x90dbbe (0x3ebe bytes) 2024-09-12T05:20:36.207 INFO:teuthology.orchestra.run.smithi059.stdout:1305 writesame 0x57e2592 thru 0x57e50ab data_size 0x9(0x2b1a bytes) 2024-09-12T05:20:36.207 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:36.205+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:36.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:36.305+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:36.337 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:36.337 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:36.337 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:36.337 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:36.351 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:36.408 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:36.431 INFO:teuthology.orchestra.run.smithi059.stdout:1313 writesame 0xda90f97 thru 0xda9eb4d data_size 0x1(0xdbb7 bytes) 2024-09-12T05:20:36.432 INFO:teuthology.orchestra.run.smithi059.stdout:1314 write 0xb12e5cb thru 0xb139ac9 (0xb4ff bytes) 2024-09-12T05:20:36.436 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:36.437+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:36.448 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:36.448 INFO:teuthology.orchestra.run.smithi059.stdout:1319 read 0x25cb9e thru 0x25f69e (0x2b01 bytes) 2024-09-12T05:20:36.449 INFO:teuthology.orchestra.run.smithi059.stdout:1320 punch from 0xbb47c30 to 0xbb4c521, (0x48f1 bytes) 2024-09-12T05:20:36.468 INFO:teuthology.orchestra.run.smithi059.stdout:1321 writesame 0xec7a5e0 thru 0xec824df data_size 0x20(0x7f00 bytes) 2024-09-12T05:20:36.469 INFO:teuthology.orchestra.run.smithi059.stdout:1322 read 0xa592599 thru 0xa59d177 (0xabdf bytes) 2024-09-12T05:20:36.469 INFO:teuthology.orchestra.run.smithi059.stdout:1323 write 0x6aa2770 thru 0x6aab390 (0x8c21 bytes) 2024-09-12T05:20:36.486 INFO:teuthology.orchestra.run.smithi059.stdout:1324 punch from 0x68f1ed2 to 0x68f6c18, (0x4d46 bytes) 2024-09-12T05:20:36.486 INFO:teuthology.orchestra.run.smithi059.stdout:1325 writesame 0xcf726f9 thru 0xcf790e4 data_size 0x2(0x69ec bytes) 2024-09-12T05:20:36.508 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:36.509+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:36.510 INFO:teuthology.orchestra.run.smithi059.stdout:1327 punch from 0xc66ecf5 to 0xc67ca68, (0xdd73 bytes) 2024-09-12T05:20:36.511 INFO:teuthology.orchestra.run.smithi059.stdout:1328 write 0x1e84db3 thru 0x1e8ff3c (0xb18a bytes) 2024-09-12T05:20:36.517 INFO:teuthology.orchestra.run.smithi059.stdout:1329 read 0xae4fa6c thru 0xae5221f (0x27b4 bytes) 2024-09-12T05:20:36.517 INFO:teuthology.orchestra.run.smithi059.stdout:1331 write 0x217b5ff thru 0x2180656 (0x5058 bytes) 2024-09-12T05:20:36.526 INFO:teuthology.orchestra.run.smithi059.stdout:1332 writesame 0x5055a6f thru 0x505d76b data_size 0x7(0x7cfd bytes) 2024-09-12T05:20:36.535 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:36.535 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:36.535 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:36.535 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:36.535 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:36.544 INFO:teuthology.orchestra.run.smithi059.stdout:1333 writesame 0x17669e3 thru 0x1773905 data_size 0x1(0xcf23 bytes) 2024-09-12T05:20:36.553 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:36.574 INFO:teuthology.orchestra.run.smithi059.stdout:1334 write 0xada4675 thru 0xadad1cd (0x8b59 bytes) 2024-09-12T05:20:36.598 INFO:teuthology.orchestra.run.smithi059.stdout:1335 trunc from 0xec824e0 to 0xaadb056 2024-09-12T05:20:36.644 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:36.645+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:36.649 INFO:teuthology.orchestra.run.smithi059.stdout:1337 writesame 0xea41946 thru 0xea41d22 data_size 0x1(0x3dd bytes) 2024-09-12T05:20:36.649 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:36.649 INFO:teuthology.orchestra.run.smithi059.stdout:1339 writesame 0x7b14393 thru 0x7b23c5e data_size 0x2(0xf8cc bytes) 2024-09-12T05:20:36.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:36.709+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:36.720 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4630 3.1a 3:5ebba714:::rbd_data.1118e5842253.0000000000000077:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.581926983000001, 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039742162999999997, 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.721 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4630 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138451+0000", 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9570000000000001e-06 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138461+0000", 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9760000000000007e-06 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138489+0000", 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7742999999999998e-05 2024-09-12T05:20:36.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138504+0000", 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4960000000000001e-05 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138608+0000", 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104053 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138815+0000", 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000206832 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.145988+0000", 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071735109999999996 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.177998+0000", 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032009700000000002 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178028+0000", 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0209000000000002e-05 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178118+0000", 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9365999999999998e-05 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178191+0000", 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3856000000000006e-05 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.726 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10843 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.056947+0000", 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6634288579999996, 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029482554000000001, 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.727 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10843 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056947+0000", 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056947+0000", 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056949+0000", 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.53e-06 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056954+0000", 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8770000000000001e-06 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056975+0000", 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0985999999999999e-05 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.056989+0000", 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.438e-05 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.085647+0000", 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028658006999999999 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.085867+0000", 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021989899999999999 2024-09-12T05:20:36.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.086430+0000", 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056287500000000001 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10907 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.060847+0000", 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6595288749999995, 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029492616999999999, 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.731 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10907 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060847+0000", 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060847+0000", 2024-09-12T05:20:36.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060849+0000", 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7570000000000001e-06 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060854+0000", 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2530000000000004e-06 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060872+0000", 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.789e-05 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060887+0000", 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4263999999999999e-05 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.089562+0000", 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028675407 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.089775+0000", 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021315900000000001 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.090340+0000", 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056488700000000003 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10967 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 294912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.060917+0000", 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6594593020000001, 2024-09-12T05:20:36.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031039906999999999, 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10967 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060917+0000", 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060917+0000", 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060918+0000", 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2899999999999999e-06 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060924+0000", 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-12T05:20:36.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060942+0000", 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8283000000000001e-05 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060955+0000", 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3196999999999999e-05 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.090417+0000", 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029461560000000001 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.090613+0000", 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019550700000000001 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.091957+0000", 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013443000000000001 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10968 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 344064~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.060977+0000", 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6593997260000002, 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031831350000000001, 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10968 2024-09-12T05:20:36.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060977+0000", 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060977+0000", 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060978+0000", 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.254e-06 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.060983+0000", 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061001+0000", 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8357000000000001e-05 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061015+0000", 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3806e-05 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.092034+0000", 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031018885999999999 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.092249+0000", 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000215107 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.092808+0000", 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00055870699999999998 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10969 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 393216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061034+0000", 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6593424359999993, 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032757221000000003, 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.744 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10969 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061034+0000", 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061034+0000", 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061035+0000", 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4300000000000001e-06 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061041+0000", 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4260000000000002e-06 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061058+0000", 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7640000000000001e-05 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061072+0000", 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3557000000000001e-05 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.092884+0000", 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031811697999999999 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093153+0000", 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000269855 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093791+0000", 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063761500000000001 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10970 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.748 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6592863900000001, 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033399048000000001, 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10970 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:36.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061091+0000", 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1230000000000001e-06 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061096+0000", 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1000000000000003e-06 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061113+0000", 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7227e-05 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061127+0000", 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3793e-05 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093864+0000", 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032736994999999998 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094052+0000", 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018771799999999999 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094489+0000", 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043709199999999998 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.752 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10971 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6592317269999999, 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033948741999999997, 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.753 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10971 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061146+0000", 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.167e-06 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061151+0000", 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8899999999999998e-06 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061167+0000", 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6578999999999998e-05 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061181+0000", 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3587000000000001e-05 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094538+0000", 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033357568999999997 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094672+0000", 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133323 2024-09-12T05:20:36.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095093+0000", 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042162699999999999 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11031 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 303104~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6588189199999999, 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034486665, 2024-09-12T05:20:36.757 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11031 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061559+0000", 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061568+0000", 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5329999999999994e-06 2024-09-12T05:20:36.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061598+0000", 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0395999999999998e-05 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061618+0000", 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000001e-05 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095169+0000", 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033551105999999997 2024-09-12T05:20:36.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095379+0000", 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021028999999999999 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096044+0000", 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00066456000000000002 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11032 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 352256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6587263540000006, 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035279433999999998, 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11032 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061651+0000", 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.44e-06 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061658+0000", 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4529999999999999e-06 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061678+0000", 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0460000000000001e-05 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061693+0000", 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.468e-05 2024-09-12T05:20:36.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096100+0000", 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034407364000000003 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096256+0000", 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015584799999999999 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096929+0000", 2024-09-12T05:20:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067318900000000004 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11033 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 401408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6586623750000005, 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036054468999999999, 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11033 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061715+0000", 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061722+0000", 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5740000000000001e-06 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061741+0000", 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061754+0000", 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3257e-05 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096997+0000", 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035242809 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097165+0000", 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000168839 2024-09-12T05:20:36.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097768+0000", 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00060290099999999998 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11034 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 450560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.658603695, 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036605824000000002, 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.770 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11034 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:36.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061774+0000", 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.13e-06 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061779+0000", 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9169999999999997e-06 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061797+0000", 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7995999999999998e-05 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061810+0000", 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3753e-05 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097821+0000", 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036010845 2024-09-12T05:20:36.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097958+0000", 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137188 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098378+0000", 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041999499999999999 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11035 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 499712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6585458059999993, 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037210007000000003, 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11035 2024-09-12T05:20:36.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061832+0000", 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.243e-06 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061842+0000", 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0067e-05 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061860+0000", 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7923000000000001e-05 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061873+0000", 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3277e-05 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098443+0000", 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036569628999999999 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098601+0000", 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015857800000000001 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099040+0000", 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043929 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11095 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 262144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071019+0000", 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6493572289999996, 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029211827999999999, 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.779 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11095 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071019+0000", 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071019+0000", 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071022+0000", 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8370000000000001e-06 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071035+0000", 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3606e-05 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071069+0000", 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3074000000000002e-05 2024-09-12T05:20:36.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071087+0000", 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8657000000000001e-05 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099101+0000", 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028013672999999999 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099781+0000", 2024-09-12T05:20:36.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00068001800000000001 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100231+0000", 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000449963 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11096 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 311296~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071117+0000", 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6492592409999993, 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029594869999999999, 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.783 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11096 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071117+0000", 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071117+0000", 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071118+0000", 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071124+0000", 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0340000000000002e-06 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071143+0000", 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8794e-05 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071157+0000", 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3786e-05 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100318+0000", 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029161016000000001 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100407+0000", 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9411000000000002e-05 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100712+0000", 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030446899999999997 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11097 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 360448~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071183+0000", 2024-09-12T05:20:36.787 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6491935039999994, 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030088387000000001, 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11097 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071183+0000", 2024-09-12T05:20:36.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071183+0000", 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071184+0000", 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3939999999999999e-06 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071189+0000", 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071224+0000", 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4897000000000001e-05 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071238+0000", 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3831e-05 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100755+0000", 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029516923 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100874+0000", 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119188 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101271+0000", 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039707099999999998 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.791 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11098 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 409600~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071258+0000", 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6491181509999997, 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030624607000000002, 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11098 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.792 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071258+0000", 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071258+0000", 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071259+0000", 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2860000000000001e-06 2024-09-12T05:20:36.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071265+0000", 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1259999999999997e-06 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071282+0000", 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7538999999999999e-05 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071295+0000", 2024-09-12T05:20:36.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101353+0000", 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030058449000000001 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101504+0000", 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015117799999999999 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101883+0000", 2024-09-12T05:20:36.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037834300000000001 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11099 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 458752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071312+0000", 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6490642399999995, 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031176991000000001, 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.796 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11099 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071312+0000", 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071312+0000", 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071313+0000", 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.266e-06 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071318+0000", 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071335+0000", 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6934000000000001e-05 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071348+0000", 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2680000000000001e-05 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101932+0000", 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030584094999999999 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102052+0000", 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000120365 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102489+0000", 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043673099999999999 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11100 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 507904~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.071365+0000", 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6490115769999996, 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031595102999999999, 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.800 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11100 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071365+0000", 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071365+0000", 2024-09-12T05:20:36.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071366+0000", 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1739999999999999e-06 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071371+0000", 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.809e-06 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071387+0000", 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6796999999999999e-05 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071400+0000", 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2687999999999999e-05 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102539+0000", 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.031139314000000001 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102652+0000", 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112577 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102960+0000", 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030774399999999999 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11164 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 516096~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.077944+0000", 2024-09-12T05:20:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.6424321039999992, 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028937213999999999, 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11164 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:36.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077944+0000", 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077944+0000", 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077945+0000", 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0049999999999999e-06 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:36.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077949+0000", 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.822e-06 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077962+0000", 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2628e-05 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077971+0000", 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6420000000000002e-06 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.106361+0000", 2024-09-12T05:20:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028389761999999999 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.106515+0000", 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015405599999999999 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.106881+0000", 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000366299 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:36.809 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:36.810 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1341 trunc from 0xea41d23 to 0x4c65031 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1342 read 0x3cd0cd4 thru 0x3cdede0 (0xe10d bytes) 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1344 punch from 0x208c079 to 0x209368e, (0x7615 bytes) 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1345 write 0x10b56d5 thru 0x10b9764 (0x4090 bytes) 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1346 read 0x397394d thru 0x397a628 (0x6cdc bytes) 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1347 trunc from 0x4c65031 to 0x3430bde 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1352 read 0x32debdd thru 0x32e23e2 (0x3806 bytes) 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1353 read 0x18ecf84 thru 0x18f0bb4 (0x3c31 bytes) 2024-09-12T05:20:36.811 INFO:teuthology.orchestra.run.smithi059.stdout:1354 write 0x1fbd269 thru 0x1fc9a10 (0xc7a8 bytes) 2024-09-12T05:20:36.812 INFO:teuthology.orchestra.run.smithi059.stdout:1355 writesame 0x2b9916c thru 0x2b9a596 data_size 0x1(0x142b bytes) 2024-09-12T05:20:36.813 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:36.813+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:36.840 INFO:teuthology.orchestra.run.smithi059.stdout:1357 write 0xc4f3a33 thru 0xc4fe873 (0xae41 bytes) 2024-09-12T05:20:36.859 INFO:teuthology.orchestra.run.smithi059.stdout:1358 writesame 0x4dd6bb6 thru 0x4de0a9c data_size 0x1(0x9ee7 bytes) 2024-09-12T05:20:36.889 INFO:teuthology.orchestra.run.smithi059.stdout:1359 read 0x746c21 thru 0x74f095 (0x8475 bytes) 2024-09-12T05:20:36.906 INFO:teuthology.orchestra.run.smithi059.stdout:1360 write 0xda25872 thru 0xda2b1ca (0x5959 bytes) 2024-09-12T05:20:36.913 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:36.913+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:36.915 INFO:teuthology.orchestra.run.smithi059.stdout:1361 write 0x4eeca0b thru 0x4eeee1b (0x2411 bytes) 2024-09-12T05:20:36.919 INFO:teuthology.orchestra.run.smithi059.stdout:1363 write 0xbf3135a thru 0xbf412a0 (0xff47 bytes) 2024-09-12T05:20:36.934 INFO:teuthology.orchestra.run.smithi059.stdout:1364 punch from 0x5d8f752 to 0x5d9249c, (0x2d4a bytes) 2024-09-12T05:20:36.934 INFO:teuthology.orchestra.run.smithi059.stdout:1365 writesame 0xa8508c thru 0xa85b1b data_size 0x1a(0xa90 bytes) 2024-09-12T05:20:36.939 INFO:teuthology.orchestra.run.smithi059.stdout:1366 writesame 0xf51416 thru 0xf5a58b data_size 0x2b(0x9176 bytes) 2024-09-12T05:20:36.945 INFO:teuthology.orchestra.run.smithi059.stdout:1367 read 0x434cd2d thru 0x4356f27 (0xa1fb bytes) 2024-09-12T05:20:36.952 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:20:36.962 INFO:teuthology.orchestra.run.smithi059.stdout:1368 trunc from 0xda2b1cb to 0x6aa0b43 2024-09-12T05:20:36.993 INFO:teuthology.orchestra.run.smithi059.stdout:1370 trunc from 0x6aa0b43 to 0x8b9d873 2024-09-12T05:20:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:36.997 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:36.997 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:37.001 INFO:teuthology.orchestra.run.smithi059.stdout:1371 writesame 0x4544297 thru 0x454dcb0 data_size 0x4b(0x9a1a bytes) 2024-09-12T05:20:37.013 INFO:teuthology.orchestra.run.smithi059.stdout:1372 punch from 0x6e08465 to 0x6e15e75, (0xda10 bytes) 2024-09-12T05:20:37.013 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.013 INFO:teuthology.orchestra.run.smithi059.stdout:1374 write 0x3092297 thru 0x3095953 (0x36bd bytes) 2024-09-12T05:20:37.014 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:37.013+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:37.015 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:37.021 INFO:teuthology.orchestra.run.smithi059.stdout:1375 trunc from 0x8b9d873 to 0x567a55a 2024-09-12T05:20:37.028 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.028 INFO:teuthology.orchestra.run.smithi059.stdout:1378 read 0xb3b021 thru 0xb480d8 (0xd0b8 bytes) 2024-09-12T05:20:37.033 INFO:teuthology.orchestra.run.smithi059.stdout:1379 trunc from 0x567a55a to 0x2e33701 2024-09-12T05:20:37.065 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.065 INFO:teuthology.orchestra.run.smithi059.stdout:1384 read 0x144a402 thru 0x1458f72 (0xeb71 bytes) 2024-09-12T05:20:37.074 INFO:teuthology.orchestra.run.smithi059.stdout:1386 trunc from 0x2e33701 to 0x6b85dae 2024-09-12T05:20:37.102 INFO:teuthology.orchestra.run.smithi059.stdout:1387 write 0x9b97514 thru 0x9ba41c7 (0xccb4 bytes) 2024-09-12T05:20:37.115 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:37.117+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:37.118 INFO:teuthology.orchestra.run.smithi059.stdout:1388 punch from 0x86d65d8 to 0x86e4a8f, (0xe4b7 bytes) 2024-09-12T05:20:37.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:37.122 INFO:teuthology.orchestra.run.smithi059.stdout:1389 trunc from 0x9ba41c8 to 0x867905b 2024-09-12T05:20:37.144 INFO:teuthology.orchestra.run.smithi059.stdout:1391 write 0x6679a71 thru 0x66889fc (0xef8c bytes) 2024-09-12T05:20:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:37.166 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:37.167 INFO:teuthology.orchestra.run.smithi059.stdout:1392 read 0x402f944 thru 0x4031a0d (0x20ca bytes) 2024-09-12T05:20:37.167 INFO:teuthology.orchestra.run.smithi059.stdout:1393 read 0x2a8ccb5 thru 0x2a9b5f4 (0xe940 bytes) 2024-09-12T05:20:37.167 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.168 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.179 INFO:teuthology.orchestra.run.smithi059.stdout:1396 trunc from 0x867905b to 0xe77c208 2024-09-12T05:20:37.186 INFO:teuthology.orchestra.run.smithi059.stdout:1397 write 0x3ffde09 thru 0x400b32a (0xd522 bytes) 2024-09-12T05:20:37.216 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:37.217+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:37.216 INFO:teuthology.orchestra.run.smithi059.stdout:1399 trunc from 0xe77c208 to 0x1f9825c 2024-09-12T05:20:37.278 INFO:teuthology.orchestra.run.smithi059.stdout:1400 write 0xcf7b882 thru 0xcf85dc8 (0xa547 bytes) 2024-09-12T05:20:37.293 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:37.294 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:37.296 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.296 INFO:teuthology.orchestra.run.smithi059.stdout:1402 read 0x4a4a719 thru 0x4a52262 (0x7b4a bytes) 2024-09-12T05:20:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:37.301 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:37.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:37.301 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:37.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.301 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4530 3.1d 3:b845397b:::rbd_object_map.1118e5842253:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:37.301 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:37.302 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.403225832, 2024-09-12T05:20:37.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034828258000000001, 2024-09-12T05:20:37.302 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.302 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.302 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:37.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.303 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4530 2024-09-12T05:20:37.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.303 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:37.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:37.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898325+0000", 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898333+0000", 2024-09-12T05:20:37.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3200000000000002e-06 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898372+0000", 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9403000000000002e-05 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898403+0000", 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1282999999999998e-05 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925774+0000", 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027371126999999999 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925885+0000", 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110536 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.926372+0000", 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048729900000000001 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.931755+0000", 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053824099999999998 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.932970+0000", 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012150799999999999 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933079+0000", 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108736 2024-09-12T05:20:37.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933152+0000", 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3910000000000002e-05 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10924 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 278528~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062093+0000", 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.239457402999999, 2024-09-12T05:20:37.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033766996000000001, 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10924 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062093+0000", 2024-09-12T05:20:37.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062093+0000", 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062094+0000", 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.173e-06 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062099+0000", 2024-09-12T05:20:37.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1970000000000004e-06 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062117+0000", 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8332999999999999e-05 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062131+0000", 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4167e-05 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095052+0000", 2024-09-12T05:20:37.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032920387000000002 2024-09-12T05:20:37.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095258+0000", 2024-09-12T05:20:37.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020573299999999999 2024-09-12T05:20:37.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095860+0000", 2024-09-12T05:20:37.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00060200599999999998 2024-09-12T05:20:37.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.239400166999999, 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.317 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:20:37.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.317 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:20:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:20:37.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.239304144, 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:20:37.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.325 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.239244841, 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:20:37.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:20:37.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.239188134999999, 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:20:37.330 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.238160797000001, 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.335 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:20:37.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:20:37.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.238100940000001, 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.340 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:20:37.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.238013133999999, 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:20:37.344 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:37.348 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.237330696000001, 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.352 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.237244084, 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:20:37.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:20:37.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11053 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 294912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.357 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070689+0000", 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.230861496999999, 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.03328221, 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11053 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070689+0000", 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070689+0000", 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070691+0000", 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.469e-06 2024-09-12T05:20:37.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070702+0000", 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1334e-05 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070727+0000", 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5131e-05 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070763+0000", 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5234000000000002e-05 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103489+0000", 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032726606999999998 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103627+0000", 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013767599999999999 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103971+0000", 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00034375900000000001 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11054 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 344064~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070795+0000", 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.230754992, 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033674177, 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.362 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11054 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070795+0000", 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070795+0000", 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070796+0000", 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3489999999999999e-06 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070815+0000", 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8227999999999999e-05 2024-09-12T05:20:37.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070835+0000", 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0837000000000001e-05 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070850+0000", 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4776999999999999e-05 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104013+0000", 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033163087000000001 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104122+0000", 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010825200000000001 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104469+0000", 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00034764699999999997 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.366 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11055 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 393216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070874+0000", 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.230676081, 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034136239999999998, 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.367 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11055 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070874+0000", 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070874+0000", 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070875+0000", 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.426e-06 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070881+0000", 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9569999999999999e-06 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070897+0000", 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6147999999999999e-05 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070911+0000", 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3662999999999999e-05 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104515+0000", 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033603715999999999 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.104640+0000", 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012482500000000001 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105010+0000", 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037050499999999998 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11056 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070931+0000", 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.230619207, 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034562506, 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.372 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11056 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070931+0000", 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070931+0000", 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070932+0000", 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.063e-06 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070940+0000", 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6939999999999995e-06 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070957+0000", 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6962000000000001e-05 2024-09-12T05:20:37.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070969+0000", 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2031999999999999e-05 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105063+0000", 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034094363000000003 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105158+0000", 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5122000000000002e-05 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105493+0000", 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00033526999999999998 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11057 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.230562001999999, 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034782517999999998, 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11057 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.377 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070989+0000", 2024-09-12T05:20:37.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.268e-06 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071050+0000", 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0294000000000002e-05 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071068+0000", 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8683000000000001e-05 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071083+0000", 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5167999999999999e-05 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105540+0000", 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034457039000000002 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105657+0000", 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116248 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105771+0000", 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113818 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11183 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 655360~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.076889+0000", 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.224660644, 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033440448999999997, 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.381 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11183 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076889+0000", 2024-09-12T05:20:37.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076889+0000", 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076891+0000", 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3170000000000001e-06 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076896+0000", 2024-09-12T05:20:37.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6999999999999996e-06 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076915+0000", 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8845999999999999e-05 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076929+0000", 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4207e-05 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.109666+0000", 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032736563000000003 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.109806+0000", 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013991900000000001 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110330+0000", 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00052389699999999995 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.385 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11184 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 704512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.076949+0000", 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.224600981, 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033865792999999998, 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.386 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11184 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076949+0000", 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076949+0000", 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076950+0000", 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1400000000000001e-06 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076970+0000", 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0230000000000001e-05 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.076992+0000", 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1325999999999999e-05 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077008+0000", 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6509999999999999e-05 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110380+0000", 2024-09-12T05:20:37.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033371425000000003 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110493+0000", 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011322 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110815+0000", 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032194199999999997 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11185 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 753664~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.077028+0000", 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.224521712, 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034400746000000003, 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.391 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11185 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077028+0000", 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077028+0000", 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077030+0000", 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4339999999999999e-06 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077036+0000", 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2430000000000002e-06 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077054+0000", 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8219999999999998e-05 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.077071+0000", 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6665999999999999e-05 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.110887+0000", 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033816484000000001 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.111033+0000", 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145902 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.111429+0000", 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039579699999999998 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11249 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.080857+0000", 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.220693334, 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034131901999999999, 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11249 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080857+0000", 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080857+0000", 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080858+0000", 2024-09-12T05:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3e-06 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080881+0000", 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3237000000000001e-05 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080900+0000", 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8617000000000001e-05 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:37.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.080914+0000", 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3691e-05 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.113676+0000", 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032762566999999999 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.114667+0000", 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099052600000000004 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:37.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:37.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.114989+0000", 2024-09-12T05:20:37.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321964 2024-09-12T05:20:37.400 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.400 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.400 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.400 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:37.400 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:37.400 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:37.401 INFO:teuthology.orchestra.run.smithi059.stdout:1403 trunc from 0xcf85dc9 to 0x2af31c5 2024-09-12T05:20:37.401 INFO:teuthology.orchestra.run.smithi059.stdout:1405 write 0x7e3f171 thru 0x7e44218 (0x50a8 bytes) 2024-09-12T05:20:37.401 INFO:teuthology.orchestra.run.smithi059.stdout:1406 write 0xa991230 thru 0xa99cb25 (0xb8f6 bytes) 2024-09-12T05:20:37.402 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:37.402 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:37.401+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:37.409 INFO:teuthology.orchestra.run.smithi059.stdout:1407 write 0x76e2b73 thru 0x76eeb99 (0xc027 bytes) 2024-09-12T05:20:37.441 INFO:teuthology.orchestra.run.smithi059.stdout:1408 write 0xa9fc890 thru 0xaa00ab7 (0x4228 bytes) 2024-09-12T05:20:37.448 INFO:teuthology.orchestra.run.smithi059.stdout:1410 read 0x35df674 thru 0x35ee362 (0xecef bytes) 2024-09-12T05:20:37.463 INFO:teuthology.orchestra.run.smithi059.stdout:1411 writesame 0xb0a7757 thru 0xb0b06f2 data_size 0x65(0x8f9c bytes) 2024-09-12T05:20:37.463 INFO:teuthology.orchestra.run.smithi059.stdout:1413 read 0xa9db612 thru 0xa9e855f (0xcf4e bytes) 2024-09-12T05:20:37.464 INFO:teuthology.orchestra.run.smithi059.stdout:1414 read 0xcc4f1c thru 0xcce918 (0x99fd bytes) 2024-09-12T05:20:37.482 INFO:teuthology.orchestra.run.smithi059.stdout:1415 trunc from 0xb0b06f3 to 0x4d1c27d 2024-09-12T05:20:37.502 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:37.501+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:37.511 INFO:teuthology.orchestra.run.smithi059.stdout:1416 read 0x44aa11c thru 0x44b85f0 (0xe4d5 bytes) 2024-09-12T05:20:37.512 INFO:teuthology.orchestra.run.smithi059.stdout:1417 write 0x89687f thru 0x89cb4a (0x62cc bytes) 2024-09-12T05:20:37.522 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:37.522 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:37.522 INFO:teuthology.orchestra.run.smithi059.stdout:1419 read 0xcb5826 thru 0xcbd8b7 (0x8092 bytes) 2024-09-12T05:20:37.522 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.523 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.523 INFO:teuthology.orchestra.run.smithi059.stdout:1422 read 0xf6847f thru 0xf7493b (0xc4bd bytes) 2024-09-12T05:20:37.523 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.523 INFO:teuthology.orchestra.run.smithi059.stdout:1426 write 0x269091d thru 0x269ec7f (0xe363 bytes) 2024-09-12T05:20:37.533 INFO:teuthology.orchestra.run.smithi059.stdout:1427 read 0x3217030 thru 0x3221416 (0xa3e7 bytes) 2024-09-12T05:20:37.533 INFO:teuthology.orchestra.run.smithi059.stdout:1428 writesame 0x3dc1213 thru 0x3dc9522 data_size 0x18(0x8310 bytes) 2024-09-12T05:20:37.543 INFO:teuthology.orchestra.run.smithi059.stdout:1429 punch from 0x3faae1c to 0x3fb2fca, (0x81ae bytes) 2024-09-12T05:20:37.543 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.560 INFO:teuthology.orchestra.run.smithi059.stdout:1433 trunc from 0x4d1c27d to 0xbfbfc91 2024-09-12T05:20:37.563 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:37.563 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:37.571 INFO:teuthology.orchestra.run.smithi059.stdout:1435 writesame 0xb034683 thru 0xb037de9 data_size 0x1(0x3767 bytes) 2024-09-12T05:20:37.586 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:37.586 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:37.586 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:37.586 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:37.599 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:37.599 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:37.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:37.602 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:37.601+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:37.605 INFO:teuthology.orchestra.run.smithi059.stdout:1436 trunc from 0xbfbfc91 to 0x2f22471 2024-09-12T05:20:37.621 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.627 INFO:teuthology.orchestra.run.smithi059.stdout:1438 trunc from 0x2f22471 to 0x13e9d2 2024-09-12T05:20:37.633 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:37.659 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:37.659 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:37.670 INFO:teuthology.orchestra.run.smithi059.stdout:1439 trunc from 0x13e9d2 to 0x229e3ca 2024-09-12T05:20:37.679 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:37.697 INFO:teuthology.orchestra.run.smithi059.stdout:1440 write 0x6a82465 thru 0x6a83666 (0x1202 bytes) 2024-09-12T05:20:37.701 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:37.701 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:37.703 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:37.701+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:37.712 INFO:teuthology.orchestra.run.smithi059.stdout:1441 write 0x7dbdce9 thru 0x7dc6912 (0x8c2a bytes) 2024-09-12T05:20:37.740 INFO:teuthology.orchestra.run.smithi059.stdout:1443 write 0xbeeac58 thru 0xbeef9d7 (0x4d80 bytes) 2024-09-12T05:20:37.754 INFO:teuthology.orchestra.run.smithi059.stdout:1446 write 0x3e48f7f thru 0x3e4c256 (0x32d8 bytes) 2024-09-12T05:20:37.766 INFO:teuthology.orchestra.run.smithi059.stdout:1448 writesame 0x9526a24 thru 0x9526b5e data_size 0x9(0x13b bytes) 2024-09-12T05:20:37.772 INFO:teuthology.orchestra.run.smithi059.stdout:1449 read 0x2885f29 thru 0x288df10 (0x7fe8 bytes) 2024-09-12T05:20:37.772 INFO:teuthology.orchestra.run.smithi059.stdout:1452 read 0x9626c72 thru 0x962fb68 (0x8ef7 bytes) 2024-09-12T05:20:37.773 INFO:teuthology.orchestra.run.smithi059.stdout:1453 write 0x5721879 thru 0x5726cc2 (0x544a bytes) 2024-09-12T05:20:37.781 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:37.781 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:37.788 INFO:teuthology.orchestra.run.smithi059.stdout:1454 read 0xb5770b1 thru 0xb57cfdd (0x5f2d bytes) 2024-09-12T05:20:37.788 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.797 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:37.801 INFO:teuthology.orchestra.run.smithi059.stdout:1457 trunc from 0xbeef9d8 to 0x57a9d5f 2024-09-12T05:20:37.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:37.841+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:37.844 INFO:teuthology.orchestra.run.smithi059.stdout:1458 trunc from 0x57a9d5f to 0x7630e 2024-09-12T05:20:37.869 INFO:teuthology.orchestra.run.smithi059.stdout:1461 read 0x618fc thru 0x6a47b (0x8b80 bytes) 2024-09-12T05:20:37.871 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.905 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:37.905+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:37.912 INFO:teuthology.orchestra.run.smithi059.stdout:1464 write 0xb9405e5 thru 0xb94485c (0x4278 bytes) 2024-09-12T05:20:37.922 INFO:teuthology.orchestra.run.smithi059.stdout:1465 writesame 0x8106e80 thru 0x810b5b8 data_size 0x1(0x4739 bytes) 2024-09-12T05:20:37.956 INFO:teuthology.orchestra.run.smithi059.stdout:1466 write 0xc972f3c thru 0xc9732bf (0x384 bytes) 2024-09-12T05:20:37.958 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:37.959 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:37.959 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-12T05:20:37.959 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T05:20:37.959 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T05:20:37.959 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-12T05:20:37.963 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:37.969 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:37.969 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:37.977 INFO:teuthology.orchestra.run.smithi059.stdout:1468 trunc from 0xc9732c0 to 0x740e2ca 2024-09-12T05:20:37.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:38.001 INFO:teuthology.orchestra.run.smithi059.stdout:1469 read 0x1cdff4f thru 0x1cec2b5 (0xc367 bytes) 2024-09-12T05:20:38.001 INFO:teuthology.orchestra.run.smithi059.stdout:1471 read 0x4cc544f thru 0x4cd3e81 (0xea33 bytes) 2024-09-12T05:20:38.028 INFO:teuthology.orchestra.run.smithi059.stdout:1472 write 0xbe00852 thru 0xbe0c209 (0xb9b8 bytes) 2024-09-12T05:20:38.032 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:38.033+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:38.038 INFO:teuthology.orchestra.run.smithi059.stdout:1473 read 0x2197056 thru 0x219b554 (0x44ff bytes) 2024-09-12T05:20:38.053 INFO:teuthology.orchestra.run.smithi059.stdout:1475 write 0xc41f16c thru 0xc42a37d (0xb212 bytes) 2024-09-12T05:20:38.068 INFO:teuthology.orchestra.run.smithi059.stdout:1476 read 0xb83a231 thru 0xb83d8b0 (0x3680 bytes) 2024-09-12T05:20:38.068 INFO:teuthology.orchestra.run.smithi059.stdout:1478 read 0xcaa84e thru 0xcabdd0 (0x1583 bytes) 2024-09-12T05:20:38.071 INFO:teuthology.orchestra.run.smithi059.stdout:1479 trunc from 0xc42a37e to 0xd7738fc 2024-09-12T05:20:38.084 INFO:teuthology.orchestra.run.smithi059.stdout:1480 read 0x4a36df5 thru 0x4a45860 (0xea6c bytes) 2024-09-12T05:20:38.084 INFO:teuthology.orchestra.run.smithi059.stdout:1482 writesame 0x42021db thru 0x420a3ee data_size 0x2d(0x8214 bytes) 2024-09-12T05:20:38.097 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:38.097 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T05:20:38.097 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:38.099 INFO:teuthology.orchestra.run.smithi059.stdout:1483 write 0x6a4f84e thru 0x6a532c0 (0x3a73 bytes) 2024-09-12T05:20:38.108 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:38.109+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:38.108 INFO:teuthology.orchestra.run.smithi059.stdout:1484 punch from 0x271f5 to 0x33616, (0xc421 bytes) 2024-09-12T05:20:38.108 INFO:teuthology.orchestra.run.smithi059.stdout:1485 read 0xc877c70 thru 0xc880503 (0x8894 bytes) 2024-09-12T05:20:38.108 INFO:teuthology.orchestra.run.smithi059.stdout:1487 read 0x133f1bc thru 0x1340b31 (0x1976 bytes) 2024-09-12T05:20:38.124 INFO:teuthology.orchestra.run.smithi059.stdout:1488 write 0xea99cf4 thru 0xeaa8b30 (0xee3d bytes) 2024-09-12T05:20:38.138 INFO:teuthology.orchestra.run.smithi059.stdout:1489 read 0x7b81cb4 thru 0x7b8d059 (0xb3a6 bytes) 2024-09-12T05:20:38.138 INFO:teuthology.orchestra.run.smithi059.stdout:1493 write 0x2789167 thru 0x27966ba (0xd554 bytes) 2024-09-12T05:20:38.155 INFO:teuthology.orchestra.run.smithi059.stdout:1495 write 0x2455196 thru 0x2458a2b (0x3896 bytes) 2024-09-12T05:20:38.166 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:38.166 INFO:teuthology.orchestra.run.smithi059.stdout:1497 writesame 0xa3deb09 thru 0xa3e584b data_size 0x1(0x6d43 bytes) 2024-09-12T05:20:38.170 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:38.170 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:38.187 INFO:teuthology.orchestra.run.smithi059.stdout:1498 write 0xb1b9fa8 thru 0xb1c2d17 (0x8d70 bytes) 2024-09-12T05:20:38.189 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:38.233 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:38.233+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:38.238 INFO:teuthology.orchestra.run.smithi059.stdout:1499 trunc from 0xeaa8b31 to 0x7934da 2024-09-12T05:20:38.276 INFO:teuthology.orchestra.run.smithi059.stdout:1500 read 0x502f4b thru 0x50a67a (0x7730 bytes) 2024-09-12T05:20:38.277 INFO:teuthology.orchestra.run.smithi059.stdout:1501 writesame 0x41a571 thru 0x41e47c data_size 0x1e(0x3f0c bytes) 2024-09-12T05:20:38.309 INFO:teuthology.orchestra.run.smithi059.stdout:1502 trunc from 0x7934da to 0x8ffafa3 2024-09-12T05:20:38.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:38.309+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:38.326 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:38.339 INFO:teuthology.orchestra.run.smithi059.stdout:1503 write 0xa912e53 thru 0xa91b475 (0x8623 bytes) 2024-09-12T05:20:38.356 INFO:teuthology.orchestra.run.smithi059.stdout:1506 write 0x95cc14f thru 0x95d0c9d (0x4b4f bytes) 2024-09-12T05:20:38.373 INFO:teuthology.orchestra.run.smithi059.stdout:1507 trunc from 0xa91b476 to 0x7f4aeb8 2024-09-12T05:20:38.396 INFO:teuthology.orchestra.run.smithi059.stdout:1508 write 0x635d4bc thru 0x636cb3c (0xf681 bytes) 2024-09-12T05:20:38.412 INFO:teuthology.orchestra.run.smithi059.stdout:1510 punch from 0x87381e to 0x87db56, (0xa338 bytes) 2024-09-12T05:20:38.412 INFO:teuthology.orchestra.run.smithi059.stdout:1511 write 0x516780 thru 0x51cd95 (0x6616 bytes) 2024-09-12T05:20:38.417 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:38.417+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:38.424 INFO:teuthology.orchestra.run.smithi059.stdout:1512 read 0x6ca1150 thru 0x6ca4311 (0x31c2 bytes) 2024-09-12T05:20:38.424 INFO:teuthology.orchestra.run.smithi059.stdout:1513 punch from 0x63e451a to 0x63e8af2, (0x45d8 bytes) 2024-09-12T05:20:38.458 INFO:teuthology.orchestra.run.smithi059.stdout:1514 writesame 0xe22f504 thru 0xe23b6cb data_size 0x75(0xc1c8 bytes) 2024-09-12T05:20:38.458 INFO:teuthology.orchestra.run.smithi059.stdout:1515 punch from 0xd9e2aa8 to 0xd9eb2b0, (0x8808 bytes) 2024-09-12T05:20:38.458 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:38.458 INFO:teuthology.orchestra.run.smithi059.stdout:1517 read 0x3740ebf thru 0x3750cce (0xfe10 bytes) 2024-09-12T05:20:38.458 INFO:teuthology.orchestra.run.smithi059.stdout:1518 punch from 0x2d97b13 to 0x2d9a6d0, (0x2bbd bytes) 2024-09-12T05:20:38.458 INFO:teuthology.orchestra.run.smithi059.stdout:1520 read 0xc1506e thru 0xc197da (0x476d bytes) 2024-09-12T05:20:38.474 INFO:teuthology.orchestra.run.smithi059.stdout:1521 writesame 0xee2f6af thru 0xee31f66 data_size 0x4(0x28b8 bytes) 2024-09-12T05:20:38.474 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:38.474 INFO:teuthology.orchestra.run.smithi059.stdout:1523 punch from 0x8e26961 to 0x8e28850, (0x1eef bytes) 2024-09-12T05:20:38.474 INFO:teuthology.orchestra.run.smithi059.stdout:1524 punch from 0x423f7b3 to 0x424a5b7, (0xae04 bytes) 2024-09-12T05:20:38.474 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:38.475 INFO:teuthology.orchestra.run.smithi059.stdout:1527 write 0xa11cd2e thru 0xa12c392 (0xf665 bytes) 2024-09-12T05:20:38.503 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:38.503 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:38.511 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:38.509+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:38.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:38.524 INFO:teuthology.orchestra.run.smithi059.stdout:1531 trunc from 0xee31f67 to 0x40c606e 2024-09-12T05:20:38.579 INFO:teuthology.orchestra.run.smithi059.stdout:1533 write 0xeaaa497 thru 0xeaaf32d (0x4e97 bytes) 2024-09-12T05:20:38.596 INFO:teuthology.orchestra.run.smithi059.stdout:1535 read 0xaf03aa2 thru 0xaf0df80 (0xa4df bytes) 2024-09-12T05:20:38.596 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:38.596 INFO:teuthology.orchestra.run.smithi059.stdout:1537 punch from 0x6eb6e8 to 0x6f7f43, (0xc85b bytes) 2024-09-12T05:20:38.596 INFO:teuthology.orchestra.run.smithi059.stdout:1540 write 0xf7fcfb thru 0xf81940 (0x1c46 bytes) 2024-09-12T05:20:38.613 INFO:teuthology.orchestra.run.smithi059.stdout:1541 trunc from 0xeaaf32e to 0xbb24445 2024-09-12T05:20:38.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:38.613+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:38.636 INFO:teuthology.orchestra.run.smithi059.stdout:1542 read 0x2d1129e thru 0x2d1afd6 (0x9d39 bytes) 2024-09-12T05:20:38.644 INFO:teuthology.orchestra.run.smithi059.stdout:1543 trunc from 0xbb24445 to 0x868096d 2024-09-12T05:20:38.656 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:38.656 INFO:teuthology.orchestra.run.smithi059.stdout:1545 read 0x185e8b3 thru 0x18664e2 (0x7c30 bytes) 2024-09-12T05:20:38.656 INFO:teuthology.orchestra.run.smithi059.stdout:1546 punch from 0x7877b01 to 0x78794dc, (0x19db bytes) 2024-09-12T05:20:38.657 INFO:teuthology.orchestra.run.smithi059.stdout:1548 read 0x5a6da53 thru 0x5a73d4e (0x62fc bytes) 2024-09-12T05:20:38.657 INFO:teuthology.orchestra.run.smithi059.stdout:1549 punch from 0x72540f3 to 0x725aff2, (0x6eff bytes) 2024-09-12T05:20:38.661 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:38.662 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:38.667 INFO:teuthology.orchestra.run.smithi059.stdout:1551 trunc from 0x868096d to 0xce67105 2024-09-12T05:20:38.681 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:38.681 INFO:teuthology.orchestra.run.smithi059.stdout:1552 write 0x7fa98ff thru 0x7faf587 (0x5c89 bytes) 2024-09-12T05:20:38.696 INFO:teuthology.orchestra.run.smithi059.stdout:1555 read 0x8eb82e1 thru 0x8ec5e40 (0xdb60 bytes) 2024-09-12T05:20:38.696 INFO:teuthology.orchestra.run.smithi059.stdout:1556 write 0x7ed9972 thru 0x7ee5dce (0xc45d bytes) 2024-09-12T05:20:38.714 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:38.713+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:38.714 INFO:teuthology.orchestra.run.smithi059.stdout:1560 trunc from 0xce67105 to 0xda159af 2024-09-12T05:20:38.723 INFO:teuthology.orchestra.run.smithi059.stdout:1561 write 0x6d64caa thru 0x6d6948f (0x47e6 bytes) 2024-09-12T05:20:38.737 INFO:teuthology.orchestra.run.smithi059.stdout:1562 write 0x76ad2fa thru 0x76baa20 (0xd727 bytes) 2024-09-12T05:20:38.756 INFO:teuthology.orchestra.run.smithi059.stdout:1563 write 0x9ab5bba thru 0x9abab7a (0x4fc1 bytes) 2024-09-12T05:20:38.784 INFO:teuthology.orchestra.run.smithi059.stdout:1564 writesame 0xee38756 thru 0xee443e2 data_size 0x2f(0xbc8d bytes) 2024-09-12T05:20:38.784 INFO:teuthology.orchestra.run.smithi059.stdout:1566 write 0x8ce3fe9 thru 0x8cec4a7 (0x84bf bytes) 2024-09-12T05:20:38.800 INFO:teuthology.orchestra.run.smithi059.stdout:1568 writesame 0x20d89fe thru 0x20e520b data_size 0x1d(0xc80e bytes) 2024-09-12T05:20:38.815 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:38.813+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:38.816 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:38.816 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:38.817 INFO:teuthology.orchestra.run.smithi059.stdout:1569 writesame 0x5d413e5 thru 0x5d49bec data_size 0xc(0x8808 bytes) 2024-09-12T05:20:38.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:38.834 INFO:teuthology.orchestra.run.smithi059.stdout:1570 read 0xcfc6054 thru 0xcfc89ad (0x295a bytes) 2024-09-12T05:20:38.834 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:38.834 INFO:teuthology.orchestra.run.smithi059.stdout:1572 write 0xdff4311 thru 0xe002907 (0xe5f7 bytes) 2024-09-12T05:20:38.861 INFO:teuthology.orchestra.run.smithi059.stdout:1573 trunc from 0xee443e3 to 0x82bcb97 2024-09-12T05:20:38.890 INFO:teuthology.orchestra.run.smithi059.stdout:1575 write 0x58ec736 thru 0x58f0d7b (0x4646 bytes) 2024-09-12T05:20:38.903 INFO:teuthology.orchestra.run.smithi059.stdout:1576 trunc from 0x82bcb97 to 0x754984c 2024-09-12T05:20:38.915 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:38.917+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:38.948 INFO:teuthology.orchestra.run.smithi059.stdout:1577 write 0xd0eb0f3 thru 0xd0f61d0 (0xb0de bytes) 2024-09-12T05:20:38.964 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:38.964 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:38.968 INFO:teuthology.orchestra.run.smithi059.stdout:1580 punch from 0x912dbca to 0x9138fc7, (0xb3fd bytes) 2024-09-12T05:20:38.968 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:38.968 INFO:teuthology.orchestra.run.smithi059.stdout:1582 write 0xcae63ff thru 0xcaeb336 (0x4f38 bytes) 2024-09-12T05:20:38.979 INFO:teuthology.orchestra.run.smithi059.stdout:1583 write 0xc67716e thru 0xc67c65c (0x54ef bytes) 2024-09-12T05:20:38.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:20:38.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:39.008 INFO:teuthology.orchestra.run.smithi059.stdout:1586 trunc from 0xd0f61d1 to 0x6844ae2 2024-09-12T05:20:39.034 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:39.035 INFO:teuthology.orchestra.run.smithi059.stdout:1588 read 0x115fbe2 thru 0x1161ea5 (0x22c4 bytes) 2024-09-12T05:20:39.035 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:39.033+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:39.047 INFO:teuthology.orchestra.run.smithi059.stdout:1590 write 0x7b9c471 thru 0x7ba9a32 (0xd5c2 bytes) 2024-09-12T05:20:39.066 INFO:teuthology.orchestra.run.smithi059.stdout:1593 read 0x726e7ad thru 0x7274b40 (0x6394 bytes) 2024-09-12T05:20:39.067 INFO:teuthology.orchestra.run.smithi059.stdout:1594 read 0x51bdf6a thru 0x51c3d17 (0x5dae bytes) 2024-09-12T05:20:39.086 INFO:teuthology.orchestra.run.smithi059.stdout:1595 write 0xe099c7f thru 0xe0a6b9d (0xcf1f bytes) 2024-09-12T05:20:39.105 INFO:teuthology.orchestra.run.smithi059.stdout:1596 write 0xb6beb6a thru 0xb6c5a79 (0x6f10 bytes) 2024-09-12T05:20:39.117 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:39.117+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:39.123 INFO:teuthology.orchestra.run.smithi059.stdout:1598 read 0xa8e3b1c thru 0xa8ec66d (0x8b52 bytes) 2024-09-12T05:20:39.123 INFO:teuthology.orchestra.run.smithi059.stdout:1600 punch from 0x1dc1c0f to 0x1dcd4dd, (0xb8ce bytes) 2024-09-12T05:20:39.123 INFO:teuthology.orchestra.run.smithi059.stdout:1601 read 0x5fead6d thru 0x5ff9b0c (0xeda0 bytes) 2024-09-12T05:20:39.138 INFO:teuthology.orchestra.run.smithi059.stdout:1604 trunc from 0xe0a6b9e to 0x3ad90e8 2024-09-12T05:20:39.150 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:39.150 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:39.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:39.187 INFO:teuthology.orchestra.run.smithi059.stdout:1605 writesame 0x9df6641 thru 0x9e02ae0 data_size 0xb0(0xc4a0 bytes) 2024-09-12T05:20:39.187 INFO:teuthology.orchestra.run.smithi059.stdout:1606 punch from 0x5731b3e to 0x57397b3, (0x7c75 bytes) 2024-09-12T05:20:39.197 INFO:teuthology.orchestra.run.smithi059.stdout:1607 trunc from 0x9e02ae1 to 0x318aef9 2024-09-12T05:20:39.206 INFO:teuthology.orchestra.run.smithi059.stdout:1608 read 0x8e3ebd thru 0x8f13d7 (0xd51b bytes) 2024-09-12T05:20:39.206 INFO:teuthology.orchestra.run.smithi059.stdout:1609 clone 12 order 18 su 1024 sc 14 2024-09-12T05:20:39.218 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:39.217+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:39.306 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:39.307 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:39.319 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:39.321+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:39.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:39.420 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:39.421+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:39.491 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:39.491 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:39.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:39.548 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:39.549+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:39.623 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:39.621+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:39.677 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:39.677 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:39.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:39.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:39.736 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:39.737+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:39.825 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:39.825+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:39.864 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:39.864 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:39.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:39.896 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:39.896 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:39.914 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:39.914 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:39.925 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:39.925+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:39.931 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:39.931 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:39.948 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:39.948 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:39.966 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:20:39.970 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:39.970 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:40.003 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:40.026 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:40.025+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:40.027 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:40.027 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:40.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:40.027 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:40.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.027 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:20:40.027 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.049834467, 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:40.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:20:40.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:20:40.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8553 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'44, mlcod=37'40)", 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.188338936999999, 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048787479999999996, 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.032 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.033 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:40.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:40.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840757+0000", 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840761+0000", 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0790000000000002e-06 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840771+0000", 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0151e-05 2024-09-12T05:20:40.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840776+0000", 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9389999999999996e-06 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840826+0000", 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9521999999999998e-05 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840845+0000", 2024-09-12T05:20:40.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9360000000000001e-05 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845590+0000", 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004744687 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845635+0000", 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5423999999999997e-05 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.13820215, 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:40.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:20:40.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:20:40.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.042 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.042 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9013 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'63, mlcod=37'59)", 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.059625721, 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051699299999999997, 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:40.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6400000000000002e-07 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969476+0000", 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0440000000000001e-06 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969490+0000", 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3328e-05 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969497+0000", 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2559999999999996e-06 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969563+0000", 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5879999999999999e-05 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969589+0000", 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5972000000000001e-05 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974583+0000", 2024-09-12T05:20:40.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049945379999999998 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974640+0000", 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6248000000000001e-05 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9885 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'109, mlcod=37'106)", 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.756260492999999, 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051369570000000002, 2024-09-12T05:20:40.047 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:40.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272840+0000", 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1559999999999997e-06 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272848+0000", 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-06 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272853+0000", 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4569999999999998e-06 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272896+0000", 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3441e-05 2024-09-12T05:20:40.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272911+0000", 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4484000000000001e-05 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277923+0000", 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050118480000000002 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277972+0000", 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9174e-05 2024-09-12T05:20:40.051 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.755501666000001, 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:20:40.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9901 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'114, mlcod=37'110)", 2024-09-12T05:20:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.731831517, 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048386820000000004, 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297264+0000", 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297265+0000", 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6700000000000003e-07 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297270+0000", 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5759999999999996e-06 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297281+0000", 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1240000000000001e-05 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297288+0000", 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.472e-06 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297350+0000", 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1625999999999996e-05 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.297369+0000", 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9673e-05 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.302000+0000", 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046303610000000004 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.302103+0000", 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010296700000000001 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.060 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10139 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'147, mlcod=37'142)", 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.587393759999999, 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051775290000000002, 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441706+0000", 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.985e-06 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441716+0000", 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3810000000000005e-06 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441722+0000", 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:20:40.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441772+0000", 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9465999999999997e-05 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441792+0000", 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0560999999999998e-05 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446825+0000", 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050325259999999998 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446879+0000", 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999999e-05 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:20:40.065 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.521458019000001, 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:20:40.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10192 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'159, mlcod=37'154)", 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.520704579, 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048454229999999997, 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.070 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508391+0000", 2024-09-12T05:20:40.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508396+0000", 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9219999999999996e-06 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508407+0000", 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0902e-05 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508414+0000", 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8920000000000003e-06 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508463+0000", 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8829999999999998e-05 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.508484+0000", 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.143e-05 2024-09-12T05:20:40.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513207+0000", 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047223289999999999 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513236+0000", 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9403e-05 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.074 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10212 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'166, mlcod=37'162)", 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.493559040999999, 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004931403, 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535537+0000", 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5799999999999999e-07 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535542+0000", 2024-09-12T05:20:40.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0159999999999999e-06 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535554+0000", 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2199e-05 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535564+0000", 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7070000000000004e-06 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535606+0000", 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2391999999999997e-05 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535627+0000", 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0503e-05 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540427+0000", 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047999770000000004 2024-09-12T05:20:40.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540468+0000", 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0951000000000001e-05 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.491333687999999, 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.079 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:40.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:20:40.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10236 3.9 e37/23 3:91b6a2ae:::rbd_data.11182c6d9c71.0000000000000179:head v 37'56, mlcod=37'54)", 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.45461972, 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047699020000000003, 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574476+0000", 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9100000000000003e-07 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574482+0000", 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3519999999999997e-06 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574492+0000", 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0733999999999999e-05 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574498+0000", 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1410000000000004e-06 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574556+0000", 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8403000000000003e-05 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.574579+0000", 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319000000000002e-05 2024-09-12T05:20:40.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.579173+0000", 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045932000000000004 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.579246+0000", 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2961999999999997e-05 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.929245907, 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:20:40.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.927291689, 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.093 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11437 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'65, mlcod=38'62)", 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.924410577, 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049658940000000002, 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104691+0000", 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0979999999999999e-06 2024-09-12T05:20:40.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104702+0000", 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0611999999999999e-05 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104711+0000", 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107402+0000", 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026907889999999999 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107423+0000", 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1035000000000001e-05 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109616+0000", 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021936870000000002 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109651+0000", 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4434999999999998e-05 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9859829549999999, 2024-09-12T05:20:40.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:20:40.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:20:40.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9693863619999998, 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:40.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:40.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:20:40.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:20:40.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:20:40.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:20:40.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:20:40.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:20:40.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:20:40.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:20:40.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:20:40.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:20:40.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:20:40.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:20:40.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:20:40.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:20:40.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:20:40.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:20:40.116 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.116 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.117 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20160 3.0 e44/23 3:00225d41:::rbd_data.1118d7e09baf.0000000000000056:head v 44'214, mlcod=43'212)", 2024-09-12T05:20:40.117 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:40.117 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 2.8008725430000001, 2024-09-12T05:20:40.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049886230000000002, 2024-09-12T05:20:40.118 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.118 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:40.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:40.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228224+0000", 2024-09-12T05:20:40.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0699999999999999e-06 2024-09-12T05:20:40.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228232+0000", 2024-09-12T05:20:40.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:20:40.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228254+0000", 2024-09-12T05:20:40.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2507e-05 2024-09-12T05:20:40.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228264+0000", 2024-09-12T05:20:40.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6900000000000004e-06 2024-09-12T05:20:40.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228350+0000", 2024-09-12T05:20:40.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5877999999999993e-05 2024-09-12T05:20:40.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228378+0000", 2024-09-12T05:20:40.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7976000000000001e-05 2024-09-12T05:20:40.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.233084+0000", 2024-09-12T05:20:40.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047061580000000002 2024-09-12T05:20:40.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.233211+0000", 2024-09-12T05:20:40.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012753499999999999 2024-09-12T05:20:40.128 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.128 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.128 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.129 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:20:40.129 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:40.129 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 2.799046922, 2024-09-12T05:20:40.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:20:40.129 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.130 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.130 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.130 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:40.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:40.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:20:40.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:20:40.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:20:40.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:20:40.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:20:40.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:20:40.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:20:40.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:20:40.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:20:40.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:20:40.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:20:40.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:20:40.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:20:40.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:20:40.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:20:40.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:20:40.139 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.139 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.140 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.140 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.140 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.140 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:40.141 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:40.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:40.144 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:40.145 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:40.146 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-12T05:20:40.147 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:40.145+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:40.250 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:40.249+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:40.311 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:40.311 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:40.311 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:40.311 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:40.322 INFO:teuthology.orchestra.run.smithi059.stdout:1610 writesame 0xc2af51b thru 0xc2b96dd data_size 0x1(0xa1c3 bytes) 2024-09-12T05:20:40.322 INFO:teuthology.orchestra.run.smithi059.stdout:1612 write 0x34e2e4f thru 0x34e41cc (0x137e bytes) 2024-09-12T05:20:40.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:40.342 INFO:teuthology.orchestra.run.smithi059.stdout:1613 read 0x52e5f7 thru 0x53c276 (0xdc80 bytes) 2024-09-12T05:20:40.350 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:40.349+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout:1614 writesame 0x2b96f6b thru 0x2b9c3c6 data_size 0x2(0x545c bytes) 2024-09-12T05:20:40.395 INFO:teuthology.orchestra.run.smithi059.stdout:1615 punch from 0x688199f to 0x688d348, (0xb9a9 bytes) 2024-09-12T05:20:40.395 INFO:teuthology.orchestra.run.smithi059.stdout:1616 writesame 0x629758a thru 0x629f650 data_size 0xb(0x80c7 bytes) 2024-09-12T05:20:40.433 INFO:teuthology.orchestra.run.smithi059.stdout:1617 write 0xd28564 thru 0xd2f255 (0x6cf2 bytes) 2024-09-12T05:20:40.451 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:40.449+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:40.470 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:40.470 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:40.470 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:40.470 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:40.470 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:40.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:40.551 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:40.553+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:40.653 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:40.653 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:40.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:40.653 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:40.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.653 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11351 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 278528~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.564880971000001, 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040773482999999999, 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11351 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090440+0000", 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7899999999999999e-07 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090442+0000", 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9319999999999999e-06 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090449+0000", 2024-09-12T05:20:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.781e-06 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090454+0000", 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0440000000000003e-06 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.129625+0000", 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039171428000000001 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.129705+0000", 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0148999999999994e-05 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131213+0000", 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015077700000000001 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11352 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.658 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.564859740999999, 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041165723000000001, 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11352 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090461+0000", 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090463+0000", 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0150000000000002e-06 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090470+0000", 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5760000000000002e-06 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090475+0000", 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7729999999999999e-06 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131246+0000", 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040771485000000003 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131331+0000", 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5338000000000002e-05 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131627+0000", 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029515599999999998 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11353 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.564838465999999, 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041566055999999997, 2024-09-12T05:20:40.663 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11353 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090482+0000", 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090483+0000", 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4499999999999997e-07 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090484+0000", 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9149999999999999e-06 2024-09-12T05:20:40.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090491+0000", 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6170000000000003e-06 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090496+0000", 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.882e-06 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131659+0000", 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041163386000000003 2024-09-12T05:20:40.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.131740+0000", 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0575999999999996e-05 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132048+0000", 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030823500000000002 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11354 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.667 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.564817629, 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042063306000000002, 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11354 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090503+0000", 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090511+0000", 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8199999999999997e-06 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090518+0000", 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9360000000000002e-06 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090523+0000", 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0490000000000003e-06 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132081+0000", 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041557747999999999 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132166+0000", 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4905000000000001e-05 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132566+0000", 2024-09-12T05:20:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040041399999999998 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11355 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.564788034999999, 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042441325000000002, 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.672 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11355 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090532+0000", 2024-09-12T05:20:40.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090533+0000", 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090535+0000", 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.272e-06 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090542+0000", 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0219999999999999e-06 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.090547+0000", 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4710000000000001e-06 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132604+0000", 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042057223999999997 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132696+0000", 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1596999999999997e-05 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.132974+0000", 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000278287 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.676 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11388 3.18 3:1c5f1393:::rbd_data.1118f6d14695.0000000000000004:9 [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562972287000001, 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040980874, 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11388 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092348+0000", 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092349+0000", 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2899999999999999e-07 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092350+0000", 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.559e-06 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092357+0000", 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.148e-06 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092371+0000", 2024-09-12T05:20:40.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4104000000000001e-05 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133008+0000", 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040637083999999997 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133094+0000", 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5118999999999996e-05 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133329+0000", 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023553100000000001 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11389 3.18 3:1c5f1393:::rbd_data.1118f6d14695.0000000000000004:9 [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562940158, 2024-09-12T05:20:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041475895999999998, 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11389 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092380+0000", 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092381+0000", 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4700000000000002e-07 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092383+0000", 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7799999999999999e-06 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092387+0000", 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4830000000000001e-06 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092390+0000", 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.101e-06 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133374+0000", 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040983693000000002 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133458+0000", 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4320000000000006e-05 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133856+0000", 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039817200000000002 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.685 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11390 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562926495999999, 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041490103, 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11390 2024-09-12T05:20:40.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092394+0000", 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5100000000000001e-07 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092396+0000", 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0600000000000002e-06 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092400+0000", 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.456e-06 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092402+0000", 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5799999999999999e-06 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133843+0000", 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041440799 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133884+0000", 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0957000000000001e-05 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11391 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562914621000001, 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041529139999999999, 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11391 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092406+0000", 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2499999999999999e-07 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092407+0000", 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0780000000000001e-06 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092411+0000", 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1389999999999997e-06 2024-09-12T05:20:40.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092416+0000", 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1849999999999997e-06 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133925+0000", 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041509031000000002 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133935+0000", 2024-09-12T05:20:40.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0482000000000001e-05 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11392 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562898348999999, 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041566648999999997, 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.694 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11392 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092422+0000", 2024-09-12T05:20:40.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092423+0000", 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092425+0000", 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0959999999999999e-06 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092431+0000", 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3199999999999996e-06 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092436+0000", 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6809999999999997e-06 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133967+0000", 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041531476999999997 2024-09-12T05:20:40.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.133989+0000", 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1691e-05 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11393 3.18 3.c9c8fa38 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562876906, 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041603366000000003, 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11393 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092444+0000", 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092446+0000", 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092454+0000", 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1450000000000002e-06 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092458+0000", 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.95e-06 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134037+0000", 2024-09-12T05:20:40.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041578089999999998 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134047+0000", 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0404999999999999e-05 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11415 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562712763, 2024-09-12T05:20:40.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041482690000000003, 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11415 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092608+0000", 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.96e-07 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092610+0000", 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.874e-06 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092617+0000", 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.374e-06 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092623+0000", 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134081+0000", 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041458288000000003 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134090+0000", 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4350000000000003e-06 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11416 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:40.706 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562690807999999, 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041499819, 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11416 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:40.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092630+0000", 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092632+0000", 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9800000000000001e-06 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092638+0000", 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.207e-06 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092643+0000", 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5820000000000003e-06 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134121+0000", 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041477953999999997 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134130+0000", 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7159999999999992e-06 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11417 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:40.710 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562670921, 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041510551, 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11417 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092650+0000", 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092652+0000", 2024-09-12T05:20:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8950000000000001e-06 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092658+0000", 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3749999999999999e-06 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092664+0000", 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9159999999999998e-06 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134154+0000", 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041489640000000001 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134160+0000", 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2859999999999996e-06 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11418 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562649252, 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041515682999999998, 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11418 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092671+0000", 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092672+0000", 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9200000000000002e-07 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092674+0000", 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9700000000000002e-06 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092681+0000", 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7030000000000006e-06 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092686+0000", 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9649999999999999e-06 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134180+0000", 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041493915999999999 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134187+0000", 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.737e-06 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11419 3.18 3.932aa4f8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.562627169000001, 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041519681000000003, 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11419 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092693+0000", 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092694+0000", 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0600000000000001e-07 2024-09-12T05:20:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092696+0000", 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.891e-06 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092702+0000", 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.314e-06 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.092707+0000", 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6870000000000002e-06 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134206+0000", 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041499825999999997 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.134213+0000", 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5570000000000001e-06 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11782 3.8 3:15cf90c5:::rbd_data.11182c6d9c71.000000000000000f:head [write 0~0] snapc a=[a] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.517834899, 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039417731999999997, 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11782 2024-09-12T05:20:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137486+0000", 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7800000000000002e-07 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137489+0000", 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4669999999999998e-06 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137496+0000", 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.137501+0000", 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.135e-06 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173249+0000", 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035747202999999998 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173327+0000", 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8601000000000002e-05 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.173486+0000", 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015863699999999999 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176556+0000", 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030699220000000001 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176819+0000", 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026288100000000002 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176867+0000", 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8786999999999999e-05 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.176903+0000", 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5923000000000001e-05 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11833 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 663552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.515617654, 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039526073000000002, 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11833 2024-09-12T05:20:40.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139703+0000", 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.82e-07 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139706+0000", 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3609999999999999e-06 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139715+0000", 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1970000000000002e-06 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139720+0000", 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2549999999999997e-06 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.178847+0000", 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039127126999999998 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.178942+0000", 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4652000000000001e-05 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179229+0000", 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028699900000000002 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11834 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 712704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.515592843, 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039912229, 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.733 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11834 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139728+0000", 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139730+0000", 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.322e-06 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139737+0000", 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3799999999999999e-06 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139742+0000", 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9609999999999996e-06 2024-09-12T05:20:40.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179273+0000", 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039530869000000003 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179361+0000", 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8683000000000005e-05 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179640+0000", 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027860199999999997 2024-09-12T05:20:40.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:11835 3.18 3:1f2554c9:::rbd_data.1118f6d14695.000000000000000b:9 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.515570722, 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040348751000000002, 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:40.738 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 11835 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139750+0000", 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139753+0000", 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.497e-06 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139760+0000", 2024-09-12T05:20:40.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4749999999999996e-06 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.139766+0000", 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179687+0000", 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039921449999999997 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.179784+0000", 2024-09-12T05:20:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6669000000000006e-05 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.180099+0000", 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031458700000000002 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:40.742 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:40.742 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:40.653+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:40.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:40.744 INFO:teuthology.orchestra.run.smithi059.stdout:1618 write 0x39c5c76 thru 0x39d4b62 (0xeeed bytes) 2024-09-12T05:20:40.744 INFO:teuthology.orchestra.run.smithi059.stdout:1619 write 0x2bb7935 thru 0x2bba829 (0x2ef5 bytes) 2024-09-12T05:20:40.745 INFO:teuthology.orchestra.run.smithi059.stdout:1620 read 0x40ecfbf thru 0x40f1a97 (0x4ad9 bytes) 2024-09-12T05:20:40.754 INFO:teuthology.orchestra.run.smithi059.stdout:1621 trunc from 0xc2b96de to 0x3066a4b 2024-09-12T05:20:40.755 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:40.753+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:40.828 INFO:teuthology.orchestra.run.smithi059.stdout:1622 write 0x22e840a thru 0x22ec90f (0x4506 bytes) 2024-09-12T05:20:40.854 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:40.853+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:40.931 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:40.931 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23380 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.899112+0000", 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014574256000000001, 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014593773000000001, 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23380 2024-09-12T05:20:40.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899112+0000", 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899112+0000", 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899112+0000", 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9799999999999999e-07 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899114+0000", 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9709999999999998e-06 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899122+0000", 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8709999999999997e-06 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899128+0000", 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4639999999999997e-06 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23449 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902947+0000", 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010739327999999999, 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010819255999999999, 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.935 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23449 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902947+0000", 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902947+0000", 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902947+0000", 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902950+0000", 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1069999999999999e-06 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902956+0000", 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0120000000000002e-06 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902960+0000", 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.707e-06 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23555 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903750+0000", 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0099366920000000004, 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010070483999999999, 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23555 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903750+0000", 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903750+0000", 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903750+0000", 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7399999999999998e-07 2024-09-12T05:20:40.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903752+0000", 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9300000000000002e-06 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903758+0000", 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.404e-06 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903763+0000", 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23624 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904516+0000", 2024-09-12T05:20:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0091702499999999996, 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093539299999999999, 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23624 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904516+0000", 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904516+0000", 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904517+0000", 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2200000000000004e-07 2024-09-12T05:20:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904519+0000", 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904525+0000", 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4969999999999998e-06 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904531+0000", 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8680000000000004e-06 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23656 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905433+0000", 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0082530950000000002, 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.008486726, 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23656 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905433+0000", 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905433+0000", 2024-09-12T05:20:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905434+0000", 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905436+0000", 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.26e-06 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905443+0000", 2024-09-12T05:20:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7309999999999996e-06 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905448+0000", 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1279999999999999e-06 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23761 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0074967139999999998, 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0077854899999999999, 2024-09-12T05:20:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23761 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906192+0000", 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2330000000000001e-06 2024-09-12T05:20:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906199+0000", 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906204+0000", 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.113e-06 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23829 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911847+0000", 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.001839488, 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021991250000000001, 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23829 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911847+0000", 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911847+0000", 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911847+0000", 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8700000000000001e-07 2024-09-12T05:20:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911849+0000", 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8840000000000001e-06 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911856+0000", 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7299999999999999e-06 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911861+0000", 2024-09-12T05:20:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8679999999999998e-06 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23381 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.899135+0000", 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014551721, 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014956463999999999, 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23381 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899135+0000", 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899135+0000", 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899135+0000", 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5699999999999998e-07 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899142+0000", 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5950000000000004e-06 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899150+0000", 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4460000000000001e-06 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899156+0000", 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0700000000000003e-06 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23450 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902966+0000", 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010719934, 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011168121, 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23450 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902966+0000", 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902966+0000", 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902967+0000", 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.65e-07 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902969+0000", 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9379999999999999e-06 2024-09-12T05:20:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902974+0000", 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8150000000000002e-06 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902979+0000", 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6659999999999999e-06 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23556 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903770+0000", 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0099160299999999993, 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010430345000000001, 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23556 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903770+0000", 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903770+0000", 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903771+0000", 2024-09-12T05:20:40.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3700000000000001e-07 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903773+0000", 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903779+0000", 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.686e-06 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903784+0000", 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23625 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904538+0000", 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0091484359999999994, 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097227849999999994, 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23625 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904538+0000", 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904538+0000", 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904538+0000", 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0200000000000002e-07 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904554+0000", 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5926999999999998e-05 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904562+0000", 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6580000000000002e-06 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904568+0000", 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5650000000000001e-06 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23730 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905455+0000", 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0082313679999999993, 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.008856516, 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.969 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23730 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905455+0000", 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905455+0000", 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905456+0000", 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905458+0000", 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0650000000000001e-06 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905464+0000", 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2879999999999998e-06 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905469+0000", 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9869999999999999e-06 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23762 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0074750850000000002, 2024-09-12T05:20:40.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0081518770000000001, 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23762 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906212+0000", 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906214+0000", 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9470000000000002e-06 2024-09-12T05:20:40.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906220+0000", 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.302e-06 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906226+0000", 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2929999999999997e-06 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.975 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23830 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911867+0000", 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0018188900000000001, 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025471059999999999, 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23830 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911867+0000", 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911867+0000", 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911868+0000", 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8799999999999998e-07 2024-09-12T05:20:40.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911882+0000", 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4647999999999999e-05 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911893+0000", 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0665999999999999e-05 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911899+0000", 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6370000000000004e-06 2024-09-12T05:20:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23382 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.899164+0000", 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014522106, 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015301654, 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.979 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23382 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899164+0000", 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899164+0000", 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899165+0000", 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899167+0000", 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1299999999999999e-06 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899175+0000", 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899180+0000", 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.135e-06 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23451 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902986+0000", 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010700654, 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011535114000000001, 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23451 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902986+0000", 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902986+0000", 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902986+0000", 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3500000000000002e-07 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902988+0000", 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.903e-06 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902994+0000", 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5489999999999997e-06 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902998+0000", 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7339999999999999e-06 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23557 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903792+0000", 2024-09-12T05:20:40.985 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0098943309999999993, 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010779936, 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23557 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903792+0000", 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903792+0000", 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903792+0000", 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903795+0000", 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.12e-06 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903801+0000", 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3879999999999997e-06 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903806+0000", 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0089999999999998e-06 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23626 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904604+0000", 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0090827679999999997, 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010022387000000001, 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23626 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904604+0000", 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904604+0000", 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904604+0000", 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4799999999999998e-07 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904607+0000", 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7499999999999999e-06 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904617+0000", 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9599999999999995e-06 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904623+0000", 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0120000000000002e-06 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23731 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905476+0000", 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0082098199999999996, 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0092023569999999996, 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23731 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905476+0000", 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905476+0000", 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905477+0000", 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-07 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905479+0000", 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.266e-06 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905485+0000", 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.28e-06 2024-09-12T05:20:40.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905491+0000", 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0660000000000003e-06 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23763 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0074531010000000002, 2024-09-12T05:20:40.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0084961529999999993, 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23763 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906234+0000", 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906236+0000", 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1720000000000001e-06 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906243+0000", 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906248+0000", 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3140000000000003e-06 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23831 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911911+0000", 2024-09-12T05:20:40.998 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.001775691, 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002868518, 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23831 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911911+0000", 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:40.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911911+0000", 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911911+0000", 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8500000000000001e-07 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911914+0000", 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5959999999999998e-06 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911921+0000", 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9569999999999996e-06 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911926+0000", 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3029999999999999e-06 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23383 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.001 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.899187+0000", 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014499174, 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015645083000000001, 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23383 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899187+0000", 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899187+0000", 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899188+0000", 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3300000000000003e-07 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899190+0000", 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.357e-06 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899198+0000", 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2209999999999997e-06 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899211+0000", 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2561999999999999e-05 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23452 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903018+0000", 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010668769, 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011865166999999999, 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23452 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903018+0000", 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903018+0000", 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903018+0000", 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-07 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903021+0000", 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.537e-06 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903027+0000", 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7870000000000004e-06 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903032+0000", 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9690000000000002e-06 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23558 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903812+0000", 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0098739420000000001, 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011120434, 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23558 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903812+0000", 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903812+0000", 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903813+0000", 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.32e-07 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903815+0000", 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1339999999999998e-06 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903821+0000", 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9460000000000003e-06 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903826+0000", 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9509999999999997e-06 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23627 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904634+0000", 2024-09-12T05:20:41.011 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0090525940000000006, 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010349416, 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23627 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904634+0000", 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904634+0000", 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904634+0000", 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904636+0000", 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1770000000000001e-06 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904643+0000", 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.776e-06 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904650+0000", 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3899999999999998e-06 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.014 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23732 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905498+0000", 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0081887379999999992, 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095368740000000007, 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23732 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905498+0000", 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905498+0000", 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905498+0000", 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7399999999999998e-07 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905500+0000", 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0219999999999999e-06 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905507+0000", 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2479999999999999e-06 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905512+0000", 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9590000000000003e-06 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.017 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23764 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.007431104, 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0088304000000000004, 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23764 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906256+0000", 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4700000000000001e-07 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906258+0000", 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1289999999999999e-06 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906265+0000", 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3350000000000001e-06 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906271+0000", 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.020 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23832 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911933+0000", 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0017529069999999999, 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032006109999999999, 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23832 2024-09-12T05:20:41.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911933+0000", 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911933+0000", 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911934+0000", 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911936+0000", 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2309999999999999e-06 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911942+0000", 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4280000000000001e-06 2024-09-12T05:20:41.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911947+0000", 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0010000000000001e-06 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23384 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.899219+0000", 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014467172, 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015963356000000001, 2024-09-12T05:20:41.024 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23384 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899219+0000", 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899219+0000", 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899220+0000", 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899222+0000", 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-12T05:20:41.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899231+0000", 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8060000000000001e-06 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899236+0000", 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4070000000000001e-06 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23453 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903040+0000", 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010646737999999999, 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012200918999999999, 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23453 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903040+0000", 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903040+0000", 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903040+0000", 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903042+0000", 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9360000000000002e-06 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903049+0000", 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6730000000000003e-06 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903055+0000", 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4670000000000001e-06 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23559 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903834+0000", 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0098524249999999997, 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011458275, 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23559 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903834+0000", 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903834+0000", 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903834+0000", 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6499999999999999e-07 2024-09-12T05:20:41.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903836+0000", 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9980000000000002e-06 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903843+0000", 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2949999999999999e-06 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903848+0000", 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2140000000000004e-06 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.033 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23628 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904657+0000", 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0090290509999999997, 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010683662, 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23628 2024-09-12T05:20:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904657+0000", 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904657+0000", 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904658+0000", 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999995e-07 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904660+0000", 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1469999999999999e-06 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904666+0000", 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4339999999999997e-06 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904672+0000", 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1479999999999997e-06 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23733 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905519+0000", 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0081668539999999994, 2024-09-12T05:20:41.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098705070000000006, 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23733 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905519+0000", 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905519+0000", 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905520+0000", 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3200000000000005e-07 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905535+0000", 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5387999999999999e-05 2024-09-12T05:20:41.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905545+0000", 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3600000000000002e-06 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905551+0000", 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7130000000000002e-06 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23765 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0074077700000000002, 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091638499999999994, 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23765 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906281+0000", 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1320000000000001e-06 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906289+0000", 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.977e-06 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906294+0000", 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:20:41.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23833 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911976+0000", 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.001710322, 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035638029999999999, 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23833 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911976+0000", 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911976+0000", 2024-09-12T05:20:41.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911977+0000", 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3499999999999995e-07 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911979+0000", 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7520000000000001e-06 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911989+0000", 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0629999999999995e-06 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911994+0000", 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8719999999999999e-06 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23385 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.899243+0000", 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014443433, 2024-09-12T05:20:41.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016389388000000001, 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23385 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899243+0000", 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899243+0000", 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899243+0000", 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1399999999999997e-07 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899245+0000", 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-06 2024-09-12T05:20:41.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899253+0000", 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5619999999999998e-06 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899260+0000", 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9419999999999998e-06 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23454 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903062+0000", 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010624672999999999, 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012627962, 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23454 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903062+0000", 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903062+0000", 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903062+0000", 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:20:41.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903078+0000", 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5991e-05 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903087+0000", 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.602e-06 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903093+0000", 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8189999999999997e-06 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.053 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23560 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903877+0000", 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0098091189999999998, 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011862034, 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23560 2024-09-12T05:20:41.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903877+0000", 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903877+0000", 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903878+0000", 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903881+0000", 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.773e-06 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903888+0000", 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5580000000000003e-06 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903894+0000", 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9370000000000001e-06 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23629 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904679+0000", 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0090077720000000007, 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011113661, 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.057 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23629 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904679+0000", 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904679+0000", 2024-09-12T05:20:41.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904679+0000", 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8699999999999995e-07 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904681+0000", 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0609999999999998e-06 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904687+0000", 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2999999999999998e-06 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904692+0000", 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0209999999999999e-06 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23734 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.060 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905560+0000", 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0081265260000000002, 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010286148, 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23734 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905560+0000", 2024-09-12T05:20:41.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905560+0000", 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905561+0000", 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4399999999999999e-07 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905563+0000", 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3020000000000002e-06 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905569+0000", 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5470000000000002e-06 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905575+0000", 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1569999999999999e-06 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23766 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0073842109999999999, 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095929459999999998, 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23766 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906303+0000", 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2399999999999998e-07 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906305+0000", 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906311+0000", 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5169999999999996e-06 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906316+0000", 2024-09-12T05:20:41.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9749999999999998e-06 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23834 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912002+0000", 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0016839190000000001, 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039464729999999998, 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23834 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912002+0000", 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912002+0000", 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912003+0000", 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912005+0000", 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.916e-06 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912011+0000", 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2369999999999997e-06 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912016+0000", 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0490000000000003e-06 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23386 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.899267+0000", 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014419151999999999, 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016731666999999999, 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23386 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899267+0000", 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899267+0000", 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899268+0000", 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9900000000000001e-07 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899270+0000", 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2259999999999999e-06 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899276+0000", 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1290000000000001e-06 2024-09-12T05:20:41.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.899281+0000", 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1970000000000004e-06 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23455 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903102+0000", 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010584718999999999, 2024-09-12T05:20:41.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012949459, 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23455 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903102+0000", 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903102+0000", 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903102+0000", 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3e-07 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903104+0000", 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.041e-06 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903111+0000", 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3419999999999996e-06 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903116+0000", 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8289999999999996e-06 2024-09-12T05:20:41.076 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23561 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903902+0000", 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0097843289999999996, 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012199697000000001, 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.077 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23561 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903902+0000", 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903902+0000", 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903902+0000", 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0399999999999996e-07 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903904+0000", 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9649999999999998e-06 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903911+0000", 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4570000000000002e-06 2024-09-12T05:20:41.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903916+0000", 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0050000000000004e-06 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23630 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904699+0000", 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0089873369999999998, 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011457548999999999, 2024-09-12T05:20:41.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23630 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904699+0000", 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904699+0000", 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904699+0000", 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904702+0000", 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1560000000000002e-06 2024-09-12T05:20:41.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904707+0000", 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7799999999999997e-06 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904713+0000", 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3360000000000002e-06 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.083 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23735 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905583+0000", 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0081030830000000005, 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010625381999999999, 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23735 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905583+0000", 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905583+0000", 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905584+0000", 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5199999999999996e-07 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905586+0000", 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0470000000000001e-06 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905593+0000", 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7970000000000003e-06 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905598+0000", 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23804 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906323+0000", 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0073633379999999997, 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099549949999999995, 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23804 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906323+0000", 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906323+0000", 2024-09-12T05:20:41.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906323+0000", 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7899999999999999e-07 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906325+0000", 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906340+0000", 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4572e-05 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906346+0000", 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6350000000000003e-06 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23835 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912030+0000", 2024-09-12T05:20:41.090 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0016562440000000001, 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0042991660000000001, 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23835 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912030+0000", 2024-09-12T05:20:41.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912030+0000", 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912031+0000", 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4799999999999998e-07 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912033+0000", 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912039+0000", 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2349999999999996e-06 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912045+0000", 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8309999999999997e-06 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.093 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23387 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.901988+0000", 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011698739999999999, 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014406179, 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.094 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23387 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.901988+0000", 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.901988+0000", 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.901988+0000", 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0299999999999997e-07 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.901992+0000", 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8130000000000002e-06 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902001+0000", 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7360000000000007e-06 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902008+0000", 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6680000000000004e-06 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23456 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903124+0000", 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010562455, 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013321736000000001, 2024-09-12T05:20:41.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23456 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903124+0000", 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903124+0000", 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903124+0000", 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903126+0000", 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.933e-06 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903132+0000", 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9020000000000004e-06 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903137+0000", 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.096e-06 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23562 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903923+0000", 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0097637260000000003, 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012580038999999999, 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23562 2024-09-12T05:20:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903923+0000", 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903923+0000", 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903923+0000", 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5400000000000002e-07 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903925+0000", 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0700000000000001e-06 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903931+0000", 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3160000000000002e-06 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903936+0000", 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6750000000000001e-06 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23631 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904720+0000", 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0089664900000000006, 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01183298, 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.104 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23631 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904720+0000", 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904720+0000", 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904720+0000", 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7300000000000001e-07 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904722+0000", 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.125e-06 2024-09-12T05:20:41.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904729+0000", 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4529999999999999e-06 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904734+0000", 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9180000000000002e-06 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23736 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905607+0000", 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0080796840000000002, 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010999874999999999, 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23736 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.108 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905607+0000", 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905607+0000", 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905607+0000", 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4099999999999999e-07 2024-09-12T05:20:41.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905609+0000", 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2850000000000001e-06 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905616+0000", 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6370000000000002e-06 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905621+0000", 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0549999999999999e-06 2024-09-12T05:20:41.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23805 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906353+0000", 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0073329190000000002, 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010302683999999999, 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.111 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23805 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906353+0000", 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906353+0000", 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906354+0000", 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3300000000000001e-07 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906357+0000", 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4619999999999999e-06 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906364+0000", 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1659999999999997e-06 2024-09-12T05:20:41.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906369+0000", 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.186e-06 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23836 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912053+0000", 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0016332370000000001, 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046595300000000003, 2024-09-12T05:20:41.114 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23836 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912053+0000", 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912053+0000", 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912053+0000", 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9299999999999999e-07 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912056+0000", 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0810000000000001e-06 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912062+0000", 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4459999999999998e-06 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912067+0000", 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0250000000000002e-06 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23388 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902019+0000", 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011666977, 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014747316, 2024-09-12T05:20:41.117 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23388 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902019+0000", 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902019+0000", 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902020+0000", 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000002e-07 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902021+0000", 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5099999999999999e-06 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902025+0000", 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9219999999999999e-06 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902028+0000", 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.931e-06 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23457 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903144+0000", 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.01054195, 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013671605999999999, 2024-09-12T05:20:41.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23457 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903144+0000", 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903144+0000", 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903145+0000", 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6499999999999999e-07 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903147+0000", 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1100000000000001e-06 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903153+0000", 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8449999999999999e-06 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903158+0000", 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8949999999999997e-06 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23563 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903944+0000", 2024-09-12T05:20:41.123 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0097426319999999993, 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012925413, 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23563 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903944+0000", 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903944+0000", 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903944+0000", 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8299999999999997e-07 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903946+0000", 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1519999999999999e-06 2024-09-12T05:20:41.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903955+0000", 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3750000000000003e-06 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903960+0000", 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23632 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.126 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904742+0000", 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0089440609999999997, 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012164368, 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23632 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904742+0000", 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904742+0000", 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904743+0000", 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904745+0000", 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1100000000000001e-06 2024-09-12T05:20:41.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904751+0000", 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2280000000000003e-06 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904756+0000", 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0209999999999999e-06 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.129 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23737 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905629+0000", 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0080577519999999996, 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011322277, 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23737 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905629+0000", 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905629+0000", 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905629+0000", 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7899999999999998e-07 2024-09-12T05:20:41.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905631+0000", 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905637+0000", 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2600000000000002e-06 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905642+0000", 2024-09-12T05:20:41.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0760000000000002e-06 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23806 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906376+0000", 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0073103029999999998, 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010614897999999999, 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23806 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906376+0000", 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906376+0000", 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906377+0000", 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0100000000000005e-07 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906383+0000", 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5799999999999997e-06 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906390+0000", 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7360000000000004e-06 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906396+0000", 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6470000000000003e-06 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.136 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23837 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912076+0000", 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0016100450000000001, 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049539739999999999, 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23837 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912076+0000", 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912076+0000", 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912077+0000", 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0100000000000005e-07 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912079+0000", 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1519999999999999e-06 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912085+0000", 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4810000000000003e-06 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912117+0000", 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1918000000000002e-05 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23389 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902056+0000", 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011630414, 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015006181, 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.140 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23389 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902056+0000", 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902056+0000", 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902057+0000", 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1900000000000002e-07 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902060+0000", 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4000000000000001e-06 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902070+0000", 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7030000000000001e-06 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902077+0000", 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.029e-06 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23458 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903165+0000", 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010521592999999999, 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013927322000000001, 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23458 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903165+0000", 2024-09-12T05:20:41.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903165+0000", 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903165+0000", 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903167+0000", 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.852e-06 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903173+0000", 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7400000000000001e-06 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903178+0000", 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8940000000000001e-06 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23564 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903968+0000", 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0097187049999999994, 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013156246, 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23564 2024-09-12T05:20:41.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903968+0000", 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903968+0000", 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903968+0000", 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9900000000000001e-07 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903975+0000", 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.832e-06 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903981+0000", 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4110000000000001e-06 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903987+0000", 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23633 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904763+0000", 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.008923327, 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012401792, 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.150 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23633 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904763+0000", 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904763+0000", 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904764+0000", 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0100000000000005e-07 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904766+0000", 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0360000000000001e-06 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904772+0000", 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904777+0000", 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3750000000000002e-06 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23738 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905649+0000", 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0080370210000000001, 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011560703, 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23738 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905649+0000", 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905649+0000", 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905650+0000", 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4799999999999999e-07 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905652+0000", 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9939999999999999e-06 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905658+0000", 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905664+0000", 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1120000000000004e-06 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.156 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23807 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906403+0000", 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0072831520000000002, 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010936088, 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.157 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23807 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906403+0000", 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906403+0000", 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906756+0000", 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035272599999999998 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906760+0000", 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0169999999999998e-06 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906770+0000", 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7559999999999994e-06 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906778+0000", 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2300000000000008e-06 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23838 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912140+0000", 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0015464229999999999, 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052406320000000003, 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23838 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912140+0000", 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912140+0000", 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912141+0000", 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3399999999999998e-07 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912144+0000", 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.993e-06 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912153+0000", 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1260000000000004e-06 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912159+0000", 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6760000000000001e-06 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23390 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.163 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902087+0000", 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011599274999999999, 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015331709000000001, 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23390 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902087+0000", 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902087+0000", 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902088+0000", 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9999999999999997e-07 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902090+0000", 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902097+0000", 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4659999999999996e-06 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902102+0000", 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0799999999999996e-06 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23459 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903233+0000", 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010452960000000001, 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01423396, 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23459 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903233+0000", 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903233+0000", 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903234+0000", 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.23e-07 2024-09-12T05:20:41.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903237+0000", 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2219999999999998e-06 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903244+0000", 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8569999999999997e-06 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903250+0000", 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5029999999999997e-06 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23565 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903994+0000", 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0096924139999999999, 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013517655, 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23565 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903994+0000", 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903994+0000", 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903994+0000", 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903997+0000", 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.351e-06 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904003+0000", 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6710000000000002e-06 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904008+0000", 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7439999999999998e-06 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23634 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904826+0000", 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0088604100000000009, 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012740036999999999, 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.173 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23634 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904826+0000", 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904826+0000", 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904826+0000", 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904830+0000", 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000002e-06 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904839+0000", 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3559999999999999e-06 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904845+0000", 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4099999999999996e-06 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23739 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905670+0000", 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0080159749999999998, 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011937082999999999, 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23739 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.177 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905670+0000", 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905670+0000", 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905671+0000", 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7100000000000002e-07 2024-09-12T05:20:41.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905673+0000", 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.187e-06 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905680+0000", 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6100000000000002e-06 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905685+0000", 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0359999999999997e-06 2024-09-12T05:20:41.179 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23808 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906790+0000", 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0068961700000000001, 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010856978999999999, 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.180 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23808 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906790+0000", 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906790+0000", 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906791+0000", 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8199999999999999e-07 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906794+0000", 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7240000000000001e-06 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906800+0000", 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7939999999999997e-06 2024-09-12T05:20:41.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906806+0000", 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5570000000000003e-06 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23839 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912167+0000", 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0015189260000000001, 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055112809999999998, 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23839 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912167+0000", 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912167+0000", 2024-09-12T05:20:41.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912168+0000", 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3200000000000005e-07 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912170+0000", 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912176+0000", 2024-09-12T05:20:41.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9920000000000004e-06 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912181+0000", 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.242e-06 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23391 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902124+0000", 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011562754999999999, 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015595655999999999, 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.186 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23391 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902124+0000", 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902124+0000", 2024-09-12T05:20:41.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902124+0000", 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5499999999999998e-07 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902127+0000", 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4329999999999998e-06 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902133+0000", 2024-09-12T05:20:41.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5209999999999999e-06 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902138+0000", 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1250000000000001e-06 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23460 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903258+0000", 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010427817000000001, 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014503047999999999, 2024-09-12T05:20:41.189 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23460 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903258+0000", 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903258+0000", 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903259+0000", 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7000000000000004e-07 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903261+0000", 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9889999999999999e-06 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903267+0000", 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2550000000000003e-06 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903272+0000", 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9450000000000001e-06 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23566 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904015+0000", 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0096711650000000007, 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013788689999999999, 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23566 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904015+0000", 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904015+0000", 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904016+0000", 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2300000000000001e-07 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904018+0000", 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2309999999999999e-06 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904024+0000", 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4690000000000002e-06 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904031+0000", 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.195 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23635 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904855+0000", 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0088312300000000007, 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012978038000000001, 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23635 2024-09-12T05:20:41.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904855+0000", 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904855+0000", 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904856+0000", 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4700000000000001e-07 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904858+0000", 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3590000000000002e-06 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904865+0000", 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8299999999999998e-06 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904870+0000", 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3299999999999998e-06 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23740 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905691+0000", 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0079952489999999994, 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012173649999999999, 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.199 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23740 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905691+0000", 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905691+0000", 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905691+0000", 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4099999999999999e-07 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905693+0000", 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9589999999999998e-06 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905700+0000", 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.528e-06 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905705+0000", 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9130000000000002e-06 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23809 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906814+0000", 2024-09-12T05:20:41.202 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0068719219999999999, 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011087569, 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23809 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906814+0000", 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906814+0000", 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906815+0000", 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3300000000000002e-07 2024-09-12T05:20:41.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906817+0000", 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4549999999999998e-06 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906824+0000", 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0709999999999997e-06 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906830+0000", 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.378e-06 2024-09-12T05:20:41.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23914 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912189+0000", 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0014973899999999999, 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0057413689999999996, 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23914 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912189+0000", 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912189+0000", 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912189+0000", 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-07 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912192+0000", 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.187e-06 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912198+0000", 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0310000000000004e-06 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912202+0000", 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6949999999999999e-06 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23392 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902193+0000", 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011492865999999999, 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015782663999999998, 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.209 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23392 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902193+0000", 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902193+0000", 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902194+0000", 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5899999999999995e-07 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902197+0000", 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2140000000000001e-06 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902205+0000", 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6070000000000002e-06 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902211+0000", 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2589999999999997e-06 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23461 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903279+0000", 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010407291000000001, 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014726648, 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23461 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903279+0000", 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903279+0000", 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903280+0000", 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.13e-07 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903282+0000", 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903287+0000", 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9109999999999998e-06 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903292+0000", 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9579999999999998e-06 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.215 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23567 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904049+0000", 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0096372160000000005, 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013990122000000001, 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23567 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904049+0000", 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904049+0000", 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904050+0000", 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6000000000000003e-07 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904052+0000", 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.475e-06 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904059+0000", 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2660000000000004e-06 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904065+0000", 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.417e-06 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23636 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904877+0000", 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0088089339999999992, 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013197712, 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23636 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904877+0000", 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904877+0000", 2024-09-12T05:20:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904878+0000", 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5799999999999999e-07 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904880+0000", 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0379999999999998e-06 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904887+0000", 2024-09-12T05:20:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904893+0000", 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8830000000000003e-06 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23741 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905712+0000", 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0079747020000000002, 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012390797, 2024-09-12T05:20:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23741 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905712+0000", 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905712+0000", 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905712+0000", 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2199999999999999e-07 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905714+0000", 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.323e-06 2024-09-12T05:20:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905721+0000", 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905727+0000", 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23810 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906837+0000", 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0068493010000000003, 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011314009, 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23810 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906837+0000", 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906837+0000", 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911325+0000", 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044880149999999997 2024-09-12T05:20:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911331+0000", 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.66e-06 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911341+0000", 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9930000000000007e-06 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911348+0000", 2024-09-12T05:20:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4200000000000001e-06 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23915 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912209+0000", 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0014769239999999999, 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0059683449999999999, 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23915 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912209+0000", 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912209+0000", 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912210+0000", 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912212+0000", 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1069999999999999e-06 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912218+0000", 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0589999999999999e-06 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912223+0000", 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1930000000000001e-06 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23393 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902222+0000", 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011464758, 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015996719, 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23393 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902222+0000", 2024-09-12T05:20:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902222+0000", 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902222+0000", 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9500000000000002e-07 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902230+0000", 2024-09-12T05:20:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6229999999999997e-06 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902236+0000", 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5679999999999996e-06 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902242+0000", 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4360000000000001e-06 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23462 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903298+0000", 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010387848, 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014950398, 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23462 2024-09-12T05:20:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903298+0000", 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903298+0000", 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903299+0000", 2024-09-12T05:20:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2600000000000002e-07 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903301+0000", 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903307+0000", 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9699999999999996e-06 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903311+0000", 2024-09-12T05:20:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23568 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904072+0000", 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0096138360000000006, 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014234419999999999, 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23568 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904072+0000", 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904072+0000", 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904073+0000", 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9299999999999998e-07 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904075+0000", 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904081+0000", 2024-09-12T05:20:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4339999999999997e-06 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904087+0000", 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0470000000000001e-06 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23637 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904912+0000", 2024-09-12T05:20:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0087747539999999992, 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013425947000000001, 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23637 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904912+0000", 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904912+0000", 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904912+0000", 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4099999999999998e-07 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904915+0000", 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7879999999999998e-06 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904923+0000", 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6830000000000008e-06 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904928+0000", 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1209999999999998e-06 2024-09-12T05:20:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23742 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905734+0000", 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0079527539999999994, 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012642099, 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23742 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905734+0000", 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905734+0000", 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905734+0000", 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5300000000000004e-07 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905736+0000", 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.137e-06 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905743+0000", 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.421e-06 2024-09-12T05:20:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905748+0000", 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9849999999999997e-06 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23811 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911364+0000", 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0023226359999999999, 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0070454259999999996, 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23811 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911364+0000", 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911364+0000", 2024-09-12T05:20:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911364+0000", 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911367+0000", 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7e-06 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911373+0000", 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4169999999999997e-06 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911382+0000", 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4940000000000003e-06 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23916 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912232+0000", 2024-09-12T05:20:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00145477, 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062074399999999998, 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23916 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912232+0000", 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912232+0000", 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912232+0000", 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912239+0000", 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3050000000000004e-06 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912250+0000", 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0477e-05 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912255+0000", 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23394 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902259+0000", 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011426936, 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016217568000000002, 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23394 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902259+0000", 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902259+0000", 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902260+0000", 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6499999999999999e-07 2024-09-12T05:20:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902263+0000", 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6089999999999999e-06 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902270+0000", 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902276+0000", 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1800000000000004e-06 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23463 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903318+0000", 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010368621999999999, 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015184876, 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23463 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903318+0000", 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903318+0000", 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903318+0000", 2024-09-12T05:20:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903320+0000", 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8789999999999999e-06 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903326+0000", 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7899999999999996e-06 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903330+0000", 2024-09-12T05:20:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6210000000000003e-06 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23569 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904093+0000", 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.009592906, 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014451673, 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23569 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904093+0000", 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904093+0000", 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904094+0000", 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8699999999999995e-07 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904096+0000", 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.984e-06 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904102+0000", 2024-09-12T05:20:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1659999999999999e-06 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904107+0000", 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9679999999999997e-06 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23638 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904937+0000", 2024-09-12T05:20:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0087491349999999999, 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013634195, 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23638 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904937+0000", 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904937+0000", 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904938+0000", 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7899999999999999e-07 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904940+0000", 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4619999999999999e-06 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904947+0000", 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.08e-06 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904953+0000", 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000002e-06 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23743 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905755+0000", 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0079315540000000004, 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012868658999999999, 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23743 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905755+0000", 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905755+0000", 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905755+0000", 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.82e-07 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905757+0000", 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0509999999999999e-06 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905764+0000", 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2639999999999997e-06 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905770+0000", 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4049999999999997e-06 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23812 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911390+0000", 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0022967019999999999, 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0072607660000000001, 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23812 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911390+0000", 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911390+0000", 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911390+0000", 2024-09-12T05:20:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0699999999999997e-07 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911392+0000", 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2309999999999999e-06 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911398+0000", 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.144e-06 2024-09-12T05:20:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911403+0000", 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23917 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912263+0000", 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0014230309999999999, 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0064200990000000003, 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23917 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912263+0000", 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912263+0000", 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912264+0000", 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8999999999999997e-07 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912266+0000", 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-09-12T05:20:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912272+0000", 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3579999999999999e-06 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912277+0000", 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8810000000000004e-06 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23395 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902295+0000", 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011391192, 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016423426000000001, 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23395 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902295+0000", 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902295+0000", 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902296+0000", 2024-09-12T05:20:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5300000000000004e-07 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902298+0000", 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3970000000000001e-06 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902305+0000", 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902311+0000", 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8900000000000001e-06 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23464 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903337+0000", 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010349044, 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015409232, 2024-09-12T05:20:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23464 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903337+0000", 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903337+0000", 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903338+0000", 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903340+0000", 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1619999999999998e-06 2024-09-12T05:20:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903346+0000", 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9900000000000002e-06 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903351+0000", 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6630000000000001e-06 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23570 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904115+0000", 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0095711660000000007, 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014660246, 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23570 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904115+0000", 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904115+0000", 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904116+0000", 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904118+0000", 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3290000000000001e-06 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904125+0000", 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5830000000000003e-06 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904130+0000", 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1100000000000002e-06 2024-09-12T05:20:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23639 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904961+0000", 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0087256650000000005, 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013849431000000001, 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23639 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904961+0000", 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904961+0000", 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904961+0000", 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0500000000000004e-07 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904963+0000", 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0640000000000001e-06 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904969+0000", 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2199999999999997e-06 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904975+0000", 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2979999999999999e-06 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23744 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905778+0000", 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0079085279999999997, 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0130686, 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23744 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905778+0000", 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905778+0000", 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905778+0000", 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905780+0000", 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-06 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905787+0000", 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7460000000000003e-06 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905792+0000", 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23813 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911410+0000", 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0022759009999999999, 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074768980000000001, 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23813 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911410+0000", 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911410+0000", 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911411+0000", 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1399999999999997e-07 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911413+0000", 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3329999999999999e-06 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911419+0000", 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0950000000000001e-06 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911425+0000", 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2580000000000003e-06 2024-09-12T05:20:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23918 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912283+0000", 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0014030189999999999, 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066341760000000003, 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23918 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912283+0000", 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912283+0000", 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912284+0000", 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8299999999999997e-07 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912286+0000", 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.883e-06 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912292+0000", 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0750000000000003e-06 2024-09-12T05:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912297+0000", 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8400000000000002e-06 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23396 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902329+0000", 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011357488000000001, 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016624086999999999, 2024-09-12T05:20:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23396 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902329+0000", 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902329+0000", 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902329+0000", 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3200000000000005e-07 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902332+0000", 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.356e-06 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902338+0000", 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1460000000000001e-06 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902377+0000", 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8716e-05 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23465 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903357+0000", 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010329266, 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015630620000000001, 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23465 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903357+0000", 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903357+0000", 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903358+0000", 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5700000000000002e-07 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903359+0000", 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.753e-06 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903367+0000", 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7880000000000007e-06 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903373+0000", 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.835e-06 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23571 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904136+0000", 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0095499069999999998, 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014889767, 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23571 2024-09-12T05:20:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904136+0000", 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904136+0000", 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904137+0000", 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6699999999999999e-07 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904139+0000", 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9209999999999999e-06 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904145+0000", 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1430000000000003e-06 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904150+0000", 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.955e-06 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23640 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904982+0000", 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0087047930000000006, 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014084691, 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23640 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904982+0000", 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904982+0000", 2024-09-12T05:20:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904982+0000", 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904984+0000", 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8819999999999999e-06 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904990+0000", 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.528e-06 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904996+0000", 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2619999999999998e-06 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23745 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905799+0000", 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0078870929999999995, 2024-09-12T05:20:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013293101999999999, 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23745 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905799+0000", 2024-09-12T05:20:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905799+0000", 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905800+0000", 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9900000000000001e-07 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905814+0000", 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3793e-05 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905822+0000", 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1380000000000007e-06 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905827+0000", 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2429999999999996e-06 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23814 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911432+0000", 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0022542949999999999, 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0077013089999999999, 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23814 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911432+0000", 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911432+0000", 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911432+0000", 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7100000000000002e-07 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911435+0000", 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911441+0000", 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7819999999999999e-06 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911447+0000", 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0390000000000001e-06 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23919 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912303+0000", 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0013833770000000001, 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0068625969999999998, 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23919 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912303+0000", 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912303+0000", 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912303+0000", 2024-09-12T05:20:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7100000000000002e-07 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912305+0000", 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8160000000000001e-06 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912311+0000", 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912316+0000", 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9490000000000004e-06 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23397 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902398+0000", 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011287897999999999, 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016812568999999999, 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23397 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902398+0000", 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902398+0000", 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902399+0000", 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9599999999999999e-07 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902402+0000", 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0939999999999999e-06 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902410+0000", 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902416+0000", 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0260000000000004e-06 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23466 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.328 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903380+0000", 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.01030583, 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015879099000000001, 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23466 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903380+0000", 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903380+0000", 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903381+0000", 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8299999999999998e-07 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903397+0000", 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6288000000000001e-05 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903405+0000", 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3649999999999998e-06 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903410+0000", 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.331 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23572 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904157+0000", 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0095292490000000001, 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01515538, 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.332 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23572 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904157+0000", 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904157+0000", 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904157+0000", 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904159+0000", 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9520000000000001e-06 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904166+0000", 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.443e-06 2024-09-12T05:20:41.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904171+0000", 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9609999999999996e-06 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23641 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905002+0000", 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0086839259999999998, 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014357887, 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.335 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23641 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905002+0000", 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905002+0000", 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905003+0000", 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5400000000000002e-07 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905005+0000", 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.041e-06 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905011+0000", 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5719999999999999e-06 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905017+0000", 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:20:41.338 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23746 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905835+0000", 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0078508090000000003, 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013579805, 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.339 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23746 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905835+0000", 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905835+0000", 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905836+0000", 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9999999999999998e-07 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905838+0000", 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4030000000000001e-06 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905847+0000", 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.602e-06 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905852+0000", 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4009999999999996e-06 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23815 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911456+0000", 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0022304389999999999, 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0080096720000000007, 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.342 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23815 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911456+0000", 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911456+0000", 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911456+0000", 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911459+0000", 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3970000000000001e-06 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911465+0000", 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3960000000000003e-06 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911471+0000", 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5729999999999998e-06 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23920 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.345 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912322+0000", 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0013644600000000001, 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071898259999999999, 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23920 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912322+0000", 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912322+0000", 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912322+0000", 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1900000000000003e-07 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912324+0000", 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912330+0000", 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8819999999999998e-06 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912335+0000", 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2240000000000003e-06 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23398 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902430+0000", 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011255876, 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017134001999999999, 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23398 2024-09-12T05:20:41.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902430+0000", 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902430+0000", 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902431+0000", 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902433+0000", 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4329999999999998e-06 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902440+0000", 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3659999999999997e-06 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902447+0000", 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9580000000000001e-06 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23467 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903419+0000", 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010267096999999999, 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016182298000000001, 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.352 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23467 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903419+0000", 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903419+0000", 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903420+0000", 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2799999999999996e-07 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903422+0000", 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1610000000000001e-06 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903429+0000", 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0140000000000001e-06 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903435+0000", 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9630000000000003e-06 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.355 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23573 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904178+0000", 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0095087350000000008, 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015463295, 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23573 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.356 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904178+0000", 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904178+0000", 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904178+0000", 2024-09-12T05:20:41.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904180+0000", 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1550000000000001e-06 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904187+0000", 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4269999999999996e-06 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904192+0000", 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0139999999999998e-06 2024-09-12T05:20:41.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23642 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905023+0000", 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0086630089999999993, 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014648451999999999, 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.359 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23642 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905023+0000", 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905023+0000", 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905024+0000", 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905026+0000", 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0219999999999999e-06 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905032+0000", 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9139999999999996e-06 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905038+0000", 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3890000000000002e-06 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23747 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905859+0000", 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0078269680000000001, 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013841170999999999, 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.362 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23747 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905859+0000", 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905859+0000", 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905860+0000", 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905862+0000", 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3360000000000002e-06 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905869+0000", 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4250000000000003e-06 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905873+0000", 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.69e-06 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23816 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911496+0000", 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.002190666, 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0082503660000000003, 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.365 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23816 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911496+0000", 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911496+0000", 2024-09-12T05:20:41.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911496+0000", 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3300000000000001e-07 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911499+0000", 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911507+0000", 2024-09-12T05:20:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0069999999999997e-06 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911513+0000", 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9920000000000004e-06 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23921 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912342+0000", 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0013443260000000001, 2024-09-12T05:20:41.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074585299999999997, 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23921 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912342+0000", 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912342+0000", 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912342+0000", 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8400000000000005e-07 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912345+0000", 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1330000000000002e-06 2024-09-12T05:20:41.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912351+0000", 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2439999999999998e-06 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912356+0000", 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7929999999999997e-06 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23399 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.371 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902465+0000", 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011221717000000001, 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017376421, 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23399 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902465+0000", 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902465+0000", 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902465+0000", 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8500000000000002e-07 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902468+0000", 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902474+0000", 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5699999999999998e-06 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902479+0000", 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0649999999999998e-06 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23468 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903442+0000", 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010244283999999999, 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016439937000000002, 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.375 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23468 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903442+0000", 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903442+0000", 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903443+0000", 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2399999999999998e-07 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903445+0000", 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.181e-06 2024-09-12T05:20:41.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903451+0000", 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.246e-06 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903456+0000", 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1159999999999998e-06 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23574 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904219+0000", 2024-09-12T05:20:41.378 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0094676059999999999, 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015689117999999998, 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23574 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904219+0000", 2024-09-12T05:20:41.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904219+0000", 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904219+0000", 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8800000000000002e-07 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904222+0000", 2024-09-12T05:20:41.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6280000000000001e-06 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904229+0000", 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3919999999999997e-06 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904236+0000", 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8129999999999998e-06 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23643 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905045+0000", 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0086414400000000002, 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015048996, 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23643 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905045+0000", 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905045+0000", 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905045+0000", 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905047+0000", 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0509999999999999e-06 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905054+0000", 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3929999999999996e-06 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905059+0000", 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.899e-06 2024-09-12T05:20:41.384 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23748 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905881+0000", 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.007805139, 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014265342, 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.385 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23748 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905881+0000", 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905881+0000", 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905882+0000", 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0600000000000001e-07 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905884+0000", 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0949999999999998e-06 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905891+0000", 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2949999999999996e-06 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905896+0000", 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.276e-06 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23817 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911522+0000", 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0021644619999999998, 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086791409999999996, 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.388 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23817 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911522+0000", 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911522+0000", 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911522+0000", 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7400000000000003e-07 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911525+0000", 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7549999999999999e-06 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911532+0000", 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8360000000000003e-06 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911537+0000", 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23922 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912363+0000", 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.001323383, 2024-09-12T05:20:41.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007887402, 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23922 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912363+0000", 2024-09-12T05:20:41.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912363+0000", 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912363+0000", 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9999999999999998e-07 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912366+0000", 2024-09-12T05:20:41.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1440000000000001e-06 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912372+0000", 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3550000000000001e-06 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912378+0000", 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1229999999999997e-06 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23400 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.902487+0000", 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011199762, 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017817597000000001, 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23400 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.395 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902487+0000", 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902487+0000", 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902487+0000", 2024-09-12T05:20:41.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8500000000000002e-07 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902489+0000", 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0080000000000001e-06 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902495+0000", 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8449999999999999e-06 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.902500+0000", 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23469 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903463+0000", 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010223149000000001, 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016891705999999999, 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23469 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903463+0000", 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903463+0000", 2024-09-12T05:20:41.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903464+0000", 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999995e-07 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903466+0000", 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9570000000000001e-06 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903472+0000", 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5479999999999998e-06 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903479+0000", 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2770000000000002e-06 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23575 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904245+0000", 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0094417500000000005, 2024-09-12T05:20:41.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016159769000000001, 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23575 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904245+0000", 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904245+0000", 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904245+0000", 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904247+0000", 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0679999999999999e-06 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904254+0000", 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.55e-06 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904260+0000", 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5719999999999999e-06 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23644 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.404 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905075+0000", 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0086111520000000004, 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015383038999999999, 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23644 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905075+0000", 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905075+0000", 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905076+0000", 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.27e-07 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905078+0000", 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0789999999999999e-06 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905086+0000", 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.011e-06 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905091+0000", 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5489999999999997e-06 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23749 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905903+0000", 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0077830649999999996, 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014605376, 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23749 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.408 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905903+0000", 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905903+0000", 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905904+0000", 2024-09-12T05:20:41.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.46e-07 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905906+0000", 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0789999999999999e-06 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905912+0000", 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2899999999999999e-06 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905917+0000", 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8629999999999999e-06 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23818 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911544+0000", 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0021421420000000001, 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0090180910000000006, 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.411 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23818 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911544+0000", 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911544+0000", 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911545+0000", 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0699999999999997e-07 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911564+0000", 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9307999999999999e-05 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911578+0000", 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4025e-05 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911584+0000", 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3570000000000003e-06 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23923 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912386+0000", 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0013005549999999999, 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0082257470000000003, 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23923 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912386+0000", 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912386+0000", 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912386+0000", 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912388+0000", 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.193e-06 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912395+0000", 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5429999999999999e-06 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912400+0000", 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6779999999999999e-06 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23470 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903487+0000", 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010199221, 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017181465999999999, 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23470 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903487+0000", 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903487+0000", 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903488+0000", 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5499999999999998e-07 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903490+0000", 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0880000000000002e-06 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903496+0000", 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4160000000000001e-06 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903501+0000", 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7469999999999996e-06 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23576 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904268+0000", 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.009418605, 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016451344, 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.420 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23576 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904268+0000", 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904268+0000", 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904268+0000", 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904275+0000", 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7499999999999997e-06 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904283+0000", 2024-09-12T05:20:41.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6869999999999994e-06 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904288+0000", 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1560000000000003e-06 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23645 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905156+0000", 2024-09-12T05:20:41.423 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0085298390000000009, 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015617053000000001, 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23645 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905156+0000", 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905156+0000", 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905157+0000", 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1399999999999997e-07 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905160+0000", 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.084e-06 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905169+0000", 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7199999999999995e-06 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905175+0000", 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3799999999999999e-06 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.426 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23750 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905924+0000", 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0077625929999999999, 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014905740000000001, 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23750 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.427 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905924+0000", 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905924+0000", 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905924+0000", 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9100000000000004e-07 2024-09-12T05:20:41.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905926+0000", 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0090000000000002e-06 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905933+0000", 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5579999999999997e-06 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905938+0000", 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0549999999999999e-06 2024-09-12T05:20:41.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23819 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911594+0000", 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0020924899999999998, 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0092919999999999999, 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23819 2024-09-12T05:20:41.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911594+0000", 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911594+0000", 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911595+0000", 2024-09-12T05:20:41.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.85e-07 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911597+0000", 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911604+0000", 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0439999999999998e-06 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911642+0000", 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8109999999999999e-05 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23924 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912406+0000", 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0012799420000000001, 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0085302639999999992, 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23924 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912406+0000", 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912406+0000", 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912407+0000", 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0999999999999999e-07 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912409+0000", 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1129999999999999e-06 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912415+0000", 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2910000000000004e-06 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912420+0000", 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0660000000000003e-06 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23471 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903508+0000", 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010178454, 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017482595, 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.436 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23471 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903508+0000", 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903508+0000", 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903508+0000", 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.13e-07 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903510+0000", 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9989999999999998e-06 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903517+0000", 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4169999999999997e-06 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903523+0000", 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0340000000000002e-06 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23577 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904296+0000", 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.009390008, 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016743435000000001, 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23577 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904296+0000", 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904296+0000", 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904297+0000", 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0500000000000004e-07 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904299+0000", 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3020000000000002e-06 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904306+0000", 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7460000000000003e-06 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904311+0000", 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23646 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905185+0000", 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0085017219999999998, 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016000160999999999, 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.443 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23646 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905185+0000", 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905185+0000", 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905185+0000", 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905187+0000", 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2649999999999999e-06 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905194+0000", 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905200+0000", 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2989999999999996e-06 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23751 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905946+0000", 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0077399820000000003, 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015290095, 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.446 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23751 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905946+0000", 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905946+0000", 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905947+0000", 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9100000000000004e-07 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905949+0000", 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3460000000000001e-06 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905956+0000", 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5760000000000002e-06 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905961+0000", 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1630000000000004e-06 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.449 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23820 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911652+0000", 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0020338560000000001, 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096385499999999992, 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23820 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911652+0000", 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911652+0000", 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911653+0000", 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1799999999999995e-07 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911656+0000", 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0139999999999999e-06 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911664+0000", 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6070000000000002e-06 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911669+0000", 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.339e-06 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.452 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23925 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912431+0000", 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0012548909999999999, 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0089090090000000007, 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23925 2024-09-12T05:20:41.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912431+0000", 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912431+0000", 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912432+0000", 2024-09-12T05:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0999999999999999e-07 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912434+0000", 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3360000000000002e-06 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912441+0000", 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.691e-06 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912446+0000", 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8010000000000003e-06 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23472 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903530+0000", 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010156544999999999, 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017859951999999998, 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23472 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903530+0000", 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903530+0000", 2024-09-12T05:20:41.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903530+0000", 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8100000000000003e-07 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903532+0000", 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9479999999999998e-06 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903538+0000", 2024-09-12T05:20:41.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0639999999999999e-06 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903544+0000", 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4330000000000003e-06 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23578 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904318+0000", 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0093683780000000001, 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017126946000000001, 2024-09-12T05:20:41.459 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23578 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904318+0000", 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904318+0000", 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904318+0000", 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6800000000000001e-07 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904320+0000", 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0999999999999998e-06 2024-09-12T05:20:41.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904327+0000", 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.55e-06 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904332+0000", 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2800000000000003e-06 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23647 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.462 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905207+0000", 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0084796820000000005, 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016288857, 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23647 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905207+0000", 2024-09-12T05:20:41.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905207+0000", 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905207+0000", 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6899999999999998e-07 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905209+0000", 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0770000000000002e-06 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905216+0000", 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5189999999999998e-06 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905221+0000", 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1649999999999997e-06 2024-09-12T05:20:41.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23752 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905970+0000", 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0077161390000000003, 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015578430000000001, 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.466 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23752 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905970+0000", 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905970+0000", 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905971+0000", 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0100000000000005e-07 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905973+0000", 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0679999999999999e-06 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905979+0000", 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905985+0000", 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5160000000000002e-06 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23926 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912456+0000", 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0012304499999999999, 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091446730000000007, 2024-09-12T05:20:41.469 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23926 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912456+0000", 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912456+0000", 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912456+0000", 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0299999999999999e-07 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912459+0000", 2024-09-12T05:20:41.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2790000000000001e-06 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912466+0000", 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3300000000000001e-06 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912471+0000", 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23473 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903550+0000", 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.010135808, 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018139747000000001, 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23473 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.473 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903550+0000", 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903550+0000", 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903551+0000", 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4299999999999998e-07 2024-09-12T05:20:41.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903553+0000", 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.063e-06 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903559+0000", 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2790000000000004e-06 2024-09-12T05:20:41.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903564+0000", 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23579 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904339+0000", 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0093469859999999998, 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017402628, 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.476 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23579 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904339+0000", 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904339+0000", 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904340+0000", 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6600000000000002e-07 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904342+0000", 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0269999999999998e-06 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904348+0000", 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6239999999999996e-06 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904354+0000", 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000001e-06 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23648 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.479 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905228+0000", 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0084584629999999994, 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016568321, 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23648 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905228+0000", 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905228+0000", 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905228+0000", 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8500000000000002e-07 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905236+0000", 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4889999999999998e-06 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905242+0000", 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905249+0000", 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.861e-06 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23753 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905991+0000", 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0076949490000000004, 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015855068999999999, 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23753 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.483 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905991+0000", 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905991+0000", 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905992+0000", 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905994+0000", 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9570000000000001e-06 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906001+0000", 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7270000000000001e-06 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906006+0000", 2024-09-12T05:20:41.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2179999999999998e-06 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23821 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911676+0000", 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.002009926, 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010223591000000001, 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23821 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911676+0000", 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911676+0000", 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911677+0000", 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2e-07 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911679+0000", 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9879999999999999e-06 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911685+0000", 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0070000000000003e-06 2024-09-12T05:20:41.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911691+0000", 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.054e-06 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23927 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912478+0000", 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0012087949999999999, 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094747470000000004, 2024-09-12T05:20:41.489 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23927 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912478+0000", 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912478+0000", 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912478+0000", 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7299999999999996e-07 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912480+0000", 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9039999999999999e-06 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912498+0000", 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8235000000000001e-05 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912504+0000", 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7629999999999997e-06 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.492 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23580 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904360+0000", 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0093259569999999993, 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017646644, 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23580 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904360+0000", 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904360+0000", 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904361+0000", 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0100000000000005e-07 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904363+0000", 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0499999999999999e-06 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904370+0000", 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5519999999999999e-06 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904376+0000", 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.485e-06 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.495 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23649 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905258+0000", 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0084283080000000007, 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016798938999999999, 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.496 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23649 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905258+0000", 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905258+0000", 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905259+0000", 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905261+0000", 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.509e-06 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905268+0000", 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8859999999999998e-06 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905274+0000", 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4489999999999998e-06 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23754 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906013+0000", 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0076737949999999997, 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016098477999999999, 2024-09-12T05:20:41.499 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23754 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906013+0000", 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906013+0000", 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906013+0000", 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906015+0000", 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-12T05:20:41.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906022+0000", 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6159999999999998e-06 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906027+0000", 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0359999999999997e-06 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23822 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911697+0000", 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.001988886, 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010464220999999999, 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23822 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911697+0000", 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911697+0000", 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911698+0000", 2024-09-12T05:20:41.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999999e-07 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911700+0000", 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911706+0000", 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0009999999999998e-06 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911710+0000", 2024-09-12T05:20:41.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.746e-06 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23928 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912527+0000", 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.001159195, 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009687958, 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23928 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912527+0000", 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912527+0000", 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912528+0000", 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5799999999999999e-07 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912544+0000", 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558e-05 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912556+0000", 2024-09-12T05:20:41.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1756999999999999e-05 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912562+0000", 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3149999999999997e-06 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23581 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904385+0000", 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0093015470000000003, 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017880706999999999, 2024-09-12T05:20:41.509 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23581 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904385+0000", 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904385+0000", 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904385+0000", 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1600000000000001e-07 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904388+0000", 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.261e-06 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904394+0000", 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6120000000000004e-06 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904399+0000", 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.254e-06 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23650 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905280+0000", 2024-09-12T05:20:41.512 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0084059370000000005, 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017034918, 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23650 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905280+0000", 2024-09-12T05:20:41.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905280+0000", 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905281+0000", 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2300000000000002e-07 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905283+0000", 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9640000000000002e-06 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905289+0000", 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2530000000000001e-06 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905294+0000", 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0880000000000002e-06 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.515 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23755 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.007652786, 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016337979999999998, 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.516 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23755 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2499999999999995e-07 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906036+0000", 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.092e-06 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906043+0000", 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-12T05:20:41.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906048+0000", 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1019999999999996e-06 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23823 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911717+0000", 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0019691829999999998, 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010705645999999999, 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23823 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911717+0000", 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911717+0000", 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911718+0000", 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6400000000000002e-07 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911720+0000", 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911727+0000", 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0280000000000003e-06 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911733+0000", 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5300000000000004e-06 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.522 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23929 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912572+0000", 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0011138999999999999, 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099079259999999992, 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23929 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912572+0000", 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912572+0000", 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912713+0000", 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014107099999999999 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912717+0000", 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7270000000000001e-06 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912727+0000", 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8139999999999995e-06 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912734+0000", 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2740000000000002e-06 2024-09-12T05:20:41.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23582 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904406+0000", 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0092801069999999992, 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018130075999999998, 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.526 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23582 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904406+0000", 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904406+0000", 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904407+0000", 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2099999999999997e-07 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904409+0000", 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9920000000000002e-06 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904415+0000", 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3330000000000002e-06 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904420+0000", 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23651 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905301+0000", 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0083854280000000003, 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017277532000000002, 2024-09-12T05:20:41.529 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23651 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905301+0000", 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905301+0000", 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905301+0000", 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1799999999999995e-07 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905303+0000", 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0509999999999999e-06 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905310+0000", 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4010000000000002e-06 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905315+0000", 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23756 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:41.532 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0076315719999999997, 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016560154000000001, 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23756 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4000000000000002e-07 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906057+0000", 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0080000000000001e-06 2024-09-12T05:20:41.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906065+0000", 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9359999999999999e-06 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906070+0000", 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.259e-06 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23824 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911740+0000", 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0019460300000000001, 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010929012, 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23824 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911740+0000", 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911740+0000", 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911741+0000", 2024-09-12T05:20:41.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7999999999999996e-07 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911743+0000", 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3970000000000001e-06 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911749+0000", 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2310000000000001e-06 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911755+0000", 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23930 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.541 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912746+0000", 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00094028299999999998, 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099738269999999993, 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23930 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912746+0000", 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912746+0000", 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912747+0000", 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.82e-07 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912749+0000", 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7259999999999998e-06 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912777+0000", 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7331999999999999e-05 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912783+0000", 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2589999999999997e-06 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.544 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23583 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.904426+0000", 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0092598920000000005, 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353410000000001, 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23583 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904426+0000", 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904426+0000", 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904427+0000", 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4200000000000001e-07 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904429+0000", 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0899999999999999e-06 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904436+0000", 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.562e-06 2024-09-12T05:20:41.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.904440+0000", 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6519999999999997e-06 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23652 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905322+0000", 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0083641310000000003, 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017507463000000001, 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.548 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23652 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905322+0000", 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905322+0000", 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905323+0000", 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6800000000000001e-07 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905325+0000", 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0810000000000001e-06 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905331+0000", 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4069999999999998e-06 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905336+0000", 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.074e-06 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23757 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0076093690000000004, 2024-09-12T05:20:41.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016806379, 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23757 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4400000000000001e-07 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906084+0000", 2024-09-12T05:20:41.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999998e-06 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906091+0000", 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7000000000000002e-06 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906096+0000", 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9679999999999997e-06 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23825 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911763+0000", 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0019234269999999999, 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011171069, 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23825 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.555 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911763+0000", 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911763+0000", 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911763+0000", 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0800000000000004e-07 2024-09-12T05:20:41.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911766+0000", 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1550000000000001e-06 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911772+0000", 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6420000000000001e-06 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911777+0000", 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9910000000000002e-06 2024-09-12T05:20:41.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23931 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.912795+0000", 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00089112499999999999, 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010191921, 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.558 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23931 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912795+0000", 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.912795+0000", 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919217+0000", 2024-09-12T05:20:41.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0064222710000000002 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919223+0000", 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919234+0000", 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0532e-05 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919241+0000", 2024-09-12T05:20:41.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7619999999999995e-06 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23653 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905343+0000", 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0083435249999999992, 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017711089999999999, 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.561 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23653 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905343+0000", 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905343+0000", 2024-09-12T05:20:41.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905343+0000", 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5999999999999999e-07 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905345+0000", 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2239999999999998e-06 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905352+0000", 2024-09-12T05:20:41.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.353e-06 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905357+0000", 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23758 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:41.564 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0075830530000000002, 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017018063, 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23758 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:41.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906104+0000", 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.89e-07 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906106+0000", 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.419e-06 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906112+0000", 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2720000000000003e-06 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906118+0000", 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1370000000000001e-06 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.567 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23826 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911784+0000", 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0019018150000000001, 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011366452000000001, 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23826 2024-09-12T05:20:41.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911784+0000", 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911784+0000", 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911785+0000", 2024-09-12T05:20:41.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3099999999999998e-07 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911787+0000", 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0389999999999999e-06 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911794+0000", 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3509999999999996e-06 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911800+0000", 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4999999999999999e-06 2024-09-12T05:20:41.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23932 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.919255+0000", 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4294967295.9944315, 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039219540000000001, 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.571 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23932 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919255+0000", 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919255+0000", 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919255+0000", 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8700000000000005e-07 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919258+0000", 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6419999999999999e-06 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919265+0000", 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8709999999999999e-06 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919270+0000", 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5210000000000002e-06 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23654 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905385+0000", 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0083009009999999994, 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017840795, 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23654 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905385+0000", 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905385+0000", 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905386+0000", 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6199999999999997e-07 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905389+0000", 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:20:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905396+0000", 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3549999999999999e-06 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905402+0000", 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6949999999999997e-06 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.577 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23759 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0075611469999999998, 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017141987000000001, 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23759 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906126+0000", 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-07 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906129+0000", 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8100000000000002e-06 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906135+0000", 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6749999999999996e-06 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906140+0000", 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0660000000000003e-06 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23827 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911807+0000", 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0018791739999999999, 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011499186, 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23827 2024-09-12T05:20:41.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911807+0000", 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911807+0000", 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911808+0000", 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2699999999999999e-07 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911810+0000", 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.244e-06 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911816+0000", 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911821+0000", 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23933 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.919311+0000", 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4294967295.9943757, 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040456829999999996, 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23933 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919311+0000", 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919311+0000", 2024-09-12T05:20:41.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919311+0000", 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8500000000000001e-07 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919315+0000", 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6389999999999998e-06 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919323+0000", 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7510000000000008e-06 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919329+0000", 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0000000000000002e-06 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23554 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 87040~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.903729+0000", 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0099575700000000007, 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019692573000000001, 2024-09-12T05:20:41.587 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23554 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903729+0000", 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903729+0000", 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903729+0000", 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.68e-07 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903732+0000", 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2280000000000001e-06 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903738+0000", 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3720000000000001e-06 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.903743+0000", 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0000000000000004e-06 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.923364+0000", 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019620899000000001 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.590 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23655 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.905410+0000", 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0082763200000000002, 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018072785000000001, 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.591 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23655 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905410+0000", 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905410+0000", 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905411+0000", 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5199999999999997e-07 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905413+0000", 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.402e-06 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905420+0000", 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0469999999999996e-06 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.905425+0000", 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.198e-06 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23760 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0075213049999999998, 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017363256000000001, 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.594 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23760 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906166+0000", 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9299999999999998e-07 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906168+0000", 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5600000000000001e-06 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906175+0000", 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3440000000000003e-06 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906181+0000", 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7799999999999997e-06 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23828 3.9 3.e2492aa9 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.911827+0000", 2024-09-12T05:20:41.597 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0018592470000000001, 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01174041, 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23828 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911827+0000", 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911827+0000", 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911828+0000", 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9299999999999998e-07 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911829+0000", 2024-09-12T05:20:41.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.838e-06 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911836+0000", 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2149999999999998e-06 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.911840+0000", 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8770000000000001e-06 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23934 3.3 3.f6613ee3 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.919359+0000", 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4294967295.9943275, 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0042638379999999998, 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23934 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919359+0000", 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919359+0000", 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919359+0000", 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.61e-07 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919362+0000", 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6699999999999998e-06 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919369+0000", 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.919374+0000", 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5160000000000002e-06 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.604 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.604 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-12T05:20:41.604 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 203 2024-09-12T05:20:41.604 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:41.606 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:41.608 INFO:teuthology.orchestra.run.smithi059.stdout:1623 read 0x214574 thru 0x223633 (0xf0c0 bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1625 read 0x1ac5b4 thru 0x1ae811 (0x225e bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1626 write 0xecdc4db thru 0xece2324 (0x5e4a bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1627 read 0x5585706 thru 0x558eb85 (0x9480 bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1628 trunc from 0xece2325 to 0xd57c32d 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1630 writesame 0xa32a6bf thru 0xa338c09 data_size 0x1(0xe54b bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1632 trunc from 0xd57c32d to 0x9a59aa7 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1633 read 0x4812e8e thru 0x481aa33 (0x7ba6 bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1635 write 0xa95746f thru 0xa95e820 (0x73b2 bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1636 read 0x9e3bc7c thru 0x9e436a8 (0x7a2d bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1637 writesame 0x3b5c600 thru 0x3b5e344 data_size 0x1(0x1d45 bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1638 write 0xade3864 thru 0xadef2b4 (0xba51 bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1639 trunc from 0xadef2b5 to 0x2d3f81a 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1640 punch from 0x2a47969 to 0x2a559de, (0xe075 bytes) 2024-09-12T05:20:41.609 INFO:teuthology.orchestra.run.smithi059.stdout:1641 write 0xb83901c thru 0xb83cad7 (0x3abc bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1642 trunc from 0xb83cad8 to 0xc270217 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1643 punch from 0x40c9fc1 to 0x40cb4a9, (0x14e8 bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1646 read 0xb81b9d8 thru 0xb826518 (0xab41 bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1647 write 0x1f48257 thru 0x1f4ac6d (0x2a17 bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1649 write 0xa817c58 thru 0xa8212da (0x9683 bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1650 write 0x620ee17 thru 0x62145ba (0x57a4 bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1653 punch from 0xed16b0 to 0xed9d2b, (0x867b bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1654 write 0xba538b thru 0xba5969 (0x5df bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1655 write 0xdd30d9b thru 0xdd3c855 (0xbabb bytes) 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1657 trunc from 0xdd3c856 to 0xbacd5a1 2024-09-12T05:20:41.610 INFO:teuthology.orchestra.run.smithi059.stdout:1658 read 0xb6b8164 thru 0xb6c5493 (0xd330 bytes) 2024-09-12T05:20:41.611 INFO:teuthology.orchestra.run.smithi059.stdout:1659 write 0xa2733af thru 0xa282af9 (0xf74b bytes) 2024-09-12T05:20:41.611 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:41.611 INFO:teuthology.orchestra.run.smithi059.stdout:1661 punch from 0x67a798b to 0x67b31e2, (0xb857 bytes) 2024-09-12T05:20:41.611 INFO:teuthology.orchestra.run.smithi059.stdout:1662 read 0xa12ca3a thru 0xa12ead8 (0x209f bytes) 2024-09-12T05:20:41.611 INFO:teuthology.orchestra.run.smithi059.stdout:1663 write 0xae2f676 thru 0xae37e20 (0x87ab bytes) 2024-09-12T05:20:41.611 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:41.605+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:41.636 INFO:teuthology.orchestra.run.smithi059.stdout:1664 write 0xcc69e5 thru 0xcd3b16 (0xd132 bytes) 2024-09-12T05:20:41.645 INFO:teuthology.orchestra.run.smithi059.stdout:1665 punch from 0x6289528 to 0x6291447, (0x7f1f bytes) 2024-09-12T05:20:41.645 INFO:teuthology.orchestra.run.smithi059.stdout:1667 writesame 0x7de0f0 thru 0x7ecabd data_size 0x1(0xe9ce bytes) 2024-09-12T05:20:41.704 INFO:teuthology.orchestra.run.smithi059.stdout:1668 read 0xa5d44c4 thru 0xa5dee3f (0xa97c bytes) 2024-09-12T05:20:41.704 INFO:teuthology.orchestra.run.smithi059.stdout:1669 punch from 0x1647d13 to 0x1652150, (0xa43d bytes) 2024-09-12T05:20:41.704 INFO:teuthology.orchestra.run.smithi059.stdout:1670 read 0x92a885a thru 0x92b2bbf (0xa366 bytes) 2024-09-12T05:20:41.705 INFO:teuthology.orchestra.run.smithi059.stdout:1671 punch from 0xb22fa64 to 0xb230999, (0xf35 bytes) 2024-09-12T05:20:41.705 INFO:teuthology.orchestra.run.smithi059.stdout:1673 write 0xa0561da thru 0xa05e809 (0x8630 bytes) 2024-09-12T05:20:41.706 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:41.705+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:41.727 INFO:teuthology.orchestra.run.smithi059.stdout:1674 write 0x5b55a63 thru 0x5b65381 (0xf91f bytes) 2024-09-12T05:20:41.753 INFO:teuthology.orchestra.run.smithi059.stdout:1675 write 0x3ef00ec thru 0x3ef8822 (0x8737 bytes) 2024-09-12T05:20:41.774 INFO:teuthology.orchestra.run.smithi059.stdout:1676 writesame 0xb03b23a thru 0xb04501a data_size 0x1(0x9de1 bytes) 2024-09-12T05:20:41.774 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:41.774 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:41.775 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:41.775 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:41.775 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:41.796 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:41.801 INFO:teuthology.orchestra.run.smithi059.stdout:1677 read 0x86e6f6 thru 0x873a47 (0x5352 bytes) 2024-09-12T05:20:41.802 INFO:teuthology.orchestra.run.smithi059.stdout:1678 write 0x68f9343 thru 0x6904f4f (0xbc0d bytes) 2024-09-12T05:20:41.836 INFO:teuthology.orchestra.run.smithi059.stdout:1679 read 0xa70fc6 thru 0xa74681 (0x36bc bytes) 2024-09-12T05:20:41.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:41.837+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:1681 punch from 0x45bee64 to 0x45bf29f, (0x43b bytes) 2024-09-12T05:20:41.837 INFO:teuthology.orchestra.run.smithi059.stdout:1683 writesame 0x8d4fd7a thru 0x8d58c1b data_size 0x1(0x8ea2 bytes) 2024-09-12T05:20:41.859 INFO:teuthology.orchestra.run.smithi059.stdout:1684 read 0x7e5d6cc thru 0x7e6117a (0x3aaf bytes) 2024-09-12T05:20:41.868 INFO:teuthology.orchestra.run.smithi059.stdout:1685 trunc from 0xbacd5a1 to 0x809d6e2 2024-09-12T05:20:41.908 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:41.909+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:41.940 INFO:teuthology.orchestra.run.smithi059.stdout:1686 write 0xbc7095c thru 0xbc7bb45 (0xb1ea bytes) 2024-09-12T05:20:41.961 INFO:teuthology.orchestra.run.smithi059.stdout:1687 writesame 0x4f98ee3 thru 0x4f9d37f data_size 0x5(0x449d bytes) 2024-09-12T05:20:41.977 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:41.977 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:41.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4630 3.1a 3:5ebba714:::rbd_data.1118e5842253.0000000000000077:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.839380635000001, 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039742162999999997, 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.978 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4630 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138451+0000", 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9570000000000001e-06 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138461+0000", 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9760000000000007e-06 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138489+0000", 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7742999999999998e-05 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138504+0000", 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4960000000000001e-05 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138608+0000", 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104053 2024-09-12T05:20:41.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138815+0000", 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000206832 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.145988+0000", 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071735109999999996 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.177998+0000", 2024-09-12T05:20:41.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032009700000000002 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178028+0000", 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0209000000000002e-05 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178118+0000", 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9365999999999998e-05 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:41.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178191+0000", 2024-09-12T05:20:41.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3856000000000006e-05 2024-09-12T05:20:41.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.984 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.984 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10970 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:41.984 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.916740042000001, 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033399048000000001, 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10970 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061091+0000", 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1230000000000001e-06 2024-09-12T05:20:41.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061096+0000", 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1000000000000003e-06 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061113+0000", 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7227e-05 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061127+0000", 2024-09-12T05:20:41.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3793e-05 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093864+0000", 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032736994999999998 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094052+0000", 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018771799999999999 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094489+0000", 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043709199999999998 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10971 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.916685379, 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033948741999999997, 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.989 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10971 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:41.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061146+0000", 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.167e-06 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061151+0000", 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8899999999999998e-06 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061167+0000", 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6578999999999998e-05 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061181+0000", 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3587000000000001e-05 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094538+0000", 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033357568999999997 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094672+0000", 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133323 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095093+0000", 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042162699999999999 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11031 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 303104~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.916272572, 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034486665, 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11031 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061559+0000", 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-12T05:20:41.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061568+0000", 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5329999999999994e-06 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061598+0000", 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0395999999999998e-05 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061618+0000", 2024-09-12T05:20:41.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000001e-05 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095169+0000", 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033551105999999997 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095379+0000", 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021028999999999999 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:41.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096044+0000", 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00066456000000000002 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11032 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 352256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.916180005999999, 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035279433999999998, 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:41.998 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11032 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:41.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061651+0000", 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.44e-06 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061658+0000", 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4529999999999999e-06 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061678+0000", 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0460000000000001e-05 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061693+0000", 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.468e-05 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096100+0000", 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034407364000000003 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096256+0000", 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015584799999999999 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096929+0000", 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067318900000000004 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11033 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 401408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.916116026999999, 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036054468999999999, 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11033 2024-09-12T05:20:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061715+0000", 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061722+0000", 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5740000000000001e-06 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061741+0000", 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061754+0000", 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3257e-05 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096997+0000", 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035242809 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097165+0000", 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000168839 2024-09-12T05:20:42.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097768+0000", 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00060290099999999998 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11034 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 450560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.916057347000001, 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036605824000000002, 2024-09-12T05:20:42.007 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11034 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061774+0000", 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.13e-06 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061779+0000", 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9169999999999997e-06 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061797+0000", 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7995999999999998e-05 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061810+0000", 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3753e-05 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097821+0000", 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036010845 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097958+0000", 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137188 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098378+0000", 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041999499999999999 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11035 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 499712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.915999458, 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037210007000000003, 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.012 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11035 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061832+0000", 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.243e-06 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061842+0000", 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0067e-05 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061860+0000", 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7923000000000001e-05 2024-09-12T05:20:42.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061873+0000", 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3277e-05 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098443+0000", 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036569628999999999 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098601+0000", 2024-09-12T05:20:42.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015857800000000001 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099040+0000", 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043929 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23755 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 354304~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0717963740000001, 2024-09-12T05:20:42.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033578519000000001, 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23755 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2499999999999995e-07 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906036+0000", 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.092e-06 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906043+0000", 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906048+0000", 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1019999999999996e-06 2024-09-12T05:20:42.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939392+0000", 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033344290999999998 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939469+0000", 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6792000000000006e-05 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939612+0000", 2024-09-12T05:20:42.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014325699999999999 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23756 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 364544~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0717751600000001, 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033786347000000001, 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.021 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23756 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4000000000000002e-07 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906057+0000", 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0080000000000001e-06 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906065+0000", 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9359999999999999e-06 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906070+0000", 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.259e-06 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939658+0000", 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033587287 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939732+0000", 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4666000000000006e-05 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939841+0000", 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108651 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.025 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23757 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 374784~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.071752957, 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033996597000000003, 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.026 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23757 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4400000000000001e-07 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906084+0000", 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999998e-06 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906091+0000", 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7000000000000002e-06 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906096+0000", 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9679999999999997e-06 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939885+0000", 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033789419000000001 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939989+0000", 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010427100000000001 2024-09-12T05:20:42.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940074+0000", 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4135000000000007e-05 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23758 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 401408~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0717266409999999, 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034154898000000003, 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.030 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23758 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906104+0000", 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.89e-07 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906106+0000", 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.419e-06 2024-09-12T05:20:42.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906112+0000", 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2720000000000003e-06 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906118+0000", 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1370000000000001e-06 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940114+0000", 2024-09-12T05:20:42.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033996234 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940185+0000", 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0919000000000003e-05 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940258+0000", 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3428000000000002e-05 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.034 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23759 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 411648~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.071704735, 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034344294999999997, 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23759 2024-09-12T05:20:42.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906126+0000", 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-07 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906129+0000", 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8100000000000002e-06 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906135+0000", 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6749999999999996e-06 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906140+0000", 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0660000000000003e-06 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940302+0000", 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034161206 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940385+0000", 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3415e-05 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940469+0000", 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4400999999999994e-05 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23760 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 421888~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0716648929999999, 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034485021999999997, 2024-09-12T05:20:42.039 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23760 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906166+0000", 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9299999999999998e-07 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906168+0000", 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5600000000000001e-06 2024-09-12T05:20:42.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906175+0000", 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3440000000000003e-06 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906181+0000", 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7799999999999997e-06 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940510+0000", 2024-09-12T05:20:42.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034329163000000003 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940578+0000", 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7971000000000004e-05 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940650+0000", 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1611000000000003e-05 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23761 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 432128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.071640302, 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034676953000000003, 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23761 2024-09-12T05:20:42.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906192+0000", 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2330000000000001e-06 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906199+0000", 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906204+0000", 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.113e-06 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940691+0000", 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034486744 2024-09-12T05:20:42.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940787+0000", 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5880999999999999e-05 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940867+0000", 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9692999999999997e-05 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23762 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 458752~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0716186729999999, 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034860442999999998, 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23762 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906212+0000", 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-12T05:20:42.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906214+0000", 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9470000000000002e-06 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906220+0000", 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.302e-06 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906226+0000", 2024-09-12T05:20:42.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2929999999999997e-06 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940927+0000", 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034700380000000003 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940998+0000", 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1888e-05 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941072+0000", 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3182000000000005e-05 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23763 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 468992~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0715966889999999, 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035048453, 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.053 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23763 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906234+0000", 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906236+0000", 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1720000000000001e-06 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906243+0000", 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906248+0000", 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3140000000000003e-06 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941118+0000", 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034869783000000001 2024-09-12T05:20:42.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941199+0000", 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0906000000000001e-05 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941282+0000", 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3133999999999994e-05 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23764 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 479232~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.071574692, 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035223974999999998, 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23764 2024-09-12T05:20:42.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906256+0000", 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4700000000000001e-07 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906258+0000", 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1289999999999999e-06 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906265+0000", 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3350000000000001e-06 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906271+0000", 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941324+0000", 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035052899999999998 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941401+0000", 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7572999999999997e-05 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941479+0000", 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8036999999999998e-05 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23765 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 489472~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.071551358, 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035401881000000003, 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.062 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23765 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906281+0000", 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1320000000000001e-06 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906289+0000", 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.977e-06 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906294+0000", 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941519+0000", 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035224917000000001 2024-09-12T05:20:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941589+0000", 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9978e-05 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941680+0000", 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1033999999999996e-05 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23766 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 516096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0715277990000001, 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035572985000000001, 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23766 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906303+0000", 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2399999999999998e-07 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906305+0000", 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906311+0000", 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5169999999999996e-06 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906316+0000", 2024-09-12T05:20:42.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9749999999999998e-06 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941709+0000", 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035392161999999998 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941798+0000", 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9302000000000007e-05 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:42.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941875+0000", 2024-09-12T05:20:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7180000000000003e-05 2024-09-12T05:20:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.071 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.071 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:42.071 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:20:42.073 INFO:teuthology.orchestra.run.smithi059.stdout:1688 punch from 0x90ee417 to 0x90fa34a, (0xbf33 bytes) 2024-09-12T05:20:42.073 INFO:teuthology.orchestra.run.smithi059.stdout:1689 trunc from 0xbc7bb46 to 0x88a9cbf 2024-09-12T05:20:42.073 INFO:teuthology.orchestra.run.smithi059.stdout:1690 write 0x16e2d16 thru 0x16eaf42 (0x822d bytes) 2024-09-12T05:20:42.073 INFO:teuthology.orchestra.run.smithi059.stdout:1691 trunc from 0x88a9cbf to 0x36fc9ae 2024-09-12T05:20:42.074 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:42.075 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:42.073+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:42.106 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.106 INFO:teuthology.orchestra.run.smithi059.stdout:1695 read 0x2294db4 thru 0x229ed23 (0x9f70 bytes) 2024-09-12T05:20:42.133 INFO:teuthology.orchestra.run.smithi059.stdout:1698 write 0xcb6a61b thru 0xcb78b56 (0xe53c bytes) 2024-09-12T05:20:42.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:42.161 INFO:teuthology.orchestra.run.smithi059.stdout:1699 punch from 0x5f5903e to 0x5f641b4, (0xb176 bytes) 2024-09-12T05:20:42.162 INFO:teuthology.orchestra.run.smithi059.stdout:1700 punch from 0x41b9064 to 0x41c670f, (0xd6ab bytes) 2024-09-12T05:20:42.162 INFO:teuthology.orchestra.run.smithi059.stdout:1701 trunc from 0xcb78b57 to 0xcb7d4da 2024-09-12T05:20:42.168 INFO:teuthology.orchestra.run.smithi059.stdout:1702 write 0x76bfccd thru 0x76cf671 (0xf9a5 bytes) 2024-09-12T05:20:42.174 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:42.173+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:42.192 INFO:teuthology.orchestra.run.smithi059.stdout:1703 writesame 0x9a459fe thru 0x9a54ac6 data_size 0x1b(0xf0c9 bytes) 2024-09-12T05:20:42.216 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:42.216 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:42.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:26827 3.c 3:3063e7a8:::rbd_data.111887da7c95.000000000000026d:head [set-alloc-hint object_size 262144 write_size 262144,write 20480~4096 in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:42.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:42.208831+0000", 2024-09-12T05:20:42.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0095573580000000002, 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095929329999999997, 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 26827 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:42.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.208831+0000", 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.208831+0000", 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.208832+0000", 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.288e-06 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.208839+0000", 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.148e-06 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.208855+0000", 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6175999999999999e-05 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.208861+0000", 2024-09-12T05:20:42.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7620000000000001e-06 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.216734+0000", 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0078733689999999999 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.216867+0000", 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013291099999999999 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:42.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.217020+0000", 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152218 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:42.218059+0000", 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001039519 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-09-12T05:20:42.221 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:42.222 INFO:teuthology.orchestra.run.smithi059.stdout:1704 read 0x2f03ea4 thru 0x2f058ff (0x1a5c bytes) 2024-09-12T05:20:42.222 INFO:teuthology.orchestra.run.smithi059.stdout:1705 write 0x48f2df7 thru 0x48fdfd5 (0xb1df bytes) 2024-09-12T05:20:42.235 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:42.241 INFO:teuthology.orchestra.run.smithi059.stdout:1707 write 0x608d1d0 thru 0x609a3fe (0xd22f bytes) 2024-09-12T05:20:42.262 INFO:teuthology.orchestra.run.smithi059.stdout:1708 read 0x1960bba thru 0x196b32c (0xa773 bytes) 2024-09-12T05:20:42.262 INFO:teuthology.orchestra.run.smithi059.stdout:1709 write 0xc373fe0 thru 0xc37e79d (0xa7be bytes) 2024-09-12T05:20:42.275 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:42.273+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:42.285 INFO:teuthology.orchestra.run.smithi059.stdout:1710 read 0x163388d thru 0x1636083 (0x27f7 bytes) 2024-09-12T05:20:42.286 INFO:teuthology.orchestra.run.smithi059.stdout:1711 writesame 0x50553b0 thru 0x50603e2 data_size 0x1(0xb033 bytes) 2024-09-12T05:20:42.310 INFO:teuthology.orchestra.run.smithi059.stdout:1712 read 0x5cafb60 thru 0x5cb558f (0x5a30 bytes) 2024-09-12T05:20:42.315 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:42.315 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:42.320 INFO:teuthology.orchestra.run.smithi059.stdout:1713 trunc from 0xcb7d4da to 0x5fc2967 2024-09-12T05:20:42.338 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:42.358 INFO:teuthology.orchestra.run.smithi059.stdout:1715 write 0x7d36ca thru 0x7d76e6 (0x401d bytes) 2024-09-12T05:20:42.362 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:42.362 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:42.365 INFO:teuthology.orchestra.run.smithi059.stdout:1716 punch from 0x401c5d1 to 0x4023504, (0x6f33 bytes) 2024-09-12T05:20:42.365 INFO:teuthology.orchestra.run.smithi059.stdout:1717 punch from 0x42486e0 to 0x424a2fc, (0x1c1c bytes) 2024-09-12T05:20:42.371 INFO:teuthology.orchestra.run.smithi059.stdout:1718 writesame 0x666c8a1 thru 0x6670c37 data_size 0xd(0x4397 bytes) 2024-09-12T05:20:42.371 INFO:teuthology.orchestra.run.smithi059.stdout:1719 read 0x65c24d4 thru 0x65c2c7c (0x7a9 bytes) 2024-09-12T05:20:42.376 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:42.376 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:42.376 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:42.376 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:42.376 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:42.377 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:42.377+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:42.383 INFO:teuthology.orchestra.run.smithi059.stdout:1721 writesame 0x917aec5 thru 0x9183701 data_size 0x1(0x883d bytes) 2024-09-12T05:20:42.383 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.383 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.383 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.383 INFO:teuthology.orchestra.run.smithi059.stdout:1728 read 0x3d2c8b0 thru 0x3d31b6f (0x52c0 bytes) 2024-09-12T05:20:42.383 INFO:teuthology.orchestra.run.smithi059.stdout:1729 read 0x83b5524 thru 0x83c37e7 (0xe2c4 bytes) 2024-09-12T05:20:42.383 INFO:teuthology.orchestra.run.smithi059.stdout:1730 read 0x8609df8 thru 0x8611cff (0x7f08 bytes) 2024-09-12T05:20:42.383 INFO:teuthology.orchestra.run.smithi059.stdout:1731 punch from 0x6b39b74 to 0x6b48113, (0xe59f bytes) 2024-09-12T05:20:42.384 INFO:teuthology.orchestra.run.smithi059.stdout:1732 trunc from 0x9183702 to 0x98bfa6a 2024-09-12T05:20:42.391 INFO:teuthology.orchestra.run.smithi059.stdout:1734 write 0x43e6e0b thru 0x43f02e5 (0x94db bytes) 2024-09-12T05:20:42.392 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:42.395 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:42.411 INFO:teuthology.orchestra.run.smithi059.stdout:1735 read 0x3dabe0f thru 0x3dbac49 (0xee3b bytes) 2024-09-12T05:20:42.412 INFO:teuthology.orchestra.run.smithi059.stdout:1736 punch from 0x72a9535 to 0x72b8668, (0xf133 bytes) 2024-09-12T05:20:42.412 INFO:teuthology.orchestra.run.smithi059.stdout:1738 read 0x7e86c30 thru 0x7e90ff4 (0xa3c5 bytes) 2024-09-12T05:20:42.412 INFO:teuthology.orchestra.run.smithi059.stdout:1739 read 0x6021689 thru 0x602e3bd (0xcd35 bytes) 2024-09-12T05:20:42.412 INFO:teuthology.orchestra.run.smithi059.stdout:1741 read 0x69a89bb thru 0x69b5224 (0xc86a bytes) 2024-09-12T05:20:42.412 INFO:teuthology.orchestra.run.smithi059.stdout:1743 write 0x186b848 thru 0x18718d8 (0x6091 bytes) 2024-09-12T05:20:42.418 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:42.422 INFO:teuthology.orchestra.run.smithi059.stdout:1744 writesame 0x68c2a40 thru 0x68c54d1 data_size 0x1(0x2a92 bytes) 2024-09-12T05:20:42.440 INFO:teuthology.orchestra.run.smithi059.stdout:1746 punch from 0x705a74 to 0x7153b6, (0xf942 bytes) 2024-09-12T05:20:42.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:42.454 INFO:teuthology.orchestra.run.smithi059.stdout:1747 write 0xe98fc09 thru 0xe990c3c (0x1034 bytes) 2024-09-12T05:20:42.463 INFO:teuthology.orchestra.run.smithi059.stdout:1748 writesame 0xae4c907 thru 0xae53a9d data_size 0x1b(0x7197 bytes) 2024-09-12T05:20:42.472 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:42.472 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:42.477 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:42.477+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:42.483 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.483 INFO:teuthology.orchestra.run.smithi059.stdout:1752 read 0x6466bd thru 0x6486d5 (0x2019 bytes) 2024-09-12T05:20:42.484 INFO:teuthology.orchestra.run.smithi059.stdout:1753 write 0x8dab6ef thru 0x8daba72 (0x384 bytes) 2024-09-12T05:20:42.491 INFO:teuthology.orchestra.run.smithi059.stdout:1754 write 0x14e771c thru 0x14ef79e (0x8083 bytes) 2024-09-12T05:20:42.494 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:42.517 INFO:teuthology.orchestra.run.smithi059.stdout:1755 write 0x6af6bda thru 0x6b052b7 (0xe6de bytes) 2024-09-12T05:20:42.530 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:42.530 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:42.535 INFO:teuthology.orchestra.run.smithi059.stdout:1756 write 0xba3a180 thru 0xba3ddc0 (0x3c41 bytes) 2024-09-12T05:20:42.549 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:42.554 INFO:teuthology.orchestra.run.smithi059.stdout:1758 punch from 0x94eb2e6 to 0x94ef101, (0x3e1b bytes) 2024-09-12T05:20:42.555 INFO:teuthology.orchestra.run.smithi059.stdout:1759 read 0x4924704 thru 0x4934050 (0xf94d bytes) 2024-09-12T05:20:42.555 INFO:teuthology.orchestra.run.smithi059.stdout:1760 read 0xe791851 thru 0xe794749 (0x2ef9 bytes) 2024-09-12T05:20:42.556 INFO:teuthology.orchestra.run.smithi059.stdout:1761 read 0x47a992e thru 0x47b3435 (0x9b08 bytes) 2024-09-12T05:20:42.557 INFO:teuthology.orchestra.run.smithi059.stdout:1763 write 0x941c232 thru 0x942ada1 (0xeb70 bytes) 2024-09-12T05:20:42.573 INFO:teuthology.orchestra.run.smithi059.stdout:1764 read 0x41bea4a thru 0x41c4f7b (0x6532 bytes) 2024-09-12T05:20:42.573 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.573 INFO:teuthology.orchestra.run.smithi059.stdout:1766 read 0x448dcad thru 0x44939a4 (0x5cf8 bytes) 2024-09-12T05:20:42.574 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.574 INFO:teuthology.orchestra.run.smithi059.stdout:1771 read 0x16e40f9 thru 0x16f1905 (0xd80d bytes) 2024-09-12T05:20:42.576 INFO:teuthology.orchestra.run.smithi059.stdout:1772 writesame 0x21510c3 thru 0x215b2ee data_size 0x6b(0xa22c bytes) 2024-09-12T05:20:42.586 INFO:teuthology.orchestra.run.smithi059.stdout:1773 writesame 0x5b1bfb0 thru 0x5b29098 data_size 0x1(0xd0e9 bytes) 2024-09-12T05:20:42.597 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:42.597+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:42.609 INFO:teuthology.orchestra.run.smithi059.stdout:1774 read 0x26ae50c thru 0x26b976b (0xb260 bytes) 2024-09-12T05:20:42.609 INFO:teuthology.orchestra.run.smithi059.stdout:1775 writesame 0x3d23ef5 thru 0x3d2f16b data_size 0x61(0xb277 bytes) 2024-09-12T05:20:42.630 INFO:teuthology.orchestra.run.smithi059.stdout:1776 write 0xd9a3ae2 thru 0xd9b39c7 (0xfee6 bytes) 2024-09-12T05:20:42.649 INFO:teuthology.orchestra.run.smithi059.stdout:1777 punch from 0x2be9838 to 0x2bf8337, (0xeaff bytes) 2024-09-12T05:20:42.649 INFO:teuthology.orchestra.run.smithi059.stdout:1778 read 0x6e39ef9 thru 0x6e3e728 (0x4830 bytes) 2024-09-12T05:20:42.657 INFO:teuthology.orchestra.run.smithi059.stdout:1781 trunc from 0xe990c3d to 0xa679808 2024-09-12T05:20:42.679 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:42.677+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:42.698 INFO:teuthology.orchestra.run.smithi059.stdout:1783 read 0x11c2a24 thru 0x11c7486 (0x4a63 bytes) 2024-09-12T05:20:42.699 INFO:teuthology.orchestra.run.smithi059.stdout:1784 read 0x52dadde thru 0x52ea069 (0xf28c bytes) 2024-09-12T05:20:42.720 INFO:teuthology.orchestra.run.smithi059.stdout:1785 write 0xe59264d thru 0xe59b0a7 (0x8a5b bytes) 2024-09-12T05:20:42.732 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:42.732 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:42.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:42.756 INFO:teuthology.orchestra.run.smithi059.stdout:1788 write 0x63bc096 thru 0x63cbc2b (0xfb96 bytes) 2024-09-12T05:20:42.784 INFO:teuthology.orchestra.run.smithi059.stdout:1790 read 0x3a73885 thru 0x3a82aae (0xf22a bytes) 2024-09-12T05:20:42.785 INFO:teuthology.orchestra.run.smithi059.stdout:1794 read 0x4b2233c thru 0x4b31d8e (0xfa53 bytes) 2024-09-12T05:20:42.785 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.785 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:42.785 INFO:teuthology.orchestra.run.smithi059.stdout:1798 writesame 0x8bfb9ac thru 0x8c0466a data_size 0x1(0x8cbf bytes) 2024-09-12T05:20:42.804 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:42.805+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:42.826 INFO:teuthology.orchestra.run.smithi059.stdout:1799 writesame 0x2cfc7c0 thru 0x2d08861 data_size 0x3(0xc0a2 bytes) 2024-09-12T05:20:42.848 INFO:teuthology.orchestra.run.smithi059.stdout:1800 write 0x54ee909 thru 0x54f1644 (0x2d3c bytes) 2024-09-12T05:20:42.880 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:42.881+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:42.888 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:42.888 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:42.895 INFO:teuthology.orchestra.run.smithi059.stdout:1801 trunc from 0xe59b0a8 to 0x456f922 2024-09-12T05:20:42.904 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:42.989 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:42.989+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:42.990 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:20:43.025 INFO:teuthology.orchestra.run.smithi059.stdout:1802 writesame 0xd303f20 thru 0xd312212 data_size 0x1(0xe2f3 bytes) 2024-09-12T05:20:43.025 INFO:teuthology.orchestra.run.smithi059.stdout:1803 write 0x7952791 thru 0x79565da (0x3e4a bytes) 2024-09-12T05:20:43.046 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:43.046 INFO:teuthology.orchestra.run.smithi059.stdout:1805 read 0x9ee9743 thru 0x9ef100f (0x78cd bytes) 2024-09-12T05:20:43.057 INFO:teuthology.orchestra.run.smithi059.stdout:1806 write 0xea50972 thru 0xea54456 (0x3ae5 bytes) 2024-09-12T05:20:43.081 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:43.081 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:43.082 INFO:teuthology.orchestra.run.smithi059.stdout:1807 write 0xa2dc137 thru 0xa2e3b1e (0x79e8 bytes) 2024-09-12T05:20:43.082 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:43.081+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:43.100 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:43.105 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:43.105 INFO:teuthology.orchestra.run.smithi059.stdout:1809 write 0x1976d84 thru 0x197fcb9 (0x8f36 bytes) 2024-09-12T05:20:43.117 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:43.117 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:43.117 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T05:20:43.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:20:43.132 INFO:teuthology.orchestra.run.smithi059.stdout:1810 read 0xcc63ec3 thru 0xcc69f33 (0x6071 bytes) 2024-09-12T05:20:43.132 INFO:teuthology.orchestra.run.smithi059.stdout:1812 read 0xe5b79df thru 0xe5c013b (0x875d bytes) 2024-09-12T05:20:43.132 INFO:teuthology.orchestra.run.smithi059.stdout:1813 write 0x503ddb6 thru 0x50415ad (0x37f8 bytes) 2024-09-12T05:20:43.156 INFO:teuthology.orchestra.run.smithi059.stdout:1815 read 0x5c21366 thru 0x5c2c18f (0xae2a bytes) 2024-09-12T05:20:43.156 INFO:teuthology.orchestra.run.smithi059.stdout:1816 writesame 0x5a6dee9 thru 0x5a7c235 data_size 0x1(0xe34d bytes) 2024-09-12T05:20:43.181 INFO:teuthology.orchestra.run.smithi059.stdout:1818 write 0x98403ee thru 0x984fef2 (0xfb05 bytes) 2024-09-12T05:20:43.183 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:43.185+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:43.202 INFO:teuthology.orchestra.run.smithi059.stdout:1819 writesame 0x5c8189b thru 0x5c894df data_size 0x1(0x7c45 bytes) 2024-09-12T05:20:43.228 INFO:teuthology.orchestra.run.smithi059.stdout:1820 writesame 0xbef6578 thru 0xbf04788 data_size 0x3(0xe211 bytes) 2024-09-12T05:20:43.252 INFO:teuthology.orchestra.run.smithi059.stdout:1821 write 0x2eb065 thru 0x2f437a (0x9316 bytes) 2024-09-12T05:20:43.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:43.285+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:43.304 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:43.304 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:43.327 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:43.406 INFO:teuthology.orchestra.run.smithi059.stdout:1825 punch from 0x77c0f80 to 0x77cd92b, (0xc9ab bytes) 2024-09-12T05:20:43.406 INFO:teuthology.orchestra.run.smithi059.stdout:1826 write 0xd968d4b thru 0xd971504 (0x87ba bytes) 2024-09-12T05:20:43.412 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:43.413+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:43.429 INFO:teuthology.orchestra.run.smithi059.stdout:1829 punch from 0x33bed9a to 0x33c3cd8, (0x4f3e bytes) 2024-09-12T05:20:43.429 INFO:teuthology.orchestra.run.smithi059.stdout:1830 punch from 0x429ce3d to 0x42aaffb, (0xe1be bytes) 2024-09-12T05:20:43.429 INFO:teuthology.orchestra.run.smithi059.stdout:1831 read 0x97fe73d thru 0x9808cd2 (0xa596 bytes) 2024-09-12T05:20:43.439 INFO:teuthology.orchestra.run.smithi059.stdout:1832 trunc from 0xea54457 to 0x7c8ed6a 2024-09-12T05:20:43.481 INFO:teuthology.orchestra.run.smithi059.stdout:1833 punch from 0x7bd5a63 to 0x7bda7fe, (0x4d9b bytes) 2024-09-12T05:20:43.481 INFO:teuthology.orchestra.run.smithi059.stdout:1834 write 0x5c42879 thru 0x5c4caaa (0xa232 bytes) 2024-09-12T05:20:43.486 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:43.485+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:43.500 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:43.500 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:43.500 INFO:teuthology.orchestra.run.smithi059.stdout:1835 write 0xb18c476 thru 0xb1967cb (0xa356 bytes) 2024-09-12T05:20:43.520 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:43.525 INFO:teuthology.orchestra.run.smithi059.stdout:1836 write 0x6755ec8 thru 0x675a793 (0x48cc bytes) 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 46, 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:20:42.980881+0000", 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:19:51.845158+0000", 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:20:32.916583+0000", 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5799936, 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:20:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 5, 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "jewel", 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:20:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:20:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:20:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:20:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:20:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:20:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.9900000095367432, 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.9900000095367432, 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:20:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:20:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "45", 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 14, 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 45, 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:20:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:20:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:20:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.5, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.5, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 1, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.5, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.5, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:20:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 42, 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:20:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 19, 2024-09-12T05:20:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:20:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 42, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:20:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:20:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/2467380900", 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/2467380900", 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/2467380900", 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/2467380900", 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 23, 2024-09-12T05:20:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 42, 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:20:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:20:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:43.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2024-09-12T05:20:43.617 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [], 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [], 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:43.619 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:43.620 INFO:teuthology.orchestra.run.smithi059.stdout:1837 writesame 0xc1d269d thru 0xc1d6de9 data_size 0x1(0x474d bytes) 2024-09-12T05:20:43.620 INFO:teuthology.orchestra.run.smithi059.stdout:1838 read 0x935bb79 thru 0x935c2c4 (0x74c bytes) 2024-09-12T05:20:43.621 INFO:teuthology.orchestra.run.smithi059.stdout:1841 write 0x34886ec thru 0x3496d26 (0xe63b bytes) 2024-09-12T05:20:43.622 INFO:tasks.thrashosds.thrasher:j is {'epoch': 46, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:20:42.980881+0000', 'last_up_change': '2024-09-12T05:19:51.845158+0000', 'last_in_change': '2024-09-12T05:20:32.916583+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 45, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 2467380900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 2467380900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 2467380900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 2467380900}]}, 'public_addr': '172.21.15.194:6825/2467380900', 'cluster_addr': '172.21.15.194:6827/2467380900', 'heartbeat_back_addr': '172.21.15.194:6831/2467380900', 'heartbeat_front_addr': '172.21.15.194:6829/2467380900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:20:43.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:20:43.623 INFO:teuthology.orchestra.run.smithi059.stdout:1845 write 0xcb78510 thru 0xcb79cd5 (0x17c6 bytes) 2024-09-12T05:20:43.623 INFO:teuthology.orchestra.run.smithi059.stdout:1846 read 0xc752361 thru 0xc756c47 (0x48e7 bytes) 2024-09-12T05:20:43.623 INFO:teuthology.orchestra.run.smithi059.stdout:1847 trunc from 0xcb79cd6 to 0x774638d 2024-09-12T05:20:43.623 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:43.621+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:43.637 INFO:teuthology.orchestra.run.smithi059.stdout:1849 writesame 0x2fb632f thru 0x2fc6141 data_size 0x51(0xfe13 bytes) 2024-09-12T05:20:43.677 INFO:teuthology.orchestra.run.smithi059.stdout:1850 writesame 0xbd79e62 thru 0xbd828f8 data_size 0x1(0x8a97 bytes) 2024-09-12T05:20:43.677 INFO:teuthology.orchestra.run.smithi059.stdout:1851 punch from 0x175e1a7 to 0x176d3aa, (0xf203 bytes) 2024-09-12T05:20:43.697 INFO:teuthology.orchestra.run.smithi059.stdout:1852 trunc from 0xbd828f9 to 0x27ba17f 2024-09-12T05:20:43.721 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:43.721+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:43.772 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:43.772 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:43.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:43.810 INFO:teuthology.orchestra.run.smithi059.stdout:1853 punch from 0xdb115e to 0xdc06c8, (0xf56a bytes) 2024-09-12T05:20:43.810 INFO:teuthology.orchestra.run.smithi059.stdout:1854 trunc from 0x27ba17f to 0x2118995 2024-09-12T05:20:43.821 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:43.821+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:43.831 INFO:teuthology.orchestra.run.smithi059.stdout:1855 read 0xaf2496 thru 0xafe6a6 (0xc211 bytes) 2024-09-12T05:20:43.833 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:43.833 INFO:teuthology.orchestra.run.smithi059.stdout:1857 punch from 0x124017c to 0x124762a, (0x74ae bytes) 2024-09-12T05:20:43.858 INFO:teuthology.orchestra.run.smithi059.stdout:1858 write 0xc871b8e thru 0xc873306 (0x1779 bytes) 2024-09-12T05:20:43.870 INFO:teuthology.orchestra.run.smithi059.stdout:1859 writesame 0x8e42ec6 thru 0x8e4a632 data_size 0x2b(0x776d bytes) 2024-09-12T05:20:43.895 INFO:teuthology.orchestra.run.smithi059.stdout:1861 punch from 0x685790a to 0x686362b, (0xbd21 bytes) 2024-09-12T05:20:43.895 INFO:teuthology.orchestra.run.smithi059.stdout:1862 read 0x81c301 thru 0x82ab23 (0xe823 bytes) 2024-09-12T05:20:43.904 INFO:teuthology.orchestra.run.smithi059.stdout:1863 writesame 0xd79cd38 thru 0xd7a1252 data_size 0x1(0x451b bytes) 2024-09-12T05:20:43.904 INFO:teuthology.orchestra.run.smithi059.stdout:1865 read 0xacfee09 thru 0xad07a17 (0x8c0f bytes) 2024-09-12T05:20:43.905 INFO:teuthology.orchestra.run.smithi059.stdout:1866 punch from 0x9b3377a to 0x9b38c62, (0x54e8 bytes) 2024-09-12T05:20:43.905 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:43.917 INFO:teuthology.orchestra.run.smithi059.stdout:1869 trunc from 0xd7a1253 to 0x60a9055 2024-09-12T05:20:43.922 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:43.921+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:43.944 INFO:teuthology.orchestra.run.smithi059.stdout:1871 read 0x2cf438b thru 0x2cf4af1 (0x767 bytes) 2024-09-12T05:20:43.944 INFO:teuthology.orchestra.run.smithi059.stdout:1873 read 0x3a860b6 thru 0x3a8b212 (0x515d bytes) 2024-09-12T05:20:43.957 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:43.957 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:43.958 INFO:teuthology.orchestra.run.smithi059.stdout:1875 trunc from 0x60a9055 to 0xec0bdfb 2024-09-12T05:20:43.969 INFO:teuthology.orchestra.run.smithi059.stdout:1876 read 0xa255a8f thru 0xa25851e (0x2a90 bytes) 2024-09-12T05:20:43.969 INFO:teuthology.orchestra.run.smithi059.stdout:1877 read 0xea8ecc5 thru 0xea958b3 (0x6bef bytes) 2024-09-12T05:20:43.969 INFO:teuthology.orchestra.run.smithi059.stdout:1878 read 0xd1c1530 thru 0xd1c6de8 (0x58b9 bytes) 2024-09-12T05:20:43.969 INFO:teuthology.orchestra.run.smithi059.stdout:1883 read 0xcb9c46 thru 0xcc23ec (0x87a7 bytes) 2024-09-12T05:20:43.971 INFO:teuthology.orchestra.run.smithi059.stdout:1884 write 0x2ebd7ac thru 0x2ec2416 (0x4c6b bytes) 2024-09-12T05:20:43.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:44.009 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:20:44.010 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:20:44.014 INFO:teuthology.orchestra.run.smithi059.stdout:1885 read 0xb3ea2b6 thru 0xb3ec534 (0x227f bytes) 2024-09-12T05:20:44.015 INFO:teuthology.orchestra.run.smithi059.stdout:1887 read 0x34681cb thru 0x346b092 (0x2ec8 bytes) 2024-09-12T05:20:44.015 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:44.015 INFO:teuthology.orchestra.run.smithi059.stdout:1889 write 0xc8ef678 thru 0xc8f099f (0x1328 bytes) 2024-09-12T05:20:44.023 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:44.021+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:44.032 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-12T05:20:42.993014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":407115748,"num_objects":588,"num_object_clones":98,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":157,"num_read":38619,"num_read_kb":237740,"num_write":7178,"num_write_kb":128382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":6669856,"num_keys_recovered":17,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5560,"ondisk_log_size":5560,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":473984,"kb_used_data":207780,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754500736,"statfs":{"total":773094113280,"available":772608753664,"internally_reserved":0,"allocated":212766720,"data_stored":281938573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[48,38,65,43,37,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26206202,"num_objects":197,"num_object_clones":14,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18338,"num_read_kb":40596,"num_write":3903,"num_write_kb":14077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":6669856,"num_keys_recovered":17,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.087378"},"pg_stats":[{"pgid":"3.1f","version":"45'117","reported_seq":848,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.837071+0000","last_change":"2024-09-12T05:20:11.762958+0000","last_active":"2024-09-12T05:20:41.837071+0000","last_peered":"2024-09-12T05:20:41.837071+0000","last_clean":"2024-09-12T05:20:41.837071+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:20:41.837071+0000","last_undegraded":"2024-09-12T05:20:41.837071+0000","last_fullsized":"2024-09-12T05:20:41.837071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:04.340640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036800549999999998,"stat_sum":{"num_bytes":8265855,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":3,"num_read":1035,"num_read_kb":4225,"num_write":111,"num_write_kb":2328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"45'62","reported_seq":982,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.964387+0000","last_change":"2024-09-12T05:20:34.070752+0000","last_active":"2024-09-12T05:20:41.964387+0000","last_peered":"2024-09-12T05:20:41.964387+0000","last_clean":"2024-09-12T05:20:41.964387+0000","last_became_active":"2024-09-12T05:20:33.940420+0000","last_became_peered":"2024-09-12T05:20:33.940420+0000","last_unstale":"2024-09-12T05:20:41.964387+0000","last_undegraded":"2024-09-12T05:20:41.964387+0000","last_fullsized":"2024-09-12T05:20:41.964387+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:55.964090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015371499999999999,"stat_sum":{"num_bytes":13268927,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":833,"num_read_kb":7795,"num_write":62,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"45'199","reported_seq":440,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.044352+0000","last_change":"2024-09-12T05:20:11.737126+0000","last_active":"2024-09-12T05:20:42.044352+0000","last_peered":"2024-09-12T05:20:42.044352+0000","last_clean":"2024-09-12T05:20:42.044352+0000","last_became_active":"2024-09-12T05:20:09.751607+0000","last_became_peered":"2024-09-12T05:20:09.751607+0000","last_unstale":"2024-09-12T05:20:42.044352+0000","last_undegraded":"2024-09-12T05:20:42.044352+0000","last_fullsized":"2024-09-12T05:20:42.044352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:21.732277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098006399999999989,"stat_sum":{"num_bytes":2125701,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":767,"num_read_kb":499,"num_write":279,"num_write_kb":1508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"45'151","reported_seq":654,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.962151+0000","last_change":"2024-09-12T05:20:11.736070+0000","last_active":"2024-09-12T05:20:41.962151+0000","last_peered":"2024-09-12T05:20:41.962151+0000","last_clean":"2024-09-12T05:20:41.962151+0000","last_became_active":"2024-09-12T05:20:09.751421+0000","last_became_peered":"2024-09-12T05:20:09.751421+0000","last_unstale":"2024-09-12T05:20:41.962151+0000","last_undegraded":"2024-09-12T05:20:41.962151+0000","last_fullsized":"2024-09-12T05:20:41.962151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:35.027887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087905899999999996,"stat_sum":{"num_bytes":9709329,"num_objects":17,"num_object_clones":2,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":6,"num_read":737,"num_read_kb":8414,"num_write":188,"num_write_kb":3577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"45'112","reported_seq":610,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.904037+0000","last_change":"2024-09-12T05:20:11.763552+0000","last_active":"2024-09-12T05:20:41.904037+0000","last_peered":"2024-09-12T05:20:41.904037+0000","last_clean":"2024-09-12T05:20:41.904037+0000","last_became_active":"2024-09-12T05:20:09.757210+0000","last_became_peered":"2024-09-12T05:20:09.757210+0000","last_unstale":"2024-09-12T05:20:41.904037+0000","last_undegraded":"2024-09-12T05:20:41.904037+0000","last_fullsized":"2024-09-12T05:20:41.904037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:39.011233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040909680000000004,"stat_sum":{"num_bytes":12951327,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":461,"num_read_kb":4667,"num_write":110,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"45'167","reported_seq":1740,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.016449+0000","last_change":"2024-09-12T05:20:11.747238+0000","last_active":"2024-09-12T05:20:42.016449+0000","last_peered":"2024-09-12T05:20:42.016449+0000","last_clean":"2024-09-12T05:20:42.016449+0000","last_became_active":"2024-09-12T05:20:09.748122+0000","last_became_peered":"2024-09-12T05:20:09.748122+0000","last_unstale":"2024-09-12T05:20:42.016449+0000","last_undegraded":"2024-09-12T05:20:42.016449+0000","last_fullsized":"2024-09-12T05:20:42.016449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:57:24.667330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014130220000000001,"stat_sum":{"num_bytes":4314033,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":5,"num_read":2581,"num_read_kb":5296,"num_write":166,"num_write_kb":828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"45'145","reported_seq":950,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.892797+0000","last_change":"2024-09-12T05:20:11.741831+0000","last_active":"2024-09-12T05:20:41.892797+0000","last_peered":"2024-09-12T05:20:41.892797+0000","last_clean":"2024-09-12T05:20:41.892797+0000","last_became_active":"2024-09-12T05:20:09.736422+0000","last_became_peered":"2024-09-12T05:20:09.736422+0000","last_unstale":"2024-09-12T05:20:41.892797+0000","last_undegraded":"2024-09-12T05:20:41.892797+0000","last_fullsized":"2024-09-12T05:20:41.892797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:50:12.024647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001296167,"stat_sum":{"num_bytes":10109441,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":1079,"num_read_kb":5309,"num_write":141,"num_write_kb":3297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'106","reported_seq":713,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.957319+0000","last_change":"2024-09-12T05:20:11.786941+0000","last_active":"2024-09-12T05:20:41.957319+0000","last_peered":"2024-09-12T05:20:41.957319+0000","last_clean":"2024-09-12T05:20:41.957319+0000","last_became_active":"2024-09-12T05:20:09.740953+0000","last_became_peered":"2024-09-12T05:20:09.740953+0000","last_unstale":"2024-09-12T05:20:41.957319+0000","last_undegraded":"2024-09-12T05:20:41.957319+0000","last_fullsized":"2024-09-12T05:20:41.957319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:48.363714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085336099999999996,"stat_sum":{"num_bytes":13086068,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":5,"num_read":569,"num_read_kb":10849,"num_write":109,"num_write_kb":7520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"45'127","reported_seq":711,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.016647+0000","last_change":"2024-09-12T05:20:11.763561+0000","last_active":"2024-09-12T05:20:42.016647+0000","last_peered":"2024-09-12T05:20:42.016647+0000","last_clean":"2024-09-12T05:20:42.016647+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:20:42.016647+0000","last_undegraded":"2024-09-12T05:20:42.016647+0000","last_fullsized":"2024-09-12T05:20:42.016647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.228047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041487850000000003,"stat_sum":{"num_bytes":19894146,"num_objects":20,"num_object_clones":3,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":7,"num_read":848,"num_read_kb":3117,"num_write":134,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"45'94","reported_seq":824,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.916266+0000","last_change":"2024-09-12T05:20:11.737024+0000","last_active":"2024-09-12T05:20:41.916266+0000","last_peered":"2024-09-12T05:20:41.916266+0000","last_clean":"2024-09-12T05:20:41.916266+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:20:41.916266+0000","last_undegraded":"2024-09-12T05:20:41.916266+0000","last_fullsized":"2024-09-12T05:20:41.916266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:23.474763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015614439999999999,"stat_sum":{"num_bytes":27989421,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":682,"num_read_kb":1947,"num_write":92,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"45'93","reported_seq":409,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.038194+0000","last_change":"2024-09-12T05:20:11.785121+0000","last_active":"2024-09-12T05:20:42.038194+0000","last_peered":"2024-09-12T05:20:42.038194+0000","last_clean":"2024-09-12T05:20:42.038194+0000","last_became_active":"2024-09-12T05:20:09.749618+0000","last_became_peered":"2024-09-12T05:20:09.749618+0000","last_unstale":"2024-09-12T05:20:42.038194+0000","last_undegraded":"2024-09-12T05:20:42.038194+0000","last_fullsized":"2024-09-12T05:20:42.038194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:12.100327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000920377,"stat_sum":{"num_bytes":10806715,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":265,"num_read_kb":8054,"num_write":176,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"45'797","reported_seq":1463,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.898945+0000","last_change":"2024-09-12T05:20:11.747630+0000","last_active":"2024-09-12T05:20:41.898945+0000","last_peered":"2024-09-12T05:20:41.898945+0000","last_clean":"2024-09-12T05:20:41.898945+0000","last_became_active":"2024-09-12T05:20:09.751770+0000","last_became_peered":"2024-09-12T05:20:09.751770+0000","last_unstale":"2024-09-12T05:20:41.898945+0000","last_undegraded":"2024-09-12T05:20:41.898945+0000","last_fullsized":"2024-09-12T05:20:41.898945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:29.793923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013351109999999999,"stat_sum":{"num_bytes":12206935,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":5,"num_read":4869,"num_read_kb":7804,"num_write":1300,"num_write_kb":4681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:40.043833+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:20:40.043833+0000","last_peered":"2024-09-12T05:20:40.043833+0000","last_clean":"2024-09-12T05:20:40.043833+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:20:40.043833+0000","last_undegraded":"2024-09-12T05:20:40.043833+0000","last_fullsized":"2024-09-12T05:20:40.043833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"45'225","reported_seq":509,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.973469+0000","last_change":"2024-09-12T05:20:11.760826+0000","last_active":"2024-09-12T05:20:41.973469+0000","last_peered":"2024-09-12T05:20:41.973469+0000","last_clean":"2024-09-12T05:20:41.973469+0000","last_became_active":"2024-09-12T05:20:09.741300+0000","last_became_peered":"2024-09-12T05:20:09.741300+0000","last_unstale":"2024-09-12T05:20:41.973469+0000","last_undegraded":"2024-09-12T05:20:41.973469+0000","last_fullsized":"2024-09-12T05:20:41.973469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:14.757239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015825539999999999,"stat_sum":{"num_bytes":2318385,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":833,"num_read_kb":969,"num_write":302,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:39.976638+0000","last_change":"2024-09-12T05:20:33.943660+0000","last_active":"2024-09-12T05:20:39.976638+0000","last_peered":"2024-09-12T05:20:39.976638+0000","last_clean":"2024-09-12T05:20:39.976638+0000","last_became_active":"2024-09-12T05:20:33.943030+0000","last_became_peered":"2024-09-12T05:20:33.943030+0000","last_unstale":"2024-09-12T05:20:39.976638+0000","last_undegraded":"2024-09-12T05:20:39.976638+0000","last_fullsized":"2024-09-12T05:20:39.976638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:11.076201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"45'128","reported_seq":1003,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.828836+0000","last_change":"2024-09-12T05:20:11.787746+0000","last_active":"2024-09-12T05:20:41.828836+0000","last_peered":"2024-09-12T05:20:41.828836+0000","last_clean":"2024-09-12T05:20:41.828836+0000","last_became_active":"2024-09-12T05:20:09.747558+0000","last_became_peered":"2024-09-12T05:20:09.747558+0000","last_unstale":"2024-09-12T05:20:41.828836+0000","last_undegraded":"2024-09-12T05:20:41.828836+0000","last_fullsized":"2024-09-12T05:20:41.828836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:59.222279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001514325,"stat_sum":{"num_bytes":26157936,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":4,"num_read":857,"num_read_kb":36777,"num_write":154,"num_write_kb":18689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:39.978623+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:20:39.978623+0000","last_peered":"2024-09-12T05:20:39.978623+0000","last_clean":"2024-09-12T05:20:39.978623+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:20:39.978623+0000","last_undegraded":"2024-09-12T05:20:39.978623+0000","last_fullsized":"2024-09-12T05:20:39.978623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"45'117","reported_seq":215,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.004651+0000","last_change":"2024-09-12T05:20:11.742399+0000","last_active":"2024-09-12T05:20:42.004651+0000","last_peered":"2024-09-12T05:20:42.004651+0000","last_clean":"2024-09-12T05:20:42.004651+0000","last_became_active":"2024-09-12T05:20:09.731594+0000","last_became_peered":"2024-09-12T05:20:09.731594+0000","last_unstale":"2024-09-12T05:20:42.004651+0000","last_undegraded":"2024-09-12T05:20:42.004651+0000","last_fullsized":"2024-09-12T05:20:42.004651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:42.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109662,"stat_sum":{"num_bytes":2533374,"num_objects":18,"num_object_clones":3,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":3,"num_read":292,"num_read_kb":2394,"num_write":148,"num_write_kb":1395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:39.976553+0000","last_change":"2024-09-12T05:20:01.939452+0000","last_active":"2024-09-12T05:20:39.976553+0000","last_peered":"2024-09-12T05:20:39.976553+0000","last_clean":"2024-09-12T05:20:39.976553+0000","last_became_active":"2024-09-12T05:19:59.911858+0000","last_became_peered":"2024-09-12T05:19:59.911858+0000","last_unstale":"2024-09-12T05:20:39.976553+0000","last_undegraded":"2024-09-12T05:20:39.976553+0000","last_fullsized":"2024-09-12T05:20:39.976553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:52.544225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"45'97","reported_seq":546,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.915576+0000","last_change":"2024-09-12T05:20:11.737386+0000","last_active":"2024-09-12T05:20:41.915576+0000","last_peered":"2024-09-12T05:20:41.915576+0000","last_clean":"2024-09-12T05:20:41.915576+0000","last_became_active":"2024-09-12T05:20:09.734285+0000","last_became_peered":"2024-09-12T05:20:09.734285+0000","last_unstale":"2024-09-12T05:20:41.915576+0000","last_undegraded":"2024-09-12T05:20:41.915576+0000","last_fullsized":"2024-09-12T05:20:41.915576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:38.039358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093432200000000002,"stat_sum":{"num_bytes":13537290,"num_objects":15,"num_object_clones":2,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":525,"num_read_kb":7997,"num_write":119,"num_write_kb":3722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"45'155","reported_seq":1607,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.000594+0000","last_change":"2024-09-12T05:20:11.747323+0000","last_active":"2024-09-12T05:20:42.000594+0000","last_peered":"2024-09-12T05:20:42.000594+0000","last_clean":"2024-09-12T05:20:42.000594+0000","last_became_active":"2024-09-12T05:20:09.749854+0000","last_became_peered":"2024-09-12T05:20:09.749854+0000","last_unstale":"2024-09-12T05:20:42.000594+0000","last_undegraded":"2024-09-12T05:20:42.000594+0000","last_fullsized":"2024-09-12T05:20:42.000594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:28:06.028448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011274589999999999,"stat_sum":{"num_bytes":10694514,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":8,"num_read":1431,"num_read_kb":6510,"num_write":160,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:39.998752+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:20:39.998752+0000","last_peered":"2024-09-12T05:20:39.998752+0000","last_clean":"2024-09-12T05:20:39.998752+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:20:39.998752+0000","last_undegraded":"2024-09-12T05:20:39.998752+0000","last_fullsized":"2024-09-12T05:20:39.998752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"45'230","reported_seq":856,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.764986+0000","last_change":"2024-09-12T05:20:11.741593+0000","last_active":"2024-09-12T05:20:41.764986+0000","last_peered":"2024-09-12T05:20:41.764986+0000","last_clean":"2024-09-12T05:20:41.764986+0000","last_became_active":"2024-09-12T05:20:09.732988+0000","last_became_peered":"2024-09-12T05:20:09.732988+0000","last_unstale":"2024-09-12T05:20:41.764986+0000","last_undegraded":"2024-09-12T05:20:41.764986+0000","last_fullsized":"2024-09-12T05:20:41.764986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:06.129947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011707810000000001,"stat_sum":{"num_bytes":20991518,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":6,"num_read":1434,"num_read_kb":2447,"num_write":364,"num_write_kb":881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:39.972464+0000","last_change":"2024-09-12T05:20:01.936885+0000","last_active":"2024-09-12T05:20:39.972464+0000","last_peered":"2024-09-12T05:20:39.972464+0000","last_clean":"2024-09-12T05:20:39.972464+0000","last_became_active":"2024-09-12T05:20:00.049870+0000","last_became_peered":"2024-09-12T05:20:00.049870+0000","last_unstale":"2024-09-12T05:20:39.972464+0000","last_undegraded":"2024-09-12T05:20:39.972464+0000","last_fullsized":"2024-09-12T05:20:39.972464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011022810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"45'232","reported_seq":937,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.900120+0000","last_change":"2024-09-12T05:20:11.760952+0000","last_active":"2024-09-12T05:20:41.900120+0000","last_peered":"2024-09-12T05:20:41.900120+0000","last_clean":"2024-09-12T05:20:41.900120+0000","last_became_active":"2024-09-12T05:20:09.757484+0000","last_became_peered":"2024-09-12T05:20:09.757484+0000","last_unstale":"2024-09-12T05:20:41.900120+0000","last_undegraded":"2024-09-12T05:20:41.900120+0000","last_fullsized":"2024-09-12T05:20:41.900120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:29.295805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002046291,"stat_sum":{"num_bytes":4548442,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":1398,"num_read_kb":2520,"num_write":324,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:39.977531+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:20:39.977531+0000","last_peered":"2024-09-12T05:20:39.977531+0000","last_clean":"2024-09-12T05:20:39.977531+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:20:39.977531+0000","last_undegraded":"2024-09-12T05:20:39.977531+0000","last_fullsized":"2024-09-12T05:20:39.977531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"45'110","reported_seq":1405,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.895021+0000","last_change":"2024-09-12T05:20:11.787268+0000","last_active":"2024-09-12T05:20:41.895021+0000","last_peered":"2024-09-12T05:20:41.895021+0000","last_clean":"2024-09-12T05:20:41.895021+0000","last_became_active":"2024-09-12T05:20:09.747825+0000","last_became_peered":"2024-09-12T05:20:09.747825+0000","last_unstale":"2024-09-12T05:20:41.895021+0000","last_undegraded":"2024-09-12T05:20:41.895021+0000","last_fullsized":"2024-09-12T05:20:41.895021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:01.916354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010361979999999999,"stat_sum":{"num_bytes":65201600,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":3,"num_read":1256,"num_read_kb":27912,"num_write":120,"num_write_kb":13388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":67,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:39.998805+0000","last_change":"2024-09-12T05:20:01.936472+0000","last_active":"2024-09-12T05:20:39.998805+0000","last_peered":"2024-09-12T05:20:39.998805+0000","last_clean":"2024-09-12T05:20:39.998805+0000","last_became_active":"2024-09-12T05:19:59.915991+0000","last_became_peered":"2024-09-12T05:19:59.915991+0000","last_unstale":"2024-09-12T05:20:39.998805+0000","last_undegraded":"2024-09-12T05:20:39.998805+0000","last_fullsized":"2024-09-12T05:20:39.998805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:23.065491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:39.977563+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:20:39.977563+0000","last_peered":"2024-09-12T05:20:39.977563+0000","last_clean":"2024-09-12T05:20:39.977563+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:20:39.977563+0000","last_undegraded":"2024-09-12T05:20:39.977563+0000","last_fullsized":"2024-09-12T05:20:39.977563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"45'261","reported_seq":1781,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.904431+0000","last_change":"2024-09-12T05:20:11.786966+0000","last_active":"2024-09-12T05:20:41.904431+0000","last_peered":"2024-09-12T05:20:41.904431+0000","last_clean":"2024-09-12T05:20:41.904431+0000","last_became_active":"2024-09-12T05:20:09.735109+0000","last_became_peered":"2024-09-12T05:20:09.735109+0000","last_unstale":"2024-09-12T05:20:41.904431+0000","last_undegraded":"2024-09-12T05:20:41.904431+0000","last_fullsized":"2024-09-12T05:20:41.904431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:09.951297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088249400000000005,"stat_sum":{"num_bytes":4973525,"num_objects":23,"num_object_clones":5,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":3136,"num_read_kb":7191,"num_write":257,"num_write_kb":3841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"45'141","reported_seq":1123,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.032662+0000","last_change":"2024-09-12T05:20:11.746609+0000","last_active":"2024-09-12T05:20:42.032662+0000","last_peered":"2024-09-12T05:20:42.032662+0000","last_clean":"2024-09-12T05:20:42.032662+0000","last_became_active":"2024-09-12T05:20:09.753860+0000","last_became_peered":"2024-09-12T05:20:09.753860+0000","last_unstale":"2024-09-12T05:20:42.032662+0000","last_undegraded":"2024-09-12T05:20:42.032662+0000","last_fullsized":"2024-09-12T05:20:42.032662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:12.660060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083728800000000005,"stat_sum":{"num_bytes":2270196,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":1422,"num_read_kb":817,"num_write":143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"45'113","reported_seq":522,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.998705+0000","last_change":"2024-09-12T05:20:34.094906+0000","last_active":"2024-09-12T05:20:41.998705+0000","last_peered":"2024-09-12T05:20:41.998705+0000","last_clean":"2024-09-12T05:20:41.998705+0000","last_became_active":"2024-09-12T05:20:33.942064+0000","last_became_peered":"2024-09-12T05:20:33.942064+0000","last_unstale":"2024-09-12T05:20:41.998705+0000","last_undegraded":"2024-09-12T05:20:41.998705+0000","last_fullsized":"2024-09-12T05:20:41.998705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:08.281845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001140198,"stat_sum":{"num_bytes":10634406,"num_objects":15,"num_object_clones":2,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":3,"num_read":1154,"num_read_kb":3968,"num_write":109,"num_write_kb":2029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1146302,"num_keys_recovered":17,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"45'108","reported_seq":1176,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.004406+0000","last_change":"2024-09-12T05:20:11.787356+0000","last_active":"2024-09-12T05:20:42.004406+0000","last_peered":"2024-09-12T05:20:42.004406+0000","last_clean":"2024-09-12T05:20:42.004406+0000","last_became_active":"2024-09-12T05:20:09.741117+0000","last_became_peered":"2024-09-12T05:20:09.741117+0000","last_unstale":"2024-09-12T05:20:42.004406+0000","last_undegraded":"2024-09-12T05:20:42.004406+0000","last_fullsized":"2024-09-12T05:20:42.004406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:58.033708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011192330000000001,"stat_sum":{"num_bytes":12750095,"num_objects":21,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":1034,"num_read_kb":8494,"num_write":105,"num_write_kb":4770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"45'668","reported_seq":1009,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.042470+0000","last_change":"2024-09-12T05:20:11.736226+0000","last_active":"2024-09-12T05:20:42.042470+0000","last_peered":"2024-09-12T05:20:42.042470+0000","last_clean":"2024-09-12T05:20:42.042470+0000","last_became_active":"2024-09-12T05:20:09.734742+0000","last_became_peered":"2024-09-12T05:20:09.734742+0000","last_unstale":"2024-09-12T05:20:42.042470+0000","last_undegraded":"2024-09-12T05:20:42.042470+0000","last_fullsized":"2024-09-12T05:20:42.042470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:39.017033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085690600000000005,"stat_sum":{"num_bytes":3260503,"num_objects":18,"num_object_clones":3,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":6,"num_read":3412,"num_read_kb":4767,"num_write":1168,"num_write_kb":2237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"45'154","reported_seq":744,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.069174+0000","last_change":"2024-09-12T05:20:11.785456+0000","last_active":"2024-09-12T05:20:42.069174+0000","last_peered":"2024-09-12T05:20:42.069174+0000","last_clean":"2024-09-12T05:20:42.069174+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:20:42.069174+0000","last_undegraded":"2024-09-12T05:20:42.069174+0000","last_fullsized":"2024-09-12T05:20:42.069174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:07.379521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011734079999999999,"stat_sum":{"num_bytes":11473101,"num_objects":24,"num_object_clones":3,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":11,"num_read":1140,"num_read_kb":4249,"num_write":140,"num_write_kb":2119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"45'93","reported_seq":341,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.969777+0000","last_change":"2024-09-12T05:20:11.785295+0000","last_active":"2024-09-12T05:20:41.969777+0000","last_peered":"2024-09-12T05:20:41.969777+0000","last_clean":"2024-09-12T05:20:41.969777+0000","last_became_active":"2024-09-12T05:20:09.756211+0000","last_became_peered":"2024-09-12T05:20:09.756211+0000","last_unstale":"2024-09-12T05:20:41.969777+0000","last_undegraded":"2024-09-12T05:20:41.969777+0000","last_fullsized":"2024-09-12T05:20:41.969777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:21.788631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010563930000000001,"stat_sum":{"num_bytes":4783062,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":262,"num_read_kb":2307,"num_write":108,"num_write_kb":3394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"45'91","reported_seq":1238,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.984926+0000","last_change":"2024-09-12T05:20:11.785653+0000","last_active":"2024-09-12T05:20:41.984926+0000","last_peered":"2024-09-12T05:20:41.984926+0000","last_clean":"2024-09-12T05:20:41.984926+0000","last_became_active":"2024-09-12T05:20:09.756342+0000","last_became_peered":"2024-09-12T05:20:09.756342+0000","last_unstale":"2024-09-12T05:20:41.984926+0000","last_undegraded":"2024-09-12T05:20:41.984926+0000","last_fullsized":"2024-09-12T05:20:41.984926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:47.187581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072867899999999998,"stat_sum":{"num_bytes":3627726,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":3,"num_read":1104,"num_read_kb":3048,"num_write":86,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"45'88","reported_seq":926,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.909578+0000","last_change":"2024-09-12T05:20:34.018441+0000","last_active":"2024-09-12T05:20:41.909578+0000","last_peered":"2024-09-12T05:20:41.909578+0000","last_clean":"2024-09-12T05:20:41.909578+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:20:41.909578+0000","last_undegraded":"2024-09-12T05:20:41.909578+0000","last_fullsized":"2024-09-12T05:20:41.909578+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:14.139729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387196,"stat_sum":{"num_bytes":9043320,"num_objects":17,"num_object_clones":2,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":4,"num_read":1057,"num_read_kb":5915,"num_write":87,"num_write_kb":1915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"45'118","reported_seq":676,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.902460+0000","last_change":"2024-09-12T05:20:11.784843+0000","last_active":"2024-09-12T05:20:41.902460+0000","last_peered":"2024-09-12T05:20:41.902460+0000","last_clean":"2024-09-12T05:20:41.902460+0000","last_became_active":"2024-09-12T05:20:09.758738+0000","last_became_peered":"2024-09-12T05:20:09.758738+0000","last_unstale":"2024-09-12T05:20:41.902460+0000","last_undegraded":"2024-09-12T05:20:41.902460+0000","last_fullsized":"2024-09-12T05:20:41.902460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:37.332259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074458300000000005,"stat_sum":{"num_bytes":33411595,"num_objects":19,"num_object_clones":2,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":4,"num_read":531,"num_read_kb":31641,"num_write":140,"num_write_kb":15862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"45'76","reported_seq":590,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:41.882782+0000","last_change":"2024-09-12T05:20:11.760226+0000","last_active":"2024-09-12T05:20:41.882782+0000","last_peered":"2024-09-12T05:20:41.882782+0000","last_clean":"2024-09-12T05:20:41.882782+0000","last_became_active":"2024-09-12T05:20:09.743276+0000","last_became_peered":"2024-09-12T05:20:09.743276+0000","last_unstale":"2024-09-12T05:20:41.882782+0000","last_undegraded":"2024-09-12T05:20:41.882782+0000","last_fullsized":"2024-09-12T05:20:41.882782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:03.723071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347827,"stat_sum":{"num_bytes":10107547,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":872,"num_read_kb":4999,"num_write":72,"num_write_kb":3393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"45'110","reported_seq":823,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-12T05:20:42.025348+0000","last_change":"2024-09-12T05:20:11.784970+0000","last_active":"2024-09-12T05:20:42.025348+0000","last_peered":"2024-09-12T05:20:42.025348+0000","last_clean":"2024-09-12T05:20:42.025348+0000","last_became_active":"2024-09-12T05:20:09.759997+0000","last_became_peered":"2024-09-12T05:20:09.759997+0000","last_unstale":"2024-09-12T05:20:42.025348+0000","last_undegraded":"2024-09-12T05:20:42.025348+0000","last_fullsized":"2024-09-12T05:20:42.025348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:33.591965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076674600000000001,"stat_sum":{"num_bytes":9479328,"num_objects":26,"num_object_clones":5,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":8,"num_read":677,"num_read_kb":4787,"num_write":101,"num_write_kb":1491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":406525361,"num_objects":584,"num_object_clones":98,"num_object_copies":1168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":584,"num_whiteouts":157,"num_read":38553,"num_read_kb":237685,"num_write":7075,"num_write_kb":126752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":6669856,"num_keys_recovered":17,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":207876096,"data_stored":279209827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5485,"ondisk_log_size":5485,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84100,"kb_used_data":48756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287740,"statfs":{"total":96636764160,"available":96550645760,"internally_reserved":0,"allocated":49926144,"data_stored":59934364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38416,"kb_used_data":7204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333424,"statfs":{"total":96636764160,"available":96597426176,"internally_reserved":0,"allocated":7376896,"data_stored":10807701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56036,"kb_used_data":24852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94315804,"statfs":{"total":96636764160,"available":96579383296,"internally_reserved":0,"allocated":25448448,"data_stored":32428984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67136,"kb_used_data":31744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94304704,"statfs":{"total":96636764160,"available":96568016896,"internally_reserved":0,"allocated":32505856,"data_stored":42293876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[48,38,65,43,37,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95052,"kb_used_data":59700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94276788,"statfs":{"total":96636764160,"available":96539430912,"internally_reserved":0,"allocated":61132800,"data_stored":80970571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1839104,"data_stored":2524664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37308,"kb_used_data":6120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334532,"statfs":{"total":96636764160,"available":96598560768,"internally_reserved":0,"allocated":6266880,"data_stored":7352888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62952,"kb_used_data":27608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94308888,"statfs":{"total":96636764160,"available":96572301312,"internally_reserved":0,"allocated":28270592,"data_stored":45625525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27140096,"data_stored":44809372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5767168,"data_stored":7137934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1404928,"data_stored":2340898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":60641280,"data_stored":80762975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32161792,"data_stored":42161583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25075712,"data_stored":32278714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6868992,"data_stored":10594239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48816128,"data_stored":59124112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:20:44.034 INFO:tasks.thrashosds.thrasher:Setting 3.15 to [3, 1, 6, 2] 2024-09-12T05:20:44.034 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.15', '3', '1', '6', '2'] 2024-09-12T05:20:44.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.15 3 1 6 2 2024-09-12T05:20:44.042 INFO:teuthology.orchestra.run.smithi059.stdout:1890 trunc from 0xec0bdfb to 0x8a56a09 2024-09-12T05:20:44.066 INFO:teuthology.orchestra.run.smithi059.stdout:1893 trunc from 0x8a56a09 to 0xa3495c2 2024-09-12T05:20:44.082 INFO:teuthology.orchestra.run.smithi059.stdout:1894 trunc from 0xa3495c2 to 0x4dadc56 2024-09-12T05:20:44.110 INFO:teuthology.orchestra.run.smithi059.stdout:1895 writesame 0x7f47a66 thru 0x7f526e5 data_size 0x30(0xac80 bytes) 2024-09-12T05:20:44.110 INFO:teuthology.orchestra.run.smithi059.stdout:1896 writesame 0x3c876f3 thru 0x3c88f52 data_size 0x1a(0x1860 bytes) 2024-09-12T05:20:44.124 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:44.125+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:44.141 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:44.141 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:44.151 INFO:teuthology.orchestra.run.smithi059.stdout:1897 writesame 0xde6240e thru 0xde6edaf data_size 0x15(0xc9a2 bytes) 2024-09-12T05:20:44.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:44.164 INFO:teuthology.orchestra.run.smithi059.stdout:1898 writesame 0xea0248a thru 0xea1224e data_size 0xf(0xfdc5 bytes) 2024-09-12T05:20:44.164 INFO:teuthology.orchestra.run.smithi059.stdout:1899 read 0xcdacfe1 thru 0xcdb205f (0x507f bytes) 2024-09-12T05:20:44.164 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:44.164 INFO:teuthology.orchestra.run.smithi059.stdout:1901 writesame 0xdf28131 thru 0xdf34086 data_size 0x13(0xbf56 bytes) 2024-09-12T05:20:44.209 INFO:teuthology.orchestra.run.smithi059.stdout:1903 writesame 0xa3d4bb thru 0xa4caf7 data_size 0xd(0xf63d bytes) 2024-09-12T05:20:44.219 INFO:teuthology.orchestra.run.smithi059.stdout:1904 write 0x92e668c thru 0x92ec6ef (0x6064 bytes) 2024-09-12T05:20:44.224 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:44.225+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:44.259 INFO:teuthology.orchestra.run.smithi059.stdout:1905 writesame 0x142cbfb thru 0x14385a0 data_size 0x6(0xb9a6 bytes) 2024-09-12T05:20:44.269 INFO:teuthology.orchestra.run.smithi059.stdout:1907 punch from 0x86f9dc8 to 0x8700e9a, (0x70d2 bytes) 2024-09-12T05:20:44.269 INFO:teuthology.orchestra.run.smithi059.stdout:1909 read 0xababa7e thru 0xabaf6e0 (0x3c63 bytes) 2024-09-12T05:20:44.269 INFO:teuthology.orchestra.run.smithi059.stdout:1910 clone 13 order 18 su 65536 sc 5 2024-09-12T05:20:44.292 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:44.293 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:44.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:44.348 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:44.349+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:44.426 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:44.425+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:44.471 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:44.472 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:44.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:44.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:44.528 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:44.529+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:44.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:44.625+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:44.649 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:44.649 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:44.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:44.672 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:44.672 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:44.691 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:44.691 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:44.708 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:44.709 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:44.725 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:44.725 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:44.729 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:44.729+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:44.746 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:44.767 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:44.768 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:44.790 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:44.793 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3779 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.826609846, 2024-09-12T05:20:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015428234000000001, 2024-09-12T05:20:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3779 2024-09-12T05:20:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969068+0000", 2024-09-12T05:20:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969069+0000", 2024-09-12T05:20:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969078+0000", 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2229999999999996e-06 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969089+0000", 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0536999999999999e-05 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969097+0000", 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7780000000000007e-06 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984386+0000", 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01528902 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984436+0000", 2024-09-12T05:20:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0577e-05 2024-09-12T05:20:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984497+0000", 2024-09-12T05:20:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0386000000000001e-05 2024-09-12T05:20:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3780 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.826565347999999, 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015612325, 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3780 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969113+0000", 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969114+0000", 2024-09-12T05:20:44.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8899999999999999e-07 2024-09-12T05:20:44.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969117+0000", 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2090000000000001e-06 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969127+0000", 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0315e-05 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969135+0000", 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599999999999998e-06 2024-09-12T05:20:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984543+0000", 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015407403 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984617+0000", 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4270999999999994e-05 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.984725+0000", 2024-09-12T05:20:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108278 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3781 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.826531409000001, 2024-09-12T05:20:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792308999999998, 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3781 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969147+0000", 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969148+0000", 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8700000000000005e-07 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969151+0000", 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0120000000000001e-06 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969161+0000", 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0181e-05 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969179+0000", 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8057999999999999e-05 2024-09-12T05:20:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985705+0000", 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016525623 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985800+0000", 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5298999999999997e-05 2024-09-12T05:20:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985939+0000", 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013934900000000001 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3782 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5046272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.826486803000002, 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016995278999999999, 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3782 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969192+0000", 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1399999999999996e-07 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969196+0000", 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4350000000000001e-06 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969206+0000", 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0593e-05 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969214+0000", 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6380000000000004e-06 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985979+0000", 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016764658000000002 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986091+0000", 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112662 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986187+0000", 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5579000000000001e-05 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3783 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.826453073, 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017209842, 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3783 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969225+0000", 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969226+0000", 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969229+0000", 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.585e-06 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969265+0000", 2024-09-12T05:20:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5884999999999999e-05 2024-09-12T05:20:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969274+0000", 2024-09-12T05:20:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6070000000000008e-06 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986237+0000", 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016962755999999999 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986323+0000", 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5902000000000005e-05 2024-09-12T05:20:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986435+0000", 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011246700000000001 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3866 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.8261945, 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017196439000000001, 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3866 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969484+0000", 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0699999999999997e-07 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969488+0000", 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1e-06 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969498+0000", 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0468e-05 2024-09-12T05:20:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969505+0000", 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.452e-06 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986467+0000", 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016961092000000001 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986563+0000", 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6010999999999999e-05 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986680+0000", 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011770899999999999 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3867 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.82616028, 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017352149000000001, 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3867 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969518+0000", 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969519+0000", 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6700000000000003e-07 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969522+0000", 2024-09-12T05:20:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.123e-06 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969532+0000", 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0112000000000001e-05 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969540+0000", 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6979999999999998e-06 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986711+0000", 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017171285000000001 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986781+0000", 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0072000000000003e-05 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986870+0000", 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3868 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.826126596999998, 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017560494999999999, 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3868 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969552+0000", 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969553+0000", 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4200000000000005e-07 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969556+0000", 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9730000000000002e-06 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969566+0000", 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0387999999999999e-05 2024-09-12T05:20:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969585+0000", 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8604e-05 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.986945+0000", 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017360197000000001 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987016+0000", 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1130000000000005e-05 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987112+0000", 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6360999999999994e-05 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3869 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.826080618999999, 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017730589000000001, 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3869 2024-09-12T05:20:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969598+0000", 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969608+0000", 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4490000000000005e-06 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969619+0000", 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0781999999999999e-05 2024-09-12T05:20:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969636+0000", 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7218e-05 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987143+0000", 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017506799 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987247+0000", 2024-09-12T05:20:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010446900000000001 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987328+0000", 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1100999999999995e-05 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3870 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.826029817999999, 2024-09-12T05:20:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017855591000000001, 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3870 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969649+0000", 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5499999999999998e-07 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969653+0000", 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5499999999999999e-06 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969663+0000", 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.005e-05 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969670+0000", 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.43e-06 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987362+0000", 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017691521000000002 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987426+0000", 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4204999999999999e-05 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987504+0000", 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.818e-05 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3871 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825998344999999, 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018082318, 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3871 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969680+0000", 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969681+0000", 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969683+0000", 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6350000000000002e-06 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969693+0000", 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4169999999999998e-06 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969700+0000", 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1350000000000003e-06 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987538+0000", 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017838166999999999 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987609+0000", 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1316999999999995e-05 2024-09-12T05:20:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987762+0000", 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015310200000000001 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3872 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7995392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825968806999999, 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018277057999999999, 2024-09-12T05:20:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3872 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969710+0000", 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000002e-07 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969713+0000", 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5830000000000001e-06 2024-09-12T05:20:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969722+0000", 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2240000000000001e-06 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969752+0000", 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0142e-05 2024-09-12T05:20:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987828+0000", 2024-09-12T05:20:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018076297000000002 2024-09-12T05:20:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987901+0000", 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2767000000000003e-05 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.987987+0000", 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5474000000000002e-05 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3883 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 6291456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825851333999999, 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018349118000000001, 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3883 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969827+0000", 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969828+0000", 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7800000000000001e-07 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969839+0000", 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1779e-05 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969851+0000", 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1573000000000001e-05 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969859+0000", 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8320000000000006e-06 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988018+0000", 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018158819999999999 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988085+0000", 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7366000000000005e-05 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988176+0000", 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1169999999999996e-05 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3884 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7012352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825807123000001, 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018487955, 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3884 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969871+0000", 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969872+0000", 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2500000000000005e-07 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969875+0000", 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3950000000000001e-06 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969885+0000", 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9399999999999997e-06 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969893+0000", 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4930000000000001e-06 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988206+0000", 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018312910000000002 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988276+0000", 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0198999999999997e-05 2024-09-12T05:20:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988359+0000", 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3293000000000004e-05 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3885 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.82577367, 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019004607999999999, 2024-09-12T05:20:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3885 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969905+0000", 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7400000000000003e-07 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969908+0000", 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0529999999999998e-06 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969918+0000", 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.009e-05 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969939+0000", 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0797000000000001e-05 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988391+0000", 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018452177 2024-09-12T05:20:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988462+0000", 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0154999999999995e-05 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988909+0000", 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00044776199999999999 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3886 3.19 3:9aa39664:::rbd_data.1118feb697f7.0000000000000006:5 [sparse-read 7864320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825725553000002, 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019129604000000001, 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3886 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969953+0000", 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969954+0000", 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8800000000000001e-07 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969958+0000", 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.89e-06 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969971+0000", 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.376e-05 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969979+0000", 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0420000000000003e-06 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.988959+0000", 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018980011000000001 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989027+0000", 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7439000000000003e-05 2024-09-12T05:20:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989082+0000", 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5574e-05 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3887 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825685984, 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019321270000000001, 2024-09-12T05:20:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3887 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969992+0000", 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969993+0000", 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1699999999999998e-07 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.969996+0000", 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1870000000000001e-06 2024-09-12T05:20:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970007+0000", 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0676000000000001e-05 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970016+0000", 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5019999999999998e-06 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989125+0000", 2024-09-12T05:20:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019108750000000001 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989201+0000", 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5852999999999994e-05 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989314+0000", 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112685 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3888 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825637936, 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019523841, 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3888 2024-09-12T05:20:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970040+0000", 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970041+0000", 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-07 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970045+0000", 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5719999999999999e-06 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970056+0000", 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1107999999999999e-05 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970064+0000", 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0239999999999997e-06 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989388+0000", 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019324108 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989469+0000", 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0958000000000007e-05 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989564+0000", 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5422999999999998e-05 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3889 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825603450999999, 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019700655000000001, 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3889 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970075+0000", 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970076+0000", 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6300000000000004e-07 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970087+0000", 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1449e-05 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970098+0000", 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.042e-05 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970106+0000", 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9209999999999992e-06 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989608+0000", 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019502562000000001 2024-09-12T05:20:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989680+0000", 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1762999999999997e-05 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989776+0000", 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5676999999999999e-05 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:3890 3.19 3:9e967161:::rbd_data.1118feb697f7.0000000000000007:5 [sparse-read 7929856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.825560251999999, 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019853272000000002, 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3890 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970118+0000", 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970119+0000", 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2900000000000003e-07 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970122+0000", 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7420000000000002e-06 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970131+0000", 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7909999999999999e-06 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.970138+0000", 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8090000000000004e-06 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989808+0000", 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019669641000000002 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989880+0000", 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2606000000000002e-05 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:44.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.989971+0000", 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0953999999999997e-05 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:44.892 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:44.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:44.894 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:44.895 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:44.895 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:44.893+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:set 3.15 pg_upmap_items mapping to [3->1,6->2] 2024-09-12T05:20:44.994 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:44.993+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:45.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:20:45.084 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:45.084 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:45.084 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:45.084 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:45.094 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:45.093+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:45.099 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone12 from 0xea1224f (overlap 0x2118995) to 0x172ad1b 2024-09-12T05:20:45.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:45.195 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:45.193+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:45.265 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:45.266 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:45.266 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:45.266 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:45.266 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:45.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:45.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:45.293+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:45.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:45.397+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.474822428, 2024-09-12T05:20:45.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:45.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:20:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8553 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'44, mlcod=37'40)", 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.613326898, 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048787479999999996, 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.459 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840757+0000", 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840761+0000", 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0790000000000002e-06 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840771+0000", 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0151e-05 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840776+0000", 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9389999999999996e-06 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840826+0000", 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9521999999999998e-05 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840845+0000", 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9360000000000001e-05 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845590+0000", 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004744687 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845635+0000", 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5423999999999997e-05 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:20:45.463 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.563190111000001, 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:20:45.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9013 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'63, mlcod=37'59)", 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.484613681999999, 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051699299999999997, 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.468 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6400000000000002e-07 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969476+0000", 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0440000000000001e-06 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969490+0000", 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3328e-05 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969497+0000", 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2559999999999996e-06 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969563+0000", 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5879999999999999e-05 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969589+0000", 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5972000000000001e-05 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974583+0000", 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049945379999999998 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974640+0000", 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6248000000000001e-05 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.472 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9885 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'109, mlcod=37'106)", 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.181248453999999, 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051369570000000002, 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272840+0000", 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1559999999999997e-06 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272848+0000", 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-06 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272853+0000", 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4569999999999998e-06 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272896+0000", 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3441e-05 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272911+0000", 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4484000000000001e-05 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277923+0000", 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050118480000000002 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277972+0000", 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9174e-05 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.180489627, 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:20:45.477 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:20:45.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10139 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'147, mlcod=37'142)", 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.012381721000001, 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051775290000000002, 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441706+0000", 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.985e-06 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441716+0000", 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3810000000000005e-06 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441722+0000", 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441772+0000", 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9465999999999997e-05 2024-09-12T05:20:45.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441792+0000", 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0560999999999998e-05 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446825+0000", 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050325259999999998 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446879+0000", 2024-09-12T05:20:45.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999999e-05 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.94644598, 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:20:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:20:45.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:20:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10212 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'166, mlcod=37'162)", 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.918547002, 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004931403, 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535537+0000", 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5799999999999999e-07 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535542+0000", 2024-09-12T05:20:45.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0159999999999999e-06 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535554+0000", 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2199e-05 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535564+0000", 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7070000000000004e-06 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535606+0000", 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2391999999999997e-05 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535627+0000", 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0503e-05 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540427+0000", 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047999770000000004 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540468+0000", 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0951000000000001e-05 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.916321649, 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:20:45.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:20:45.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.354233868000001, 2024-09-12T05:20:45.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:20:45.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:20:45.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.503 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.35227965, 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11437 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'65, mlcod=38'62)", 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.349398537999999, 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049658940000000002, 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104691+0000", 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0979999999999999e-06 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104702+0000", 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0611999999999999e-05 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104711+0000", 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2024-09-12T05:20:45.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107402+0000", 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026907889999999999 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107423+0000", 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1035000000000001e-05 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109616+0000", 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021936870000000002 2024-09-12T05:20:45.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109651+0000", 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4434999999999998e-05 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.4109709160000001, 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:20:45.512 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3943743229999992, 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:20:45.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:20:45.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20160 3.0 e44/23 3:00225d41:::rbd_data.1118d7e09baf.0000000000000056:head v 44'214, mlcod=43'212)", 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.2258605039999999, 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049886230000000002, 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228224+0000", 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0699999999999999e-06 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228232+0000", 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228254+0000", 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2507e-05 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228264+0000", 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6900000000000004e-06 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228350+0000", 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5877999999999993e-05 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228378+0000", 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7976000000000001e-05 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.233084+0000", 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047061580000000002 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.233211+0000", 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012753499999999999 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:20:45.525 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.2240348829999999, 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.529 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34558063100000003, 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:20:45.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:20:45.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.345535537, 2024-09-12T05:20:45.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:20:45.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.33697397600000001, 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:20:45.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:45.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:45.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:45.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:20:45.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:20:45.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.543 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:45.543 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:45.543 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:45.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:45.545 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:45.545+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:45.661 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:45.645+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:45.675 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:45.675 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:45.675 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:45.675 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:45.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:45.747 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:45.745+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:45.848 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:45.849+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:45.860 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:45.860 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:45.860 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:45.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:45.949 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:45.949+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:46.004 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:20:46.050 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:46.049+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:46.059 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23601 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1823225580000001, 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046132175999999997, 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.060 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23601 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:46.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877967+0000", 2024-09-12T05:20:46.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9299999999999996e-07 2024-09-12T05:20:46.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877970+0000", 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6600000000000001e-06 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877987+0000", 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7033000000000001e-05 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877997+0000", 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8970000000000003e-06 2024-09-12T05:20:46.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924083+0000", 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046086037000000003 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924098+0000", 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4656e-05 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23602 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1822396560000001, 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046134982999999997, 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23602 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878050+0000", 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0299999999999998e-07 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878060+0000", 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0008e-05 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878069+0000", 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0699999999999996e-06 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878076+0000", 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8990000000000004e-06 2024-09-12T05:20:46.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924152+0000", 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046076735000000001 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924184+0000", 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1467999999999998e-05 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23604 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1821712660000001, 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046158181, 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23604 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878118+0000", 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7299999999999996e-07 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878120+0000", 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.694e-06 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878128+0000", 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5320000000000001e-06 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878134+0000", 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.083e-06 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924258+0000", 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046123551999999998 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924275+0000", 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7747000000000001e-05 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.072 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23605 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1821425850000002, 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046181315000000001, 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23605 2024-09-12T05:20:46.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878147+0000", 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5000000000000001e-07 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878149+0000", 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5150000000000001e-06 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878168+0000", 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8505e-05 2024-09-12T05:20:46.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878174+0000", 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5250000000000002e-06 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924319+0000", 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046145149000000003 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924327+0000", 2024-09-12T05:20:46.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7710000000000006e-06 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23606 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1821045290000001, 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046204501000000002, 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.077 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23606 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878187+0000", 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.667e-06 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878195+0000", 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7319999999999998e-06 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878201+0000", 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.489e-06 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924374+0000", 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046172264999999997 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924388+0000", 2024-09-12T05:20:46.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4762e-05 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23607 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1820427200000001, 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046215282000000003, 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.081 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23607 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3200000000000004e-07 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878250+0000", 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1920000000000001e-06 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878258+0000", 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4279999999999996e-06 2024-09-12T05:20:46.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878265+0000", 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9539999999999998e-06 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924447+0000", 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046182198000000001 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924461+0000", 2024-09-12T05:20:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3678e-05 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23608 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1819680669999997, 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046219194999999998, 2024-09-12T05:20:46.085 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23608 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878321+0000", 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5899999999999995e-07 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878324+0000", 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9220000000000001e-06 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878332+0000", 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0620000000000001e-06 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878339+0000", 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6440000000000003e-06 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924512+0000", 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046173120999999998 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924540+0000", 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7586999999999999e-05 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23609 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.089 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1819405600000001, 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046254423000000003, 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23609 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878349+0000", 2024-09-12T05:20:46.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4499999999999996e-07 2024-09-12T05:20:46.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878351+0000", 2024-09-12T05:20:46.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7180000000000001e-06 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878368+0000", 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6801000000000001e-05 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878376+0000", 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3649999999999998e-06 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924593+0000", 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046217113999999997 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924602+0000", 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5799999999999998e-06 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23610 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.094 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1818926239999996, 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046255375000000001, 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.095 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23610 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878399+0000", 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9919999999999999e-06 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878407+0000", 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9650000000000008e-06 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878414+0000", 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924641+0000", 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046226972999999998 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924651+0000", 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.03e-05 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23611 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1818583360000003, 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046240949000000003, 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.099 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23611 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:46.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878431+0000", 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4099999999999999e-07 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878433+0000", 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.632e-06 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878443+0000", 2024-09-12T05:20:46.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0104e-05 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878450+0000", 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2620000000000004e-06 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924666+0000", 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046216672 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924671+0000", 2024-09-12T05:20:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23612 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1818305220000003, 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046245959000000003, 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.103 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23612 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878459+0000", 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1900000000000001e-07 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878461+0000", 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4930000000000001e-06 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878473+0000", 2024-09-12T05:20:46.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1756000000000001e-05 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878480+0000", 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7170000000000002e-06 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924694+0000", 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046214660999999997 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924704+0000", 2024-09-12T05:20:46.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5130000000000002e-06 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23613 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1817603050000001, 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046232418999999997, 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.107 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23613 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878529+0000", 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.367e-06 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878535+0000", 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9680000000000003e-06 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878554+0000", 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8513e-05 2024-09-12T05:20:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878567+0000", 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3492000000000001e-05 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924749+0000", 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046181148999999998 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924760+0000", 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1929999999999999e-05 2024-09-12T05:20:46.110 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23614 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1817005370000002, 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046230298000000003, 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23614 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878589+0000", 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2750000000000001e-06 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878603+0000", 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3626e-05 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878618+0000", 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5671999999999998e-05 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878631+0000", 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2206e-05 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924805+0000", 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046174814000000002 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924818+0000", 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2704999999999999e-05 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.114 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23615 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1816367640000003, 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046210418000000003, 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23615 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.115 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878653+0000", 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.173e-06 2024-09-12T05:20:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878658+0000", 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8890000000000001e-06 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878673+0000", 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5580999999999999e-05 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878687+0000", 2024-09-12T05:20:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3565e-05 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924851+0000", 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046164226000000003 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924862+0000", 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0984e-05 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23616 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1815656959999998, 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046184362, 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23616 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878724+0000", 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.649e-06 2024-09-12T05:20:46.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878730+0000", 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878748+0000", 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7271000000000001e-05 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878760+0000", 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2564e-05 2024-09-12T05:20:46.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924897+0000", 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046136542000000003 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924907+0000", 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0358e-05 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.122 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23617 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.181508955, 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046182312000000003, 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23617 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878781+0000", 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878786+0000", 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2850000000000002e-06 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878802+0000", 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5837000000000001e-05 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878814+0000", 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2228e-05 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924949+0000", 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046135352999999997 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924962+0000", 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2255e-05 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.126 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23618 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1814538839999997, 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046185865, 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23618 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878835+0000", 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8199999999999998e-07 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878839+0000", 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5279999999999999e-06 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878848+0000", 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.653e-06 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878854+0000", 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6930000000000001e-06 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925008+0000", 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046153753999999998 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925020+0000", 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2354999999999999e-05 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23619 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.130 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1814034319999998, 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046173694000000001, 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23619 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:46.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878886+0000", 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7400000000000003e-07 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878889+0000", 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878899+0000", 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0264e-05 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878906+0000", 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2350000000000002e-06 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925046+0000", 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046139927999999997 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925059+0000", 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2463000000000001e-05 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23620 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1813359859999997, 2024-09-12T05:20:46.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046148199000000001, 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23620 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878954+0000", 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1510000000000001e-06 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878959+0000", 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5949999999999998e-06 2024-09-12T05:20:46.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878975+0000", 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5790999999999998e-05 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878987+0000", 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1972e-05 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925086+0000", 2024-09-12T05:20:46.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046099049000000003 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925101+0000", 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4640999999999999e-05 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:24894 3.b 3:d0acdfbf:::rbd_data.1118d7e09baf.0000000000000041:e [read 324608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1219114890000004, 2024-09-12T05:20:46.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046214719000000001, 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 24894 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943307+0000", 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049300769999999997 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943313+0000", 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4749999999999998e-06 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943332+0000", 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8261e-05 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943341+0000", 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9409999999999996e-06 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984427+0000", 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041085932999999998 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984510+0000", 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3432999999999999e-05 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984592+0000", 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599000000000003e-05 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:46.142 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:46.143 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:46.189 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:46.189+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:46.254 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:46.253+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:46.276 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:46.276 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:46.276 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:46.276 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:46.290 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:46.354 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:46.357+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:46.457 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:46.457 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:46.457 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:46.457 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:46.457 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:46.458 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:46.457+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:46.469 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:46.557 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:46.557+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:46.632 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4630 3.1a 3:5ebba714:::rbd_data.1118e5842253.0000000000000077:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.493069229, 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039742162999999997, 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.633 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4630 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138451+0000", 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9570000000000001e-06 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138461+0000", 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9760000000000007e-06 2024-09-12T05:20:46.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138489+0000", 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7742999999999998e-05 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138504+0000", 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4960000000000001e-05 2024-09-12T05:20:46.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138608+0000", 2024-09-12T05:20:46.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104053 2024-09-12T05:20:46.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138815+0000", 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000206832 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.145988+0000", 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071735109999999996 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.177998+0000", 2024-09-12T05:20:46.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032009700000000002 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178028+0000", 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0209000000000002e-05 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178118+0000", 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9365999999999998e-05 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178191+0000", 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3856000000000006e-05 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10970 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.570428635999999, 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033399048000000001, 2024-09-12T05:20:46.640 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10970 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061091+0000", 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1230000000000001e-06 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061096+0000", 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1000000000000003e-06 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061113+0000", 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7227e-05 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061127+0000", 2024-09-12T05:20:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3793e-05 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093864+0000", 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032736994999999998 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094052+0000", 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018771799999999999 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094489+0000", 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043709199999999998 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10971 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.570373972999999, 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033948741999999997, 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.645 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10971 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061146+0000", 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.167e-06 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061151+0000", 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8899999999999998e-06 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061167+0000", 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6578999999999998e-05 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061181+0000", 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3587000000000001e-05 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094538+0000", 2024-09-12T05:20:46.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033357568999999997 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094672+0000", 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133323 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095093+0000", 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042162699999999999 2024-09-12T05:20:46.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11031 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 303104~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.569961165999999, 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034486665, 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.650 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11031 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061559+0000", 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061568+0000", 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5329999999999994e-06 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061598+0000", 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0395999999999998e-05 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061618+0000", 2024-09-12T05:20:46.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000001e-05 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095169+0000", 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033551105999999997 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095379+0000", 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021028999999999999 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096044+0000", 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00066456000000000002 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11032 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 352256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.5698686, 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035279433999999998, 2024-09-12T05:20:46.655 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11032 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061651+0000", 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.44e-06 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061658+0000", 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4529999999999999e-06 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061678+0000", 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0460000000000001e-05 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061693+0000", 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.468e-05 2024-09-12T05:20:46.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096100+0000", 2024-09-12T05:20:46.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034407364000000003 2024-09-12T05:20:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096256+0000", 2024-09-12T05:20:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015584799999999999 2024-09-12T05:20:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096929+0000", 2024-09-12T05:20:46.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067318900000000004 2024-09-12T05:20:46.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.661 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11033 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 401408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.569804620999999, 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036054468999999999, 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11033 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:46.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061715+0000", 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061722+0000", 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5740000000000001e-06 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061741+0000", 2024-09-12T05:20:46.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:46.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061754+0000", 2024-09-12T05:20:46.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3257e-05 2024-09-12T05:20:46.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096997+0000", 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035242809 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097165+0000", 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000168839 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097768+0000", 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00060290099999999998 2024-09-12T05:20:46.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11034 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 450560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.569745941000001, 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036605824000000002, 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11034 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061774+0000", 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.13e-06 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061779+0000", 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9169999999999997e-06 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061797+0000", 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7995999999999998e-05 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061810+0000", 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3753e-05 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097821+0000", 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036010845 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097958+0000", 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137188 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098378+0000", 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041999499999999999 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.672 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11035 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 499712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.569688052, 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037210007000000003, 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11035 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061832+0000", 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.243e-06 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061842+0000", 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0067e-05 2024-09-12T05:20:46.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061860+0000", 2024-09-12T05:20:46.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7923000000000001e-05 2024-09-12T05:20:46.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061873+0000", 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3277e-05 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098443+0000", 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036569628999999999 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098601+0000", 2024-09-12T05:20:46.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015857800000000001 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099040+0000", 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043929 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23755 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 354304~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:46.678 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.725484968, 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033578519000000001, 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23755 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:46.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2499999999999995e-07 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906036+0000", 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.092e-06 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906043+0000", 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906048+0000", 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1019999999999996e-06 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939392+0000", 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033344290999999998 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939469+0000", 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6792000000000006e-05 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939612+0000", 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014325699999999999 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.682 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23756 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 364544~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7254637539999997, 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033786347000000001, 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23756 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4000000000000002e-07 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906057+0000", 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0080000000000001e-06 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906065+0000", 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9359999999999999e-06 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906070+0000", 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.259e-06 2024-09-12T05:20:46.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939658+0000", 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033587287 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939732+0000", 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4666000000000006e-05 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939841+0000", 2024-09-12T05:20:46.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108651 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23757 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 374784~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7254415510000003, 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033996597000000003, 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.688 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23757 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4400000000000001e-07 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906084+0000", 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999998e-06 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906091+0000", 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7000000000000002e-06 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906096+0000", 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9679999999999997e-06 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939885+0000", 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033789419000000001 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939989+0000", 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010427100000000001 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940074+0000", 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4135000000000007e-05 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23758 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 401408~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7254152349999998, 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034154898000000003, 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23758 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906104+0000", 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.89e-07 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906106+0000", 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.419e-06 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906112+0000", 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2720000000000003e-06 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906118+0000", 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1370000000000001e-06 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940114+0000", 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033996234 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940185+0000", 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0919000000000003e-05 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940258+0000", 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3428000000000002e-05 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23759 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 411648~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7253933290000001, 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034344294999999997, 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23759 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906126+0000", 2024-09-12T05:20:46.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-07 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906129+0000", 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8100000000000002e-06 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906135+0000", 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6749999999999996e-06 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906140+0000", 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0660000000000003e-06 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940302+0000", 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034161206 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940385+0000", 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3415e-05 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940469+0000", 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4400999999999994e-05 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23760 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 421888~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7253534869999996, 2024-09-12T05:20:46.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034485021999999997, 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23760 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906166+0000", 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9299999999999998e-07 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906168+0000", 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5600000000000001e-06 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906175+0000", 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3440000000000003e-06 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906181+0000", 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7799999999999997e-06 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940510+0000", 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034329163000000003 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940578+0000", 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7971000000000004e-05 2024-09-12T05:20:46.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940650+0000", 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1611000000000003e-05 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23761 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 432128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:46.707 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7253288959999997, 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034676953000000003, 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23761 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906192+0000", 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2330000000000001e-06 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906199+0000", 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906204+0000", 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.113e-06 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940691+0000", 2024-09-12T05:20:46.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034486744 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940787+0000", 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5880999999999999e-05 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940867+0000", 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9692999999999997e-05 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23762 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 458752~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7253072669999998, 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034860442999999998, 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23762 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.713 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906212+0000", 2024-09-12T05:20:46.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906214+0000", 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9470000000000002e-06 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906220+0000", 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.302e-06 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906226+0000", 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2929999999999997e-06 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940927+0000", 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034700380000000003 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940998+0000", 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1888e-05 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941072+0000", 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3182000000000005e-05 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23763 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 468992~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7252852829999998, 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035048453, 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.717 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23763 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906234+0000", 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906236+0000", 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1720000000000001e-06 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906243+0000", 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906248+0000", 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3140000000000003e-06 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941118+0000", 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034869783000000001 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941199+0000", 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0906000000000001e-05 2024-09-12T05:20:46.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941282+0000", 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3133999999999994e-05 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23764 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 479232~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7252632859999997, 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035223974999999998, 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.721 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23764 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906256+0000", 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4700000000000001e-07 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906258+0000", 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1289999999999999e-06 2024-09-12T05:20:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906265+0000", 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3350000000000001e-06 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906271+0000", 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941324+0000", 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035052899999999998 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941401+0000", 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7572999999999997e-05 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941479+0000", 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8036999999999998e-05 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23765 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 489472~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7252399519999999, 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035401881000000003, 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.726 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23765 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906281+0000", 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1320000000000001e-06 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906289+0000", 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.977e-06 2024-09-12T05:20:46.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906294+0000", 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941519+0000", 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035224917000000001 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941589+0000", 2024-09-12T05:20:46.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9978e-05 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941680+0000", 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1033999999999996e-05 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23766 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 516096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7252163930000002, 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035572985000000001, 2024-09-12T05:20:46.730 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23766 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:46.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906303+0000", 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2399999999999998e-07 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906305+0000", 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:46.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906311+0000", 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5169999999999996e-06 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906316+0000", 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9749999999999998e-06 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941709+0000", 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035392161999999998 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:46.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941798+0000", 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9302000000000007e-05 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941875+0000", 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7180000000000003e-05 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:46.734 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:46.736 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:46.736 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:46.737+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:46.837 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:46.837+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:46.865 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:46.865 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:46.865 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:46.865 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:46.878 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:46.896 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:46.940 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:46.941+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:47.002 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:47.002 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:47.016 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:47.038 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:47.037+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:47.061 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:47.062 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:47.078 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:47.094 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:47.113 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:47.113 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:47.133 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:47.133 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:47.139 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4530 3.1d 3:b845397b:::rbd_object_map.1118e5842253:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.240347901, 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034828258000000001, 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4530 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898325+0000", 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898333+0000", 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3200000000000002e-06 2024-09-12T05:20:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898372+0000", 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9403000000000002e-05 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898403+0000", 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1282999999999998e-05 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925774+0000", 2024-09-12T05:20:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027371126999999999 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925885+0000", 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110536 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.926372+0000", 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048729900000000001 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.931755+0000", 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053824099999999998 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.932970+0000", 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012150799999999999 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933079+0000", 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108736 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933152+0000", 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3910000000000002e-05 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.076522235999999, 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.146 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:47.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:20:47.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.150 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.076426213000001, 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:47.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:20:47.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:20:47.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.076366910000001, 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:47.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.076310203999999, 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:47.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:20:47.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.075282865999998, 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.075223008999998, 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:20:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.075135202999999, 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:20:47.173 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:20:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.074452765, 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:20:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:20:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.074366153, 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11057 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.067684070999999, 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034782517999999998, 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11057 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070989+0000", 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.268e-06 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071050+0000", 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0294000000000002e-05 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071068+0000", 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8683000000000001e-05 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071083+0000", 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5167999999999999e-05 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105540+0000", 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034457039000000002 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105657+0000", 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116248 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105771+0000", 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113818 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22384 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4602496309999999, 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035328432999999999, 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22384 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678423+0000", 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678427+0000", 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999998e-06 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678436+0000", 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8589999999999994e-06 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678444+0000", 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4959999999999996e-06 2024-09-12T05:20:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705279+0000", 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026834632000000001 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705520+0000", 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024076100000000001 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.706555+0000", 2024-09-12T05:20:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001034933 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.710982+0000", 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044268010000000002 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713437+0000", 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024553029999999998 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713623+0000", 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018639399999999999 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713751+0000", 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012766700000000001 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22385 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4602175229999999, 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037690591000000002, 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22385 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678459+0000", 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7900000000000001e-06 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678468+0000", 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8890000000000008e-06 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678475+0000", 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8800000000000002e-06 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708857+0000", 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030381907999999999 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708999+0000", 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014186900000000001 2024-09-12T05:20:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.709638+0000", 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063908400000000005 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715839+0000", 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062014890000000001 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715882+0000", 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3188000000000001e-05 2024-09-12T05:20:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716026+0000", 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014375999999999999 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716145+0000", 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011903700000000001 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22386 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4601873310000002, 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040447601, 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22386 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678496+0000", 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0623e-05 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678506+0000", 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7890000000000006e-06 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678513+0000", 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1359999999999999e-06 2024-09-12T05:20:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711185+0000", 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032671814 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711506+0000", 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321417 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.712538+0000", 2024-09-12T05:20:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010313760000000001 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716256+0000", 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037188350000000002 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718706+0000", 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024499159999999999 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718856+0000", 2024-09-12T05:20:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015012900000000001 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718932+0000", 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5926000000000005e-05 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22387 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.4601481190000003, 2024-09-12T05:20:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040806824999999998, 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22387 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678525+0000", 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678529+0000", 2024-09-12T05:20:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678538+0000", 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1060000000000006e-06 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678545+0000", 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0260000000000002e-06 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713870+0000", 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035324960000000002 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714037+0000", 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167381 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714624+0000", 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058681300000000005 2024-09-12T05:20:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718968+0000", 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043441749999999996 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719059+0000", 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1019000000000004e-05 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719151+0000", 2024-09-12T05:20:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1157999999999997e-05 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719331+0000", 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000180201 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23350 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 329728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2933350829999997, 2024-09-12T05:20:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037806736000000001, 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23350 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845338+0000", 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845340+0000", 2024-09-12T05:20:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.289e-06 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845347+0000", 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845353+0000", 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875603+0000", 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030250139999999998 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875670+0000", 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6791999999999993e-05 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.883144+0000", 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007473553 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23728 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 503808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855361+0000", 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2833109409999999, 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.03461289, 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23728 2024-09-12T05:20:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855361+0000", 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855361+0000", 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855362+0000", 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0070000000000001e-06 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855365+0000", 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0920000000000002e-06 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855374+0000", 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855381+0000", 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6449999999999999e-06 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.889827+0000", 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034446188000000003 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.889900+0000", 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3365e-05 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.889974+0000", 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3798000000000001e-05 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23729 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 514048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.2832806950000002, 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035315419000000001, 2024-09-12T05:20:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23729 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855392+0000", 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855395+0000", 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855403+0000", 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4980000000000006e-06 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855410+0000", 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6189999999999996e-06 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890120+0000", 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034710795000000003 2024-09-12T05:20:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890630+0000", 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000509901 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890707+0000", 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6423999999999999e-05 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25449 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8416355920000003, 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036956818000000002, 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25449 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297037+0000", 2024-09-12T05:20:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-07 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297041+0000", 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297052+0000", 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0866000000000001e-05 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297060+0000", 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7829999999999999e-06 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.327882+0000", 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0308218 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328015+0000", 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133406 2024-09-12T05:20:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328611+0000", 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059631400000000002 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333062+0000", 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044503540000000001 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333708+0000", 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064637699999999995 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333878+0000", 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016978800000000001 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333993+0000", 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115344 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25659 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5781527530000004, 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035645679, 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25659 2024-09-12T05:20:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560520+0000", 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560523+0000", 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0520000000000002e-06 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560529+0000", 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1330000000000004e-06 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560534+0000", 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589658+0000", 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029124035 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589799+0000", 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014103 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.590443+0000", 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064374400000000002 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.592625+0000", 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021819439999999999 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596057+0000", 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034316820000000001 2024-09-12T05:20:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596119+0000", 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2811999999999994e-05 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596165+0000", 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5534999999999997e-05 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:47.241 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:47.241 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:47.141+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:47.242 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:47.242 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:47.243 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:47.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:47.243 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:47.244 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:47.245 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:47.245 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:47.241+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:47.343 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:47.341+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:47.371 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:47.372 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:47.385 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:47.477 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:47.477+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:47.545 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:47.545+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:47.573 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:47.573 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:47.587 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:47.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:47.673+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:47.687 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-12T05:20:47.747 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:47.745+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:47.754 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:47.754 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:47.769 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:47.857 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:47.857+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:47.894 INFO:teuthology.orchestra.run.smithi059.stdout:1917 trunc from 0xea1224f to 0x52d5302 2024-09-12T05:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:47.949 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:47.949 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:47.949+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:47.950 INFO:teuthology.orchestra.run.smithi059.stdout:1919 write 0x93881f7 thru 0x939724b (0xf055 bytes) 2024-09-12T05:20:47.958 INFO:teuthology.orchestra.run.smithi059.stdout:1920 read 0x17d6c07 thru 0x17da7df (0x3bd9 bytes) 2024-09-12T05:20:47.964 INFO:teuthology.orchestra.run.smithi059.stdout:1921 trunc from 0x939724c to 0xaceb877 2024-09-12T05:20:47.975 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:47.975 INFO:teuthology.orchestra.run.smithi059.stdout:1923 punch from 0x792d0c4 to 0x7939460, (0xc39c bytes) 2024-09-12T05:20:47.975 INFO:teuthology.orchestra.run.smithi059.stdout:1926 read 0x3e056b7 thru 0x3e1286c (0xd1b6 bytes) 2024-09-12T05:20:47.976 INFO:teuthology.orchestra.run.smithi059.stdout:1927 read 0x21aba23 thru 0x21b95c0 (0xdb9e bytes) 2024-09-12T05:20:47.979 INFO:teuthology.orchestra.run.smithi059.stdout:1930 write 0x815a352 thru 0x8162322 (0x7fd1 bytes) 2024-09-12T05:20:47.987 INFO:teuthology.orchestra.run.smithi059.stdout:1931 read 0x92879a4 thru 0x9295174 (0xd7d1 bytes) 2024-09-12T05:20:47.987 INFO:teuthology.orchestra.run.smithi059.stdout:1932 writesame 0x6c6a483 thru 0x6c78308 data_size 0x1a(0xde86 bytes) 2024-09-12T05:20:47.995 INFO:teuthology.orchestra.run.smithi059.stdout:1933 read 0x2d16c48 thru 0x2d236da (0xca93 bytes) 2024-09-12T05:20:47.996 INFO:teuthology.orchestra.run.smithi059.stdout:1935 read 0x5592016 thru 0x5598096 (0x6081 bytes) 2024-09-12T05:20:47.996 INFO:teuthology.orchestra.run.smithi059.stdout:1936 read 0x6dd9009 thru 0x6de3f4a (0xaf42 bytes) 2024-09-12T05:20:48.011 INFO:teuthology.orchestra.run.smithi059.stdout:1937 write 0xc822496 thru 0xc82ed65 (0xc8d0 bytes) 2024-09-12T05:20:48.018 INFO:teuthology.orchestra.run.smithi059.stdout:1938 writesame 0x3533646 thru 0x3542afd data_size 0x52(0xf4b8 bytes) 2024-09-12T05:20:48.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:20:48.037 INFO:teuthology.orchestra.run.smithi059.stdout:1940 punch from 0x61cb2c2 to 0x61cc77a, (0x14b8 bytes) 2024-09-12T05:20:48.037 INFO:teuthology.orchestra.run.smithi059.stdout:1941 read 0x25eeac7 thru 0x25fb743 (0xcc7d bytes) 2024-09-12T05:20:48.037 INFO:teuthology.orchestra.run.smithi059.stdout:1943 read 0xa6c66f2 thru 0xa6d6392 (0xfca1 bytes) 2024-09-12T05:20:48.037 INFO:teuthology.orchestra.run.smithi059.stdout:1944 punch from 0x9dd95be to 0x9de750b, (0xdf4d bytes) 2024-09-12T05:20:48.037 INFO:teuthology.orchestra.run.smithi059.stdout:1945 writesame 0xb5d4a29 thru 0xb5d9ba0 data_size 0x2c(0x5178 bytes) 2024-09-12T05:20:48.047 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:48.047 INFO:teuthology.orchestra.run.smithi059.stdout:1949 punch from 0x69a6f9 to 0x69f234, (0x4b3b bytes) 2024-09-12T05:20:48.047 INFO:teuthology.orchestra.run.smithi059.stdout:1950 write 0xb54d1bd thru 0xb55b3de (0xe222 bytes) 2024-09-12T05:20:48.049 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:48.049+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:48.056 INFO:teuthology.orchestra.run.smithi059.stdout:1951 read 0x10f5133 thru 0x10fe715 (0x95e3 bytes) 2024-09-12T05:20:48.057 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:48.057 INFO:teuthology.orchestra.run.smithi059.stdout:1954 write 0xa5df426 thru 0xa5e7e8b (0x8a66 bytes) 2024-09-12T05:20:48.066 INFO:teuthology.orchestra.run.smithi059.stdout:1956 writesame 0x574f83c thru 0x575cfa4 data_size 0x29(0xd769 bytes) 2024-09-12T05:20:48.074 INFO:teuthology.orchestra.run.smithi059.stdout:1957 punch from 0xa24e74e to 0xa25bb49, (0xd3fb bytes) 2024-09-12T05:20:48.092 INFO:teuthology.orchestra.run.smithi059.stdout:1958 trunc from 0xc82ed66 to 0x2d7f7c4 2024-09-12T05:20:48.128 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:48.128 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:48.142 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:48.150 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:48.148+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:48.252 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:48.252+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:48.309 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:48.309 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:48.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:48.353 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:48.353+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:48.446 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:48.446 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:48.454 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:48.453+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:48.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:48.555 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:48.553+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:48.588 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:48.588 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:48.602 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:48.656 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:48.656+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:48.744 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:48.788 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:48.788+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:48.857 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:48.857+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:48.917 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:48.917 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:48.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:48.958 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:48.957+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:20:49.058 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:49.056+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:49.073 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:49.073 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:49.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:49.093 INFO:teuthology.orchestra.run.smithi059.stdout:1960 write 0x628da70 thru 0x628e9c8 (0xf59 bytes) 2024-09-12T05:20:49.098 INFO:teuthology.orchestra.run.smithi059.stdout:1961 read 0x2714809 thru 0x27215aa (0xcda2 bytes) 2024-09-12T05:20:49.098 INFO:teuthology.orchestra.run.smithi059.stdout:1962 write 0x37de682 thru 0x37ded53 (0x6d2 bytes) 2024-09-12T05:20:49.103 INFO:teuthology.orchestra.run.smithi059.stdout:1963 read 0x3debe89 thru 0x3dee740 (0x28b8 bytes) 2024-09-12T05:20:49.103 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:49.104 INFO:teuthology.orchestra.run.smithi059.stdout:1965 writesame 0x2e70e48 thru 0x2e75a64 data_size 0xf(0x4c1d bytes) 2024-09-12T05:20:49.109 INFO:teuthology.orchestra.run.smithi059.stdout:1966 read 0xf6b480 thru 0xf740f0 (0x8c71 bytes) 2024-09-12T05:20:49.122 INFO:teuthology.orchestra.run.smithi059.stdout:1967 writesame 0x6718099 thru 0x671c5e3 data_size 0x51(0x454b bytes) 2024-09-12T05:20:49.135 INFO:teuthology.orchestra.run.smithi059.stdout:1968 trunc from 0x671c5e4 to 0xebc34ea 2024-09-12T05:20:49.143 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:49.143 INFO:teuthology.orchestra.run.smithi059.stdout:1972 write 0xb23c81b thru 0xb23f1f5 (0x29db bytes) 2024-09-12T05:20:49.147 INFO:teuthology.orchestra.run.smithi059.stdout:1973 write 0x8665000 thru 0x86696e2 (0x46e3 bytes) 2024-09-12T05:20:49.154 INFO:teuthology.orchestra.run.smithi059.stdout:1974 read 0x910debf thru 0x9114ba2 (0x6ce4 bytes) 2024-09-12T05:20:49.154 INFO:teuthology.orchestra.run.smithi059.stdout:1975 write 0xb49bfb3 thru 0xb49cbad (0xbfb bytes) 2024-09-12T05:20:49.159 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:49.156+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:49.159 INFO:teuthology.orchestra.run.smithi059.stdout:1976 read 0xe34612b thru 0xe34c8f6 (0x67cc bytes) 2024-09-12T05:20:49.160 INFO:teuthology.orchestra.run.smithi059.stdout:1977 read 0x1cc6bb1 thru 0x1cd3840 (0xcc90 bytes) 2024-09-12T05:20:49.162 INFO:teuthology.orchestra.run.smithi059.stdout:1979 write 0x843c2c9 thru 0x84464fb (0xa233 bytes) 2024-09-12T05:20:49.169 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:49.169 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:49.170 INFO:teuthology.orchestra.run.smithi059.stdout:1983 read 0xc0577fe thru 0xc062826 (0xb029 bytes) 2024-09-12T05:20:49.170 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:49.170 INFO:teuthology.orchestra.run.smithi059.stdout:1985 read 0x56bb6e9 thru 0x56c934f (0xdc67 bytes) 2024-09-12T05:20:49.170 INFO:teuthology.orchestra.run.smithi059.stdout:1986 punch from 0x3d6ad6d to 0x3d7aa23, (0xfcb6 bytes) 2024-09-12T05:20:49.170 INFO:teuthology.orchestra.run.smithi059.stdout:1987 write 0x1f82435 thru 0x1f84cfe (0x28ca bytes) 2024-09-12T05:20:49.182 INFO:teuthology.orchestra.run.smithi059.stdout:1988 read 0x208ad5b thru 0x2090e9a (0x6140 bytes) 2024-09-12T05:20:49.200 INFO:teuthology.orchestra.run.smithi059.stdout:1990 trunc from 0xebc34ea to 0x6251865 2024-09-12T05:20:49.225 INFO:teuthology.orchestra.run.smithi059.stdout:1991 read 0x5cbd695 thru 0x5ccb46b (0xddd7 bytes) 2024-09-12T05:20:49.225 INFO:teuthology.orchestra.run.smithi059.stdout:1992 punch from 0x4d06535 to 0x4d10a92, (0xa55d bytes) 2024-09-12T05:20:49.225 INFO:teuthology.orchestra.run.smithi059.stdout:1993 read 0x4bba03e thru 0x4bc30f2 (0x90b5 bytes) 2024-09-12T05:20:49.234 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:49.234 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:49.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:49.251 INFO:teuthology.orchestra.run.smithi059.stdout:1994 writesame 0xddc5b41 thru 0xddce722 data_size 0x5(0x8be2 bytes) 2024-09-12T05:20:49.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:49.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:49.257+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:49.271 INFO:teuthology.orchestra.run.smithi059.stdout:1995 trunc from 0xddce723 to 0x1dcf405 2024-09-12T05:20:49.344 INFO:teuthology.orchestra.run.smithi059.stdout:1996 writesame 0xc4a87dd thru 0xc4b7093 data_size 0x1(0xe8b7 bytes) 2024-09-12T05:20:49.344 INFO:teuthology.orchestra.run.smithi059.stdout:1997 write 0x3f67338 thru 0x3f751a2 (0xde6b bytes) 2024-09-12T05:20:49.353 INFO:teuthology.orchestra.run.smithi059.stdout:1998 write 0x708ac01 thru 0x708f376 (0x4776 bytes) 2024-09-12T05:20:49.358 INFO:teuthology.orchestra.run.smithi059.stdout:2000 punch from 0xa0e33d8 to 0xa0e73a2, (0x3fca bytes) 2024-09-12T05:20:49.361 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:49.361+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:49.369 INFO:teuthology.orchestra.run.smithi059.stdout:2001 trunc from 0xc4b7094 to 0x5ad052a 2024-09-12T05:20:49.387 INFO:teuthology.orchestra.run.smithi059.stdout:2002 flatten 2024-09-12T05:20:49.421 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:49.421 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:49.431 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:49.431 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:49.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:49.459 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:49.461 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:49.461+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:49.490 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:49.490 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:49.516 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:49.516 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:49.543 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:49.543 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:49.562 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:49.561+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:49.571 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:49.604 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:49.616 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:49.617 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:49.635 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:49.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:49.665 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:49.665+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:49.767 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:49.765+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:49.831 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:49.831 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:49.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.851993454999999, 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:20:49.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:20:49.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:20:49.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.838 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.839 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8553 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'44, mlcod=37'40)", 2024-09-12T05:20:49.839 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:49.839 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.990497925, 2024-09-12T05:20:49.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048787479999999996, 2024-09-12T05:20:49.840 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.840 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:49.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840756+0000", 2024-09-12T05:20:49.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840757+0000", 2024-09-12T05:20:49.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:49.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840761+0000", 2024-09-12T05:20:49.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0790000000000002e-06 2024-09-12T05:20:49.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840771+0000", 2024-09-12T05:20:49.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0151e-05 2024-09-12T05:20:49.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840776+0000", 2024-09-12T05:20:49.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9389999999999996e-06 2024-09-12T05:20:49.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840826+0000", 2024-09-12T05:20:49.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9521999999999998e-05 2024-09-12T05:20:49.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.840845+0000", 2024-09-12T05:20:49.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9360000000000001e-05 2024-09-12T05:20:49.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845590+0000", 2024-09-12T05:20:49.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004744687 2024-09-12T05:20:49.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.845635+0000", 2024-09-12T05:20:49.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5423999999999997e-05 2024-09-12T05:20:49.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.849 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.850 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:20:49.850 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:49.850 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.940361138, 2024-09-12T05:20:49.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:20:49.851 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.851 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:49.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:20:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:20:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:20:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:20:49.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:20:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:20:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:20:49.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:20:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:20:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:20:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:20:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:20:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:20:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:20:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:20:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9013 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'63, mlcod=37'59)", 2024-09-12T05:20:49.860 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.861784708999998, 2024-09-12T05:20:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051699299999999997, 2024-09-12T05:20:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.861 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:49.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6400000000000002e-07 2024-09-12T05:20:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969476+0000", 2024-09-12T05:20:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0440000000000001e-06 2024-09-12T05:20:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969490+0000", 2024-09-12T05:20:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3328e-05 2024-09-12T05:20:49.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969497+0000", 2024-09-12T05:20:49.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2559999999999996e-06 2024-09-12T05:20:49.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969563+0000", 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5879999999999999e-05 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969589+0000", 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5972000000000001e-05 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974583+0000", 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049945379999999998 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974640+0000", 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6248000000000001e-05 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9885 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'109, mlcod=37'106)", 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.558419481000001, 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051369570000000002, 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272840+0000", 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1559999999999997e-06 2024-09-12T05:20:49.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272848+0000", 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-06 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272853+0000", 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4569999999999998e-06 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272896+0000", 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3441e-05 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272911+0000", 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4484000000000001e-05 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277923+0000", 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050118480000000002 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277972+0000", 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9174e-05 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.873 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.557660653999999, 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:20:49.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:20:49.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:20:49.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:20:49.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:20:49.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:20:49.879 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.879 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.879 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.879 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10139 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'147, mlcod=37'142)", 2024-09-12T05:20:49.880 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:49.880 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.389552748, 2024-09-12T05:20:49.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051775290000000002, 2024-09-12T05:20:49.880 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.880 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.880 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.880 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:49.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:49.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:49.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:20:49.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441706+0000", 2024-09-12T05:20:49.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.985e-06 2024-09-12T05:20:49.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441716+0000", 2024-09-12T05:20:49.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3810000000000005e-06 2024-09-12T05:20:49.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441722+0000", 2024-09-12T05:20:49.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:20:49.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441772+0000", 2024-09-12T05:20:49.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9465999999999997e-05 2024-09-12T05:20:49.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441792+0000", 2024-09-12T05:20:49.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0560999999999998e-05 2024-09-12T05:20:49.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446825+0000", 2024-09-12T05:20:49.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050325259999999998 2024-09-12T05:20:49.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446879+0000", 2024-09-12T05:20:49.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999999e-05 2024-09-12T05:20:49.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.889 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:20:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.323617006999999, 2024-09-12T05:20:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:20:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:49.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:49.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:20:49.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:20:49.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:20:49.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:20:49.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:20:49.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:20:49.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:20:49.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:20:49.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:20:49.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:20:49.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10212 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'166, mlcod=37'162)", 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.295718029, 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004931403, 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.898 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535536+0000", 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535537+0000", 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5799999999999999e-07 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535542+0000", 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0159999999999999e-06 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535554+0000", 2024-09-12T05:20:49.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2199e-05 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535564+0000", 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7070000000000004e-06 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535606+0000", 2024-09-12T05:20:49.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2391999999999997e-05 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.535627+0000", 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0503e-05 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540427+0000", 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047999770000000004 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.540468+0000", 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0951000000000001e-05 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.293492676, 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.903 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:49.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:20:49.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:20:49.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:20:49.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:20:49.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:20:49.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.731404895000001, 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.909 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:20:49.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.729450676999999, 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:49.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:20:49.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:20:49.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:20:49.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:20:49.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:20:49.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.918 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11437 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'65, mlcod=38'62)", 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.726569564999998, 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049658940000000002, 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104691+0000", 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0979999999999999e-06 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104702+0000", 2024-09-12T05:20:49.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0611999999999999e-05 2024-09-12T05:20:49.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104711+0000", 2024-09-12T05:20:49.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2024-09-12T05:20:49.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107402+0000", 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026907889999999999 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107423+0000", 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1035000000000001e-05 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109616+0000", 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021936870000000002 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109651+0000", 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4434999999999998e-05 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:20:49.926 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:49.927 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.788141942999999, 2024-09-12T05:20:49.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:20:49.927 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.927 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.927 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.927 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:49.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:20:49.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:20:49.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.77154535, 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:20:49.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:20:49.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20160 3.0 e44/23 3:00225d41:::rbd_data.1118d7e09baf.0000000000000056:head v 44'214, mlcod=43'212)", 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.603031530999999, 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049886230000000002, 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228224+0000", 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0699999999999999e-06 2024-09-12T05:20:49.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228232+0000", 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228254+0000", 2024-09-12T05:20:49.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2507e-05 2024-09-12T05:20:49.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228264+0000", 2024-09-12T05:20:49.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6900000000000004e-06 2024-09-12T05:20:49.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228350+0000", 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5877999999999993e-05 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228378+0000", 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7976000000000001e-05 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.233084+0000", 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047061580000000002 2024-09-12T05:20:49.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.233211+0000", 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012753499999999999 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.601205910000001, 2024-09-12T05:20:49.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:49.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.947 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.722751658, 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:20:49.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:20:49.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:20:49.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:20:49.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:20:49.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:20:49.953 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.953 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.953 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.7227065640000001, 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:20:49.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.7141450029999996, 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:20:49.958 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:20:49.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:20:49.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:20:49.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.963 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:49.963 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:49.963 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:49.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:49.965 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:49.960+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:50.003 INFO:teuthology.orchestra.run.smithi059.stdout:2003 write 0x1a8341f thru 0x1a89940 (0x6522 bytes) 2024-09-12T05:20:50.007 INFO:teuthology.orchestra.run.smithi059.stdout:2004 read 0x2ebc03a thru 0x2ec6298 (0xa25f bytes) 2024-09-12T05:20:50.007 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.007 INFO:teuthology.orchestra.run.smithi059.stdout:2006 read 0x54524e thru 0x54a856 (0x5609 bytes) 2024-09-12T05:20:50.007 INFO:teuthology.orchestra.run.smithi059.stdout:2008 punch from 0x2bcf5e9 to 0x2bda443, (0xae5a bytes) 2024-09-12T05:20:50.019 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:50.020 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:50.020 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-12T05:20:50.020 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T05:20:50.020 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T05:20:50.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-12T05:20:50.021 INFO:teuthology.orchestra.run.smithi059.stdout:2010 write 0x994f665 thru 0x99535b3 (0x3f4f bytes) 2024-09-12T05:20:50.026 INFO:teuthology.orchestra.run.smithi059.stdout:2011 writesame 0x2e9687a thru 0x2e9a0a8 data_size 0x1(0x382f bytes) 2024-09-12T05:20:50.046 INFO:teuthology.orchestra.run.smithi059.stdout:2013 trunc from 0x99535b4 to 0x49e1e4d 2024-09-12T05:20:50.065 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:50.064+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:50.070 INFO:teuthology.orchestra.run.smithi059.stdout:2014 write 0x7a23a0f thru 0x7a29340 (0x5932 bytes) 2024-09-12T05:20:50.080 INFO:teuthology.orchestra.run.smithi059.stdout:2017 trunc from 0x7a29341 to 0x5b5cc05 2024-09-12T05:20:50.093 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.093 INFO:teuthology.orchestra.run.smithi059.stdout:2019 punch from 0x78139e to 0x78a564, (0x91c6 bytes) 2024-09-12T05:20:50.093 INFO:teuthology.orchestra.run.smithi059.stdout:2020 write 0x3aa7c99 thru 0x3aad869 (0x5bd1 bytes) 2024-09-12T05:20:50.110 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:50.110 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:42048 3.18 3:1cd9ef6c:::rbd_header.11182d2a28db:head [call rbd.get_size in=19b out=9b,call rbd.get_features in=24b out=16b,call rbd.get_flags in=20b out=8b,call rbd.get_snapcontext in=18b out=12b,call lock.get_info in=30b out=115b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:50.112824+0000", 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.00043136599999999998, 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00044836099999999999, 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 42048 2024-09-12T05:20:50.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.112824+0000", 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.112824+0000", 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.112825+0000", 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2500000000000004e-07 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.112829+0000", 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2810000000000002e-06 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.112839+0000", 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9410000000000002e-06 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.112846+0000", 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0160000000000003e-06 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.112889+0000", 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2593999999999999e-05 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.112948+0000", 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8836999999999999e-05 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.113272+0000", 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000324767 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.116 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.116 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.116 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:20:50.116 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 1 2024-09-12T05:20:50.116 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:50.116 INFO:teuthology.orchestra.run.smithi059.stdout:2022 writesame 0xaeebf52 thru 0xaef4766 data_size 0x1(0x8815 bytes) 2024-09-12T05:20:50.116 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.117 INFO:teuthology.orchestra.run.smithi059.stdout:2024 trunc from 0xaef4767 to 0x72558f9 2024-09-12T05:20:50.133 INFO:teuthology.orchestra.run.smithi059.stdout:2026 trunc from 0x72558f9 to 0xb508b49 2024-09-12T05:20:50.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:50.139 INFO:teuthology.orchestra.run.smithi059.stdout:2027 writesame 0x56abbc3 thru 0x56ba1f6 data_size 0x6(0xe634 bytes) 2024-09-12T05:20:50.141 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T05:20:50.141 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:50.147 INFO:teuthology.orchestra.run.smithi059.stdout:2028 read 0x68a0267 thru 0x68a1a47 (0x17e1 bytes) 2024-09-12T05:20:50.147 INFO:teuthology.orchestra.run.smithi059.stdout:2029 read 0x3a82b01 thru 0x3a91e0d (0xf30d bytes) 2024-09-12T05:20:50.147 INFO:teuthology.orchestra.run.smithi059.stdout:2030 writesame 0xaddf219 thru 0xade3f1c data_size 0x1f(0x4d04 bytes) 2024-09-12T05:20:50.154 INFO:teuthology.orchestra.run.smithi059.stdout:2031 write 0x57291d2 thru 0x5738a72 (0xf8a1 bytes) 2024-09-12T05:20:50.160 INFO:teuthology.orchestra.run.smithi059.stdout:2032 read 0x29d8cf8 thru 0x29e0293 (0x759c bytes) 2024-09-12T05:20:50.172 INFO:teuthology.orchestra.run.smithi059.stdout:2033 write 0xdf63b87 thru 0xdf6b8bb (0x7d35 bytes) 2024-09-12T05:20:50.178 INFO:teuthology.orchestra.run.smithi059.stdout:2034 writesame 0xaeb78c7 thru 0xaeb8072 data_size 0x2(0x7ac bytes) 2024-09-12T05:20:50.193 INFO:teuthology.orchestra.run.smithi059.stdout:2036 trunc from 0xdf6b8bc to 0x70a3b1b 2024-09-12T05:20:50.197 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:50.196+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:50.226 INFO:teuthology.orchestra.run.smithi059.stdout:2037 writesame 0x8217ede thru 0x82189fc data_size 0xd(0xb1f bytes) 2024-09-12T05:20:50.226 INFO:teuthology.orchestra.run.smithi059.stdout:2038 write 0xc7fdc8 thru 0xc8a066 (0xa29f bytes) 2024-09-12T05:20:50.231 INFO:teuthology.orchestra.run.smithi059.stdout:2039 write 0x10edad2 thru 0x10f3bd7 (0x6106 bytes) 2024-09-12T05:20:50.238 INFO:teuthology.orchestra.run.smithi059.stdout:2040 read 0x5a74761 thru 0x5a7a38e (0x5c2e bytes) 2024-09-12T05:20:50.238 INFO:teuthology.orchestra.run.smithi059.stdout:2041 read 0x705516 thru 0x706877 (0x1362 bytes) 2024-09-12T05:20:50.238 INFO:teuthology.orchestra.run.smithi059.stdout:2042 writesame 0x361a7e7 thru 0x361fd69 data_size 0x1(0x5583 bytes) 2024-09-12T05:20:50.256 INFO:teuthology.orchestra.run.smithi059.stdout:2043 punch from 0x3e66b31 to 0x3e6f5af, (0x8a7e bytes) 2024-09-12T05:20:50.256 INFO:teuthology.orchestra.run.smithi059.stdout:2044 punch from 0x389e319 to 0x389e395, (0x7c bytes) 2024-09-12T05:20:50.257 INFO:teuthology.orchestra.run.smithi059.stdout:2045 punch from 0x5865d9b to 0x5870c46, (0xaeab bytes) 2024-09-12T05:20:50.266 INFO:teuthology.orchestra.run.smithi059.stdout:2046 write 0x8fe36c3 thru 0x8fe96c9 (0x6007 bytes) 2024-09-12T05:20:50.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:50.264+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:50.272 INFO:teuthology.orchestra.run.smithi059.stdout:2047 read 0x83e6a0c thru 0x83f2021 (0xb616 bytes) 2024-09-12T05:20:50.272 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:50.272 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:50.272 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:50.272 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:50.273 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:50.285 INFO:teuthology.orchestra.run.smithi059.stdout:2049 write 0xb6ad652 thru 0xb6b93e4 (0xbd93 bytes) 2024-09-12T05:20:50.293 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:50.293 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.294 INFO:teuthology.orchestra.run.smithi059.stdout:2052 writesame 0x56fb4e4 thru 0x56fd880 data_size 0x3(0x239d bytes) 2024-09-12T05:20:50.298 INFO:teuthology.orchestra.run.smithi059.stdout:2053 writesame 0x817f842 thru 0x818c86e data_size 0x1(0xd02d bytes) 2024-09-12T05:20:50.336 INFO:teuthology.orchestra.run.smithi059.stdout:2054 write 0x37c1c0e thru 0x37c534f (0x3742 bytes) 2024-09-12T05:20:50.340 INFO:teuthology.orchestra.run.smithi059.stdout:2056 read 0x4b707e2 thru 0x4b7e50b (0xdd2a bytes) 2024-09-12T05:20:50.343 INFO:teuthology.orchestra.run.smithi059.stdout:2061 trunc from 0xb6b93e5 to 0xa1b7438 2024-09-12T05:20:50.362 INFO:teuthology.orchestra.run.smithi059.stdout:2062 write 0x9a372b9 thru 0x9a43e0a (0xcb52 bytes) 2024-09-12T05:20:50.368 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:50.368+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:50.372 INFO:teuthology.orchestra.run.smithi059.stdout:2063 read 0x95eea9c thru 0x95fd2b3 (0xe818 bytes) 2024-09-12T05:20:50.372 INFO:teuthology.orchestra.run.smithi059.stdout:2064 read 0xa3065a thru 0xa36e4d (0x67f4 bytes) 2024-09-12T05:20:50.373 INFO:teuthology.orchestra.run.smithi059.stdout:2065 read 0x78f7d87 thru 0x78f81b5 (0x42f bytes) 2024-09-12T05:20:50.384 INFO:teuthology.orchestra.run.smithi059.stdout:2066 write 0xcbc3975 thru 0xcbcddc3 (0xa44f bytes) 2024-09-12T05:20:50.390 INFO:teuthology.orchestra.run.smithi059.stdout:2067 read 0x573c3dc thru 0x5743aa5 (0x76ca bytes) 2024-09-12T05:20:50.391 INFO:teuthology.orchestra.run.smithi059.stdout:2068 write 0x66267e4 thru 0x6632cd3 (0xc4f0 bytes) 2024-09-12T05:20:50.398 INFO:teuthology.orchestra.run.smithi059.stdout:2069 read 0x6b287da thru 0x6b2d1a0 (0x49c7 bytes) 2024-09-12T05:20:50.398 INFO:teuthology.orchestra.run.smithi059.stdout:2070 writesame 0x4fcf4a3 thru 0x4fd6c1b data_size 0x5(0x7779 bytes) 2024-09-12T05:20:50.414 INFO:teuthology.orchestra.run.smithi059.stdout:2071 trunc from 0xcbcddc4 to 0x6edb3e5 2024-09-12T05:20:50.428 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:50.428 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:50.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:50.428 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:50.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.428 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23601 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5514149320000001, 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046132175999999997, 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23601 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877967+0000", 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9299999999999996e-07 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877970+0000", 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6600000000000001e-06 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877987+0000", 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7033000000000001e-05 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877997+0000", 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8970000000000003e-06 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924083+0000", 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046086037000000003 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924098+0000", 2024-09-12T05:20:50.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4656e-05 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23602 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5513320299999993, 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046134982999999997, 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23602 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878050+0000", 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0299999999999998e-07 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878060+0000", 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0008e-05 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878069+0000", 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0699999999999996e-06 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878076+0000", 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8990000000000004e-06 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924152+0000", 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046076735000000001 2024-09-12T05:20:50.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924184+0000", 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1467999999999998e-05 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23604 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5512636400000002, 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046158181, 2024-09-12T05:20:50.437 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23604 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878118+0000", 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7299999999999996e-07 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878120+0000", 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.694e-06 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878128+0000", 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5320000000000001e-06 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878134+0000", 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.083e-06 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924258+0000", 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046123551999999998 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924275+0000", 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7747000000000001e-05 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23605 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5512349590000003, 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046181315000000001, 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23605 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878147+0000", 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5000000000000001e-07 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878149+0000", 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5150000000000001e-06 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878168+0000", 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8505e-05 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878174+0000", 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5250000000000002e-06 2024-09-12T05:20:50.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924319+0000", 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046145149000000003 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924327+0000", 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7710000000000006e-06 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23606 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5511969029999992, 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046204501000000002, 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23606 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.447 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878187+0000", 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.667e-06 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878195+0000", 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7319999999999998e-06 2024-09-12T05:20:50.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878201+0000", 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.489e-06 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924374+0000", 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046172264999999997 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924388+0000", 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4762e-05 2024-09-12T05:20:50.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23607 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5511350939999993, 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046215282000000003, 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.451 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23607 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:50.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3200000000000004e-07 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878250+0000", 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1920000000000001e-06 2024-09-12T05:20:50.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878258+0000", 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4279999999999996e-06 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878265+0000", 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9539999999999998e-06 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924447+0000", 2024-09-12T05:20:50.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046182198000000001 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924461+0000", 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3678e-05 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23608 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:50.455 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5510604410000006, 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046219194999999998, 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23608 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878321+0000", 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5899999999999995e-07 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878324+0000", 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9220000000000001e-06 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878332+0000", 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0620000000000001e-06 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878339+0000", 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6440000000000003e-06 2024-09-12T05:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924512+0000", 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046173120999999998 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924540+0000", 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7586999999999999e-05 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23609 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5510329340000002, 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046254423000000003, 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23609 2024-09-12T05:20:50.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878349+0000", 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4499999999999996e-07 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878351+0000", 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7180000000000001e-06 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878368+0000", 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6801000000000001e-05 2024-09-12T05:20:50.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878376+0000", 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3649999999999998e-06 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924593+0000", 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046217113999999997 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924602+0000", 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5799999999999998e-06 2024-09-12T05:20:50.463 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23610 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5509849980000006, 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046255375000000001, 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.464 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23610 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878399+0000", 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9919999999999999e-06 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878407+0000", 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9650000000000008e-06 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878414+0000", 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924641+0000", 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046226972999999998 2024-09-12T05:20:50.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924651+0000", 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.03e-05 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23611 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5509507100000004, 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046240949000000003, 2024-09-12T05:20:50.468 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23611 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878431+0000", 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4099999999999999e-07 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878433+0000", 2024-09-12T05:20:50.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.632e-06 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878443+0000", 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0104e-05 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878450+0000", 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2620000000000004e-06 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924666+0000", 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046216672 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924671+0000", 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23612 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5509228959999994, 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046245959000000003, 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23612 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:50.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878459+0000", 2024-09-12T05:20:50.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1900000000000001e-07 2024-09-12T05:20:50.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878461+0000", 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4930000000000001e-06 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878473+0000", 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1756000000000001e-05 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878480+0000", 2024-09-12T05:20:50.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7170000000000002e-06 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924694+0000", 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046214660999999997 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924704+0000", 2024-09-12T05:20:50.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5130000000000002e-06 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23613 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5508526790000001, 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046232418999999997, 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23613 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:50.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878529+0000", 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.367e-06 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878535+0000", 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9680000000000003e-06 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878554+0000", 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8513e-05 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878567+0000", 2024-09-12T05:20:50.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3492000000000001e-05 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924749+0000", 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046181148999999998 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924760+0000", 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1929999999999999e-05 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23614 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5507929110000003, 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046230298000000003, 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23614 2024-09-12T05:20:50.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878589+0000", 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2750000000000001e-06 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878603+0000", 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3626e-05 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878618+0000", 2024-09-12T05:20:50.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5671999999999998e-05 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878631+0000", 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2206e-05 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924805+0000", 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046174814000000002 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924818+0000", 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2704999999999999e-05 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23615 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5507291379999995, 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046210418000000003, 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.487 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23615 2024-09-12T05:20:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878653+0000", 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.173e-06 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878658+0000", 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8890000000000001e-06 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878673+0000", 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5580999999999999e-05 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878687+0000", 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3565e-05 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924851+0000", 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046164226000000003 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924862+0000", 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0984e-05 2024-09-12T05:20:50.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23616 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5506580700000008, 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046184362, 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.492 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23616 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878724+0000", 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.649e-06 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878730+0000", 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878748+0000", 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7271000000000001e-05 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878760+0000", 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2564e-05 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924897+0000", 2024-09-12T05:20:50.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046136542000000003 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924907+0000", 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0358e-05 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23617 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:50.496 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5506013289999991, 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046182312000000003, 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23617 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878781+0000", 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878786+0000", 2024-09-12T05:20:50.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2850000000000002e-06 2024-09-12T05:20:50.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878802+0000", 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5837000000000001e-05 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878814+0000", 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2228e-05 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924949+0000", 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046135352999999997 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924962+0000", 2024-09-12T05:20:50.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2255e-05 2024-09-12T05:20:50.501 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.501 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.501 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.501 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23618 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.502 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:50.502 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5505462580000007, 2024-09-12T05:20:50.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046185865, 2024-09-12T05:20:50.502 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.502 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.502 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23618 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:50.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878835+0000", 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8199999999999998e-07 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878839+0000", 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5279999999999999e-06 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878848+0000", 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.653e-06 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878854+0000", 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6930000000000001e-06 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925008+0000", 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046153753999999998 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925020+0000", 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2354999999999999e-05 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.506 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23619 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.507 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:50.507 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5504958060000007, 2024-09-12T05:20:50.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046173694000000001, 2024-09-12T05:20:50.507 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.507 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.507 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.507 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.507 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23619 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878886+0000", 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7400000000000003e-07 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878889+0000", 2024-09-12T05:20:50.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:20:50.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878899+0000", 2024-09-12T05:20:50.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0264e-05 2024-09-12T05:20:50.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878906+0000", 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2350000000000002e-06 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925046+0000", 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046139927999999997 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925059+0000", 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2463000000000001e-05 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23620 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5504283599999997, 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046148199000000001, 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23620 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878954+0000", 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1510000000000001e-06 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878959+0000", 2024-09-12T05:20:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5949999999999998e-06 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878975+0000", 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5790999999999998e-05 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878987+0000", 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1972e-05 2024-09-12T05:20:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925086+0000", 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046099049000000003 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925101+0000", 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4640999999999999e-05 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:24894 3.b 3:d0acdfbf:::rbd_data.1118d7e09baf.0000000000000041:e [read 324608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.4910038629999995, 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046214719000000001, 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.517 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 24894 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943307+0000", 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049300769999999997 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943313+0000", 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4749999999999998e-06 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943332+0000", 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8261e-05 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943341+0000", 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9409999999999996e-06 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984427+0000", 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041085932999999998 2024-09-12T05:20:50.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984510+0000", 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3432999999999999e-05 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984592+0000", 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599000000000003e-05 2024-09-12T05:20:50.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.522 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:50.522 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:50.522 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:50.524 INFO:teuthology.orchestra.run.smithi059.stdout:2072 write 0x2102e4f thru 0x2103984 (0xb36 bytes) 2024-09-12T05:20:50.524 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.525 INFO:teuthology.orchestra.run.smithi059.stdout:2075 read 0x40577a0 thru 0x405c328 (0x4b89 bytes) 2024-09-12T05:20:50.525 INFO:teuthology.orchestra.run.smithi059.stdout:2076 punch from 0x51b2543 to 0x51b8bfb, (0x66b8 bytes) 2024-09-12T05:20:50.525 INFO:teuthology.orchestra.run.smithi059.stdout:2077 read 0x59789e9 thru 0x597e811 (0x5e29 bytes) 2024-09-12T05:20:50.525 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.525 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.525 INFO:teuthology.orchestra.run.smithi059.stdout:2081 write 0x44610b3 thru 0x446e9c7 (0xd915 bytes) 2024-09-12T05:20:50.525 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.526 INFO:teuthology.orchestra.run.smithi059.stdout:2084 read 0x645ade9 thru 0x645d051 (0x2269 bytes) 2024-09-12T05:20:50.526 INFO:teuthology.orchestra.run.smithi059.stdout:2085 punch from 0x44d1ea9 to 0x44d653e, (0x4695 bytes) 2024-09-12T05:20:50.526 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.526 INFO:teuthology.orchestra.run.smithi059.stdout:2089 read 0x14c8253 thru 0x14cbc01 (0x39af bytes) 2024-09-12T05:20:50.528 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:50.531 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:50.520+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:50.533 INFO:teuthology.orchestra.run.smithi059.stdout:2090 read 0x4810719 thru 0x4811bb1 (0x1499 bytes) 2024-09-12T05:20:50.533 INFO:teuthology.orchestra.run.smithi059.stdout:2091 writesame 0xd3e1c4 thru 0xd428a3 data_size 0x3(0x46e0 bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2092 punch from 0x3b94ecf to 0x3b9aee3, (0x6014 bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2093 read 0x6556a44 thru 0x655795e (0xf1b bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2096 read 0x3820aab thru 0x3822139 (0x168f bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2097 read 0x85ded1 thru 0x8620c7 (0x41f7 bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2099 read 0x6a60ed7 thru 0x6a67b08 (0x6c32 bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2102 punch from 0x49e6de2 to 0x49f56ba, (0xe8d8 bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2103 read 0x6382881 thru 0x6383e14 (0x1594 bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2104 read 0x65d0ec9 thru 0x65dfd4f (0xee87 bytes) 2024-09-12T05:20:50.534 INFO:teuthology.orchestra.run.smithi059.stdout:2105 trunc from 0x6edb3e5 to 0x6e6d4fc 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2106 read 0x18224e8 thru 0x182c2b5 (0x9dce bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2108 write 0x5ffaea4 thru 0x6000922 (0x5a7f bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2109 write 0x4c067c0 thru 0x4c10504 (0x9d45 bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2111 punch from 0x290606f to 0x2914ec9, (0xee5a bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2113 write 0x1a3f653 thru 0x1a480a2 (0x8a50 bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2115 read 0x418de6e thru 0x419b6d9 (0xd86c bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2116 read 0xfed732 thru 0xff7753 (0xa022 bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2119 writesame 0x73930ee thru 0x739ab08 data_size 0x1(0x7a1b bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2120 trunc from 0x739ab09 to 0x93d549f 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2121 write 0x8a00eaa thru 0x8a0be66 (0xafbd bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2122 read 0x17b6e1f thru 0x17bd63f (0x6821 bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2123 write 0x61309c3 thru 0x61361b6 (0x57f4 bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2124 read 0x7501ef9 thru 0x7506382 (0x448a bytes) 2024-09-12T05:20:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:2125 trunc from 0x93d549f to 0x1f592ab 2024-09-12T05:20:50.570 INFO:teuthology.orchestra.run.smithi059.stdout:2126 write 0xdf5f722 thru 0xdf67a0a (0x82e9 bytes) 2024-09-12T05:20:50.578 INFO:teuthology.orchestra.run.smithi059.stdout:2128 trunc from 0xdf67a0b to 0xdb1320d 2024-09-12T05:20:50.594 INFO:teuthology.orchestra.run.smithi059.stdout:2130 read 0xc369caf thru 0xc3701ef (0x6541 bytes) 2024-09-12T05:20:50.594 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.610 INFO:teuthology.orchestra.run.smithi059.stdout:2132 trunc from 0xdb1320d to 0x5b1f679 2024-09-12T05:20:50.621 INFO:teuthology.orchestra.run.smithi059.stdout:2134 writesame 0x3a7cee1 thru 0x3a85c8f data_size 0x13(0x8daf bytes) 2024-09-12T05:20:50.625 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:50.624+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:2135 read 0x7e8179 thru 0x7f5453 (0xd2db bytes) 2024-09-12T05:20:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:2138 punch from 0x225356b to 0x22632cc, (0xfd61 bytes) 2024-09-12T05:20:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:2139 writesame 0x5c93bdf thru 0x5c999a6 data_size 0x4(0x5dc8 bytes) 2024-09-12T05:20:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:2141 read 0x41291ba thru 0x413550d (0xc354 bytes) 2024-09-12T05:20:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:2142 read 0x285b16d thru 0x285b7ab (0x63f bytes) 2024-09-12T05:20:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:2143 write 0x2690181 thru 0x269eaf5 (0xe975 bytes) 2024-09-12T05:20:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:2144 write 0x70d1d33 thru 0x70e053c (0xe80a bytes) 2024-09-12T05:20:50.666 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:50.666 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:50.666 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:50.667 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:2148 read 0x454e6b thru 0x46494d (0xfae3 bytes) 2024-09-12T05:20:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:2150 write 0xb8d571 thru 0xb9577a (0x820a bytes) 2024-09-12T05:20:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:2152 write 0x2118ebf thru 0x2122d68 (0x9eaa bytes) 2024-09-12T05:20:50.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:2153 write 0x4e1a12e thru 0x4e1d37f (0x3252 bytes) 2024-09-12T05:20:50.695 INFO:teuthology.orchestra.run.smithi059.stdout:2156 trunc from 0x70e053d to 0x5f2c6be 2024-09-12T05:20:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:2157 write 0x2203b0b thru 0x220e22c (0xa722 bytes) 2024-09-12T05:20:50.725 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:50.724+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:2158 punch from 0x1d75f29 to 0x1d853d5, (0xf4ac bytes) 2024-09-12T05:20:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:2160 read 0x3a1dbda thru 0x3a2cade (0xef05 bytes) 2024-09-12T05:20:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:2162 read 0x1355ffe thru 0x1360bb5 (0xabb8 bytes) 2024-09-12T05:20:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:2165 write 0xa8831fb thru 0xa88839e (0x51a4 bytes) 2024-09-12T05:20:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:2166 read 0x83c1f1 thru 0x83ca86 (0x896 bytes) 2024-09-12T05:20:50.772 INFO:teuthology.orchestra.run.smithi059.stdout:2168 writesame 0xa8ddc65 thru 0xa8ed4d8 data_size 0x2(0xf874 bytes) 2024-09-12T05:20:50.772 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.772 INFO:teuthology.orchestra.run.smithi059.stdout:2170 write 0x4bedb7f thru 0x4bf8c7a (0xb0fc bytes) 2024-09-12T05:20:50.779 INFO:teuthology.orchestra.run.smithi059.stdout:2171 write 0x15fd470 thru 0x1605c8d (0x881e bytes) 2024-09-12T05:20:50.790 INFO:teuthology.orchestra.run.smithi059.stdout:2172 read 0x9661717 thru 0x9667b10 (0x63fa bytes) 2024-09-12T05:20:50.815 INFO:teuthology.orchestra.run.smithi059.stdout:2173 trunc from 0xa8ed4d9 to 0xdec3b5 2024-09-12T05:20:50.826 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:50.824+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:50.854 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:50.854 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:50.855 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:50.855 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:50.855 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:50.857 INFO:teuthology.orchestra.run.smithi059.stdout:2174 read 0x80859f thru 0x80df0d (0x596f bytes) 2024-09-12T05:20:50.857 INFO:teuthology.orchestra.run.smithi059.stdout:2175 read 0xa87e4a thru 0xa8fd70 (0x7f27 bytes) 2024-09-12T05:20:50.869 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:50.886 INFO:teuthology.orchestra.run.smithi059.stdout:2176 write 0x58bfd14 thru 0x58c9676 (0x9963 bytes) 2024-09-12T05:20:50.927 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:50.924+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:50.930 INFO:teuthology.orchestra.run.smithi059.stdout:2177 writesame 0xc15e429 thru 0xc15e76e data_size 0x1(0x346 bytes) 2024-09-12T05:20:50.930 INFO:teuthology.orchestra.run.smithi059.stdout:2178 read 0x5fafc92 thru 0x5fbabc7 (0xaf36 bytes) 2024-09-12T05:20:50.930 INFO:teuthology.orchestra.run.smithi059.stdout:2179 read 0x656eff1 thru 0x65743b8 (0x53c8 bytes) 2024-09-12T05:20:50.930 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:50.930 INFO:teuthology.orchestra.run.smithi059.stdout:2181 writesame 0x29058f1 thru 0x290b059 data_size 0x1(0x5769 bytes) 2024-09-12T05:20:50.967 INFO:teuthology.orchestra.run.smithi059.stdout:2182 read 0x8a01bae thru 0x8a06f28 (0x537b bytes) 2024-09-12T05:20:50.967 INFO:teuthology.orchestra.run.smithi059.stdout:2185 read 0x2ee71df thru 0x2eec2ea (0x510c bytes) 2024-09-12T05:20:50.994 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4630 3.1a 3:5ebba714:::rbd_data.1118e5842253.0000000000000077:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.855614798000001, 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039742162999999997, 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4630 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138449+0000", 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138451+0000", 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9570000000000001e-06 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138461+0000", 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9760000000000007e-06 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138489+0000", 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7742999999999998e-05 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138504+0000", 2024-09-12T05:20:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4960000000000001e-05 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138608+0000", 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104053 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.138815+0000", 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000206832 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.145988+0000", 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071735109999999996 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.177998+0000", 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032009700000000002 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178028+0000", 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0209000000000002e-05 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178118+0000", 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9365999999999998e-05 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:22.178191+0000", 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3856000000000006e-05 2024-09-12T05:20:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10970 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.932974205000001, 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033399048000000001, 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10970 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061090+0000", 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061091+0000", 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1230000000000001e-06 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061096+0000", 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1000000000000003e-06 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061113+0000", 2024-09-12T05:20:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7227e-05 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061127+0000", 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3793e-05 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.093864+0000", 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032736994999999998 2024-09-12T05:20:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094052+0000", 2024-09-12T05:20:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018771799999999999 2024-09-12T05:20:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094489+0000", 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043709199999999998 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10971 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.932919542, 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033948741999999997, 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10971 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061145+0000", 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061146+0000", 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.167e-06 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061151+0000", 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8899999999999998e-06 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061167+0000", 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6578999999999998e-05 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061181+0000", 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3587000000000001e-05 2024-09-12T05:20:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094538+0000", 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033357568999999997 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.094672+0000", 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133323 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095093+0000", 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042162699999999999 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11031 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 303104~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.932506735, 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034486665, 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11031 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061557+0000", 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061559+0000", 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061568+0000", 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5329999999999994e-06 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061598+0000", 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0395999999999998e-05 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061618+0000", 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000001e-05 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095169+0000", 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033551105999999997 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095379+0000", 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021028999999999999 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096044+0000", 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00066456000000000002 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11032 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 352256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.932414169000001, 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035279433999999998, 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11032 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061650+0000", 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061651+0000", 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.44e-06 2024-09-12T05:20:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061658+0000", 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4529999999999999e-06 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061678+0000", 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0460000000000001e-05 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061693+0000", 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.468e-05 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096100+0000", 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034407364000000003 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096256+0000", 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015584799999999999 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096929+0000", 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00067318900000000004 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11033 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 401408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.932350190000001, 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036054468999999999, 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11033 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061714+0000", 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061715+0000", 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061722+0000", 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5740000000000001e-06 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061741+0000", 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061754+0000", 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3257e-05 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096997+0000", 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035242809 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097165+0000", 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000168839 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097768+0000", 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00060290099999999998 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11034 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 450560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.932291509999999, 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036605824000000002, 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11034 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061773+0000", 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061774+0000", 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.13e-06 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061779+0000", 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9169999999999997e-06 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061797+0000", 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7995999999999998e-05 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061810+0000", 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3753e-05 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097821+0000", 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036010845 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.097958+0000", 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137188 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098378+0000", 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041999499999999999 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.034 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11035 3.3 3:c5fe06d6:::rbd_data.1118f6d14695.0000000000000009:9 [read 499712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.932233621000002, 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037210007000000003, 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11035 2024-09-12T05:20:51.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061830+0000", 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061832+0000", 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.243e-06 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061842+0000", 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0067e-05 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061860+0000", 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7923000000000001e-05 2024-09-12T05:20:51.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.061873+0000", 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3277e-05 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098443+0000", 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036569628999999999 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.098601+0000", 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015857800000000001 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099040+0000", 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043929 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23755 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 354304~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.088030537, 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033578519000000001, 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.040 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23755 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906034+0000", 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2499999999999995e-07 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906036+0000", 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.092e-06 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906043+0000", 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906048+0000", 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1019999999999996e-06 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939392+0000", 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033344290999999998 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939469+0000", 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6792000000000006e-05 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939612+0000", 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014325699999999999 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23756 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 364544~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.088009323, 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033786347000000001, 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.045 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.046 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.046 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23756 2024-09-12T05:20:51.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.046 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906055+0000", 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4000000000000002e-07 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906057+0000", 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0080000000000001e-06 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906065+0000", 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9359999999999999e-06 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906070+0000", 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.259e-06 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939658+0000", 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033587287 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939732+0000", 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4666000000000006e-05 2024-09-12T05:20:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939841+0000", 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108651 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23757 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 374784~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087987119999999, 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033996597000000003, 2024-09-12T05:20:51.050 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23757 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906077+0000", 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4400000000000001e-07 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906084+0000", 2024-09-12T05:20:51.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999998e-06 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906091+0000", 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7000000000000002e-06 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906096+0000", 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9679999999999997e-06 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939885+0000", 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033789419000000001 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.939989+0000", 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010427100000000001 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940074+0000", 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4135000000000007e-05 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23758 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 401408~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.055 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087960804, 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034154898000000003, 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23758 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.056 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906103+0000", 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906104+0000", 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.89e-07 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906106+0000", 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.419e-06 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906112+0000", 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2720000000000003e-06 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906118+0000", 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1370000000000001e-06 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940114+0000", 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033996234 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940185+0000", 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0919000000000003e-05 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940258+0000", 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3428000000000002e-05 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23759 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 411648~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087938898000001, 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034344294999999997, 2024-09-12T05:20:51.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23759 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906125+0000", 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906126+0000", 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-07 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906129+0000", 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8100000000000002e-06 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906135+0000", 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6749999999999996e-06 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906140+0000", 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0660000000000003e-06 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940302+0000", 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034161206 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940385+0000", 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3415e-05 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940469+0000", 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4400999999999994e-05 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23760 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 421888~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087899055999999, 2024-09-12T05:20:51.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034485021999999997, 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23760 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:51.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906165+0000", 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906166+0000", 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9299999999999998e-07 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906168+0000", 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5600000000000001e-06 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906175+0000", 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3440000000000003e-06 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906181+0000", 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7799999999999997e-06 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940510+0000", 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034329163000000003 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940578+0000", 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7971000000000004e-05 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940650+0000", 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1611000000000003e-05 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23761 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 432128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087874465000001, 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034676953000000003, 2024-09-12T05:20:51.070 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23761 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906190+0000", 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906192+0000", 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2330000000000001e-06 2024-09-12T05:20:51.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906199+0000", 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906204+0000", 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.113e-06 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940691+0000", 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034486744 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940787+0000", 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5880999999999999e-05 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940867+0000", 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9692999999999997e-05 2024-09-12T05:20:51.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23762 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 458752~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087852836, 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034860442999999998, 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.075 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23762 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:51.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906211+0000", 2024-09-12T05:20:51.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906212+0000", 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906214+0000", 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9470000000000002e-06 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906220+0000", 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.302e-06 2024-09-12T05:20:51.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906226+0000", 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2929999999999997e-06 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940927+0000", 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034700380000000003 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.940998+0000", 2024-09-12T05:20:51.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1888e-05 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941072+0000", 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3182000000000005e-05 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23763 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 468992~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087830852, 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035048453, 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23763 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906233+0000", 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906234+0000", 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906236+0000", 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1720000000000001e-06 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906243+0000", 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906248+0000", 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3140000000000003e-06 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941118+0000", 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034869783000000001 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941199+0000", 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0906000000000001e-05 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941282+0000", 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3133999999999994e-05 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23764 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 479232~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087808855, 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035223974999999998, 2024-09-12T05:20:51.085 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23764 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906255+0000", 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906256+0000", 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4700000000000001e-07 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906258+0000", 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1289999999999999e-06 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906265+0000", 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3350000000000001e-06 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906271+0000", 2024-09-12T05:20:51.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941324+0000", 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035052899999999998 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941401+0000", 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7572999999999997e-05 2024-09-12T05:20:51.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941479+0000", 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8036999999999998e-05 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23765 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 489472~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087785521000001, 2024-09-12T05:20:51.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035401881000000003, 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23765 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:51.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:51.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906279+0000", 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906281+0000", 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1320000000000001e-06 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906289+0000", 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.977e-06 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906294+0000", 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941519+0000", 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035224917000000001 2024-09-12T05:20:51.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941589+0000", 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9978e-05 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941680+0000", 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1033999999999996e-05 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23766 3.3 3:c77c866f:::rbd_data.1118d7e09baf.0000000000000045:e [read 516096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.087761962, 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035572985000000001, 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23766 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.096 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906302+0000", 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906303+0000", 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2399999999999998e-07 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906305+0000", 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906311+0000", 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5169999999999996e-06 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.906316+0000", 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9749999999999998e-06 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941709+0000", 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035392161999999998 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941798+0000", 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9302000000000007e-05 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.941875+0000", 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7180000000000003e-05 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.100 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:51.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:20:51.103 INFO:teuthology.orchestra.run.smithi059.stdout:2189 trunc from 0xc15e76f to 0x1233c0e 2024-09-12T05:20:51.103 INFO:teuthology.orchestra.run.smithi059.stdout:2190 read 0x5998b9 thru 0x5a145e (0x7ba6 bytes) 2024-09-12T05:20:51.103 INFO:teuthology.orchestra.run.smithi059.stdout:2191 trunc from 0x1233c0e to 0x1015a1c 2024-09-12T05:20:51.103 INFO:teuthology.orchestra.run.smithi059.stdout:2192 read 0xf20636 thru 0xf2ce18 (0xc7e3 bytes) 2024-09-12T05:20:51.103 INFO:teuthology.orchestra.run.smithi059.stdout:2193 writesame 0x3ee9d14 thru 0x3ef9037 data_size 0xb6(0xf324 bytes) 2024-09-12T05:20:51.103 INFO:teuthology.orchestra.run.smithi059.stdout:2194 write 0x2d69255 thru 0x2d749da (0xb786 bytes) 2024-09-12T05:20:51.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:51.104 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:51.100+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:51.106 INFO:teuthology.orchestra.run.smithi059.stdout:2195 writesame 0xcef2843 thru 0xcef77b8 data_size 0x7(0x4f76 bytes) 2024-09-12T05:20:51.106 INFO:teuthology.orchestra.run.smithi059.stdout:2197 writesame 0x7398013 thru 0x739c3d7 data_size 0x1(0x43c5 bytes) 2024-09-12T05:20:51.135 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:51.135 INFO:teuthology.orchestra.run.smithi059.stdout:2199 read 0x8139814 thru 0x8140265 (0x6a52 bytes) 2024-09-12T05:20:51.135 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:51.136 INFO:teuthology.orchestra.run.smithi059.stdout:2202 read 0x8e85a96 thru 0x8e8a7f0 (0x4d5b bytes) 2024-09-12T05:20:51.136 INFO:teuthology.orchestra.run.smithi059.stdout:2203 writesame 0x98656e1 thru 0x9867ab3 data_size 0x1(0x23d3 bytes) 2024-09-12T05:20:51.151 INFO:teuthology.orchestra.run.smithi059.stdout:2204 write 0x42c3f5d thru 0x42c8b68 (0x4c0c bytes) 2024-09-12T05:20:51.157 INFO:teuthology.orchestra.run.smithi059.stdout:2205 write 0x3c1decf thru 0x3c24a66 (0x6b98 bytes) 2024-09-12T05:20:51.163 INFO:teuthology.orchestra.run.smithi059.stdout:2206 read 0x1ba6ffe thru 0x1bac94a (0x594d bytes) 2024-09-12T05:20:51.163 INFO:teuthology.orchestra.run.smithi059.stdout:2207 punch from 0x2c09a20 to 0x2c10e44, (0x7424 bytes) 2024-09-12T05:20:51.163 INFO:teuthology.orchestra.run.smithi059.stdout:2208 clone 14 order 18 su 1024 sc 14 2024-09-12T05:20:51.203 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:51.200+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:51.276 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:51.277 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:51.277 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:51.277 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:51.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:51.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:51.336+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:51.404 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:51.400+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:51.412 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:51.412 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:51.412 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:51.413 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:51.413 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:51.427 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:51.505 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:51.504+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:51.592 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4530 3.1d 3:b845397b:::rbd_object_map.1118e5842253:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.692574213, 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034828258000000001, 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4530 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898325+0000", 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898333+0000", 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3200000000000002e-06 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898372+0000", 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9403000000000002e-05 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898403+0000", 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1282999999999998e-05 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925774+0000", 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027371126999999999 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925885+0000", 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110536 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.926372+0000", 2024-09-12T05:20:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048729900000000001 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.931755+0000", 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053824099999999998 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.932970+0000", 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012150799999999999 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933079+0000", 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108736 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933152+0000", 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3910000000000002e-05 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.528748547999999, 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:20:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.528652524999998, 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:20:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:20:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.528593222000001, 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:20:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:20:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:20:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:20:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.528536515999999, 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:20:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:20:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.527509177999999, 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:20:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:20:51.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.527449320999999, 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:20:51.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.627 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.527361514999999, 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:20:51.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.526679077000001, 2024-09-12T05:20:51.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:51.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.636 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.526592465, 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.638 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:20:51.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:51.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:51.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:20:51.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:20:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:20:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:20:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:20:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:20:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:20:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:20:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:20:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:20:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:20:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:20:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:20:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:20:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11057 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.519910382999999, 2024-09-12T05:20:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034782517999999998, 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11057 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070989+0000", 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.268e-06 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071050+0000", 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0294000000000002e-05 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071068+0000", 2024-09-12T05:20:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8683000000000001e-05 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071083+0000", 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5167999999999999e-05 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105540+0000", 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034457039000000002 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105657+0000", 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116248 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105771+0000", 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113818 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22384 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.912475943, 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035328432999999999, 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22384 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678423+0000", 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:20:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678427+0000", 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999998e-06 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678436+0000", 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8589999999999994e-06 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678444+0000", 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4959999999999996e-06 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705279+0000", 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026834632000000001 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705520+0000", 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024076100000000001 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.706555+0000", 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001034933 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.710982+0000", 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044268010000000002 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713437+0000", 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024553029999999998 2024-09-12T05:20:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713623+0000", 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018639399999999999 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713751+0000", 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012766700000000001 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22385 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.912443834999999, 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037690591000000002, 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22385 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:20:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678459+0000", 2024-09-12T05:20:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7900000000000001e-06 2024-09-12T05:20:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678468+0000", 2024-09-12T05:20:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8890000000000008e-06 2024-09-12T05:20:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678475+0000", 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8800000000000002e-06 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708857+0000", 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030381907999999999 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708999+0000", 2024-09-12T05:20:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014186900000000001 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.709638+0000", 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063908400000000005 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715839+0000", 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062014890000000001 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715882+0000", 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3188000000000001e-05 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716026+0000", 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014375999999999999 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716145+0000", 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011903700000000001 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22386 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.912413643000001, 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040447601, 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22386 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678496+0000", 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0623e-05 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678506+0000", 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7890000000000006e-06 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678513+0000", 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1359999999999999e-06 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711185+0000", 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032671814 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711506+0000", 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321417 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.712538+0000", 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010313760000000001 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716256+0000", 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037188350000000002 2024-09-12T05:20:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718706+0000", 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024499159999999999 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718856+0000", 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015012900000000001 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718932+0000", 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5926000000000005e-05 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22387 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.912374431, 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040806824999999998, 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22387 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678525+0000", 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678529+0000", 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678538+0000", 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1060000000000006e-06 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678545+0000", 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0260000000000002e-06 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713870+0000", 2024-09-12T05:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035324960000000002 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714037+0000", 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167381 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714624+0000", 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058681300000000005 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718968+0000", 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043441749999999996 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719059+0000", 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1019000000000004e-05 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719151+0000", 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1157999999999997e-05 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719331+0000", 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000180201 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23350 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 329728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.745561394999999, 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037806736000000001, 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23350 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845338+0000", 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845340+0000", 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.289e-06 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845347+0000", 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845353+0000", 2024-09-12T05:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875603+0000", 2024-09-12T05:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030250139999999998 2024-09-12T05:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875670+0000", 2024-09-12T05:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6791999999999993e-05 2024-09-12T05:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.883144+0000", 2024-09-12T05:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007473553 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23728 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 503808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855361+0000", 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.735537253, 2024-09-12T05:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.03461289, 2024-09-12T05:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23728 2024-09-12T05:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855361+0000", 2024-09-12T05:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855361+0000", 2024-09-12T05:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855362+0000", 2024-09-12T05:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0070000000000001e-06 2024-09-12T05:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855365+0000", 2024-09-12T05:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0920000000000002e-06 2024-09-12T05:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855374+0000", 2024-09-12T05:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855381+0000", 2024-09-12T05:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6449999999999999e-06 2024-09-12T05:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.889827+0000", 2024-09-12T05:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034446188000000003 2024-09-12T05:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.889900+0000", 2024-09-12T05:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3365e-05 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.889974+0000", 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3798000000000001e-05 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23729 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 514048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.735507007000001, 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035315419000000001, 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23729 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855392+0000", 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855395+0000", 2024-09-12T05:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-12T05:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855403+0000", 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4980000000000006e-06 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855410+0000", 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6189999999999996e-06 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890120+0000", 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034710795000000003 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890630+0000", 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000509901 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890707+0000", 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6423999999999999e-05 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25449 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.293861904, 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036956818000000002, 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25449 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297037+0000", 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-07 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297041+0000", 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297052+0000", 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0866000000000001e-05 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297060+0000", 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7829999999999999e-06 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.327882+0000", 2024-09-12T05:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0308218 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328015+0000", 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133406 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328611+0000", 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059631400000000002 2024-09-12T05:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333062+0000", 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044503540000000001 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333708+0000", 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064637699999999995 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333878+0000", 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016978800000000001 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333993+0000", 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115344 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25659 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.030379065, 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035645679, 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25659 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560520+0000", 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560523+0000", 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0520000000000002e-06 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560529+0000", 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1330000000000004e-06 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560534+0000", 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589658+0000", 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029124035 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589799+0000", 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014103 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.590443+0000", 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064374400000000002 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.592625+0000", 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021819439999999999 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596057+0000", 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034316820000000001 2024-09-12T05:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596119+0000", 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2811999999999994e-05 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596165+0000", 2024-09-12T05:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5534999999999997e-05 2024-09-12T05:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:51.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:51.715 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:51.712+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:51.716 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:51.816 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:51.816+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:51.842 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:51.842 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:51.842 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:51.842 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:51.856 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:51.872 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:51.889 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:51.889 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:51.905 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:51.916 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:51.916+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:51.923 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:51.923 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:51.942 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:51.961 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:51.962 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:51.976 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:51.976 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:51.976 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:51.976 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:51.976 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:51.980 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:51.981 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:51.991 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:52.002 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:52.002 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:52.037 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:52.036+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:52.047 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:20:52.112 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:52.112 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:52.120 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:52.120+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:52.127 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:52.220 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:52.216+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:52.309 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:52.320 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:52.320+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:52.370 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-12T05:20:52.429 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:52.420+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:52.460 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:52.485 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:52.522 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:52.520+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:52.623 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:52.620+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:52.630 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:52.630 INFO:teuthology.orchestra.run.smithi059.stdout:2210 writesame 0x971fe1 thru 0x97a93a data_size 0x1(0x895a bytes) 2024-09-12T05:20:52.669 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:52.669 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:52.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:52.723 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:52.720+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:52.754 INFO:teuthology.orchestra.run.smithi059.stdout:2212 read 0x34e5f36 thru 0x34e8d45 (0x2e10 bytes) 2024-09-12T05:20:52.754 INFO:teuthology.orchestra.run.smithi059.stdout:2213 write 0xf6aa77 thru 0xf6b66d (0xbf7 bytes) 2024-09-12T05:20:52.762 INFO:teuthology.orchestra.run.smithi059.stdout:2214 clone 15 order 21 su 131072 sc 11 2024-09-12T05:20:52.822 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:52.822 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:52.824 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:52.820+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:52.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:52.928 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:52.928+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:53.008 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:53.008 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:53.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:53.064 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:53.064+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:53.126 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:53.124+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:53.188 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone14 from 0xcef77b9 (overlap 0xcef77b9) to 0x3e170b7 2024-09-12T05:20:53.198 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:53.198 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:53.220 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:53.264 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:53.264+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:53.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:53.324+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:53.382 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:53.382 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:53.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:53.450 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:53.448+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:53.529 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:53.528+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:53.613 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:53.613 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:53.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:53.631 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:53.628+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:53.732 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:53.732+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:53.833 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:53.832+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:53.835 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:53.835 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:53.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:53.933 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:53.932+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:54.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:54.028 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:54.028 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:54.034 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:54.032+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:54.038 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-12T05:20:54.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:54.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:20:54.142 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:54.140+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:54.180 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:54.198 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:54.198 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:54.215 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:54.216 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:54.230 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:54.230 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:54.230 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:54.230 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:54.230 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:54.236 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:54.232+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:54.236 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:54.236 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:54.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:54.257 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:54.258 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:54.278 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:54.278 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:54.299 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:54.320 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:54.320 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:54.336 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:54.336+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:54.374 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:54.374 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.396709465000001, 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.485077147999998, 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:20:54.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9013 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'63, mlcod=37'59)", 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.406500719, 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051699299999999997, 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969470+0000", 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6400000000000002e-07 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969476+0000", 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0440000000000001e-06 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969490+0000", 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3328e-05 2024-09-12T05:20:54.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969497+0000", 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2559999999999996e-06 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969563+0000", 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5879999999999999e-05 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.969589+0000", 2024-09-12T05:20:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5972000000000001e-05 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974583+0000", 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049945379999999998 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.974640+0000", 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6248000000000001e-05 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9885 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'109, mlcod=37'106)", 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.103135491, 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051369570000000002, 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272835+0000", 2024-09-12T05:20:54.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:54.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272840+0000", 2024-09-12T05:20:54.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1559999999999997e-06 2024-09-12T05:20:54.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272848+0000", 2024-09-12T05:20:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-06 2024-09-12T05:20:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272853+0000", 2024-09-12T05:20:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4569999999999998e-06 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272896+0000", 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3441e-05 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.272911+0000", 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4484000000000001e-05 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277923+0000", 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050118480000000002 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.277972+0000", 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9174e-05 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.102376664000001, 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.395 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:20:54.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10139 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'147, mlcod=37'142)", 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.934268758000002, 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051775290000000002, 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:54.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441706+0000", 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.985e-06 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441716+0000", 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3810000000000005e-06 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441722+0000", 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441772+0000", 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9465999999999997e-05 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441792+0000", 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0560999999999998e-05 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446825+0000", 2024-09-12T05:20:54.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050325259999999998 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446879+0000", 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999999e-05 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.868333017000001, 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:20:54.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.838208686000002, 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:20:54.409 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:20:54.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.413 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.276120904999999, 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:20:54.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:20:54.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.274166687000001, 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:20:54.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11437 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'65, mlcod=38'62)", 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.271285575, 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049658940000000002, 2024-09-12T05:20:54.423 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104685+0000", 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104691+0000", 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0979999999999999e-06 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104702+0000", 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0611999999999999e-05 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.104711+0000", 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107402+0000", 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026907889999999999 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107423+0000", 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1035000000000001e-05 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109616+0000", 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021936870000000002 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.109651+0000", 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4434999999999998e-05 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.427 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.332857953000001, 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:20:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.316261359999999, 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20160 3.0 e44/23 3:00225d41:::rbd_data.1118d7e09baf.0000000000000056:head v 44'214, mlcod=43'212)", 2024-09-12T05:20:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.147747541000001, 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049886230000000002, 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228223+0000", 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228224+0000", 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0699999999999999e-06 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228232+0000", 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228254+0000", 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2507e-05 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228264+0000", 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6900000000000004e-06 2024-09-12T05:20:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228350+0000", 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5877999999999993e-05 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.228378+0000", 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7976000000000001e-05 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.233084+0000", 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047061580000000002 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.233211+0000", 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012753499999999999 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.145921919999999, 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:20:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:20:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.2674676680000001, 2024-09-12T05:20:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.2674225739999994, 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:20:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:20:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.2588610130000006, 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:20:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.4568228540000003, 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:20:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:42174 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'386, mlcod=51'383)", 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.0083288570000004, 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052593079999999999, 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367642+0000", 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367649+0000", 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2400000000000001e-06 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367663+0000", 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3728e-05 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367672+0000", 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7919999999999998e-06 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367768+0000", 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5934999999999995e-05 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367792+0000", 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3581999999999999e-05 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.372851+0000", 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050593410000000002 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.372901+0000", 2024-09-12T05:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9919000000000001e-05 2024-09-12T05:20:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.471 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:54.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:54.473 INFO:teuthology.orchestra.run.smithi059.stdout:2215 trunc from 0xcef77b9 to 0x1dcbba8 2024-09-12T05:20:54.473 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:54.472+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:54.534 INFO:teuthology.orchestra.run.smithi059.stdout:2216 read 0x9b413a thru 0x9b9ca9 (0x5b70 bytes) 2024-09-12T05:20:54.536 INFO:teuthology.orchestra.run.smithi059.stdout:2217 clone 16 order 23 su 1048576 sc 7 2024-09-12T05:20:54.573 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:54.572+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:54.632 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:54.632 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:54.632 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:20:54.633 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:54.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:54.674 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:54.672+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:54.775 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:54.772+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:54.815 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:54.816 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:54.816 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:54.816 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:54.816 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:54.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:54.876 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:54.872+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:54.956 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:54.956 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:54.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:54.957 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:54.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.957 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23601 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.957 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:54.957 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078833556999999, 2024-09-12T05:20:54.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046132175999999997, 2024-09-12T05:20:54.957 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23601 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877967+0000", 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9299999999999996e-07 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877970+0000", 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6600000000000001e-06 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877987+0000", 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7033000000000001e-05 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877997+0000", 2024-09-12T05:20:54.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8970000000000003e-06 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924083+0000", 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046086037000000003 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924098+0000", 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4656e-05 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23602 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078750655, 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046134982999999997, 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.962 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23602 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878050+0000", 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0299999999999998e-07 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878060+0000", 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0008e-05 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878069+0000", 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0699999999999996e-06 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878076+0000", 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8990000000000004e-06 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924152+0000", 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046076735000000001 2024-09-12T05:20:54.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924184+0000", 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1467999999999998e-05 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23604 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078682264999999, 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046158181, 2024-09-12T05:20:54.966 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23604 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:54.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:54.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878118+0000", 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7299999999999996e-07 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878120+0000", 2024-09-12T05:20:54.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.694e-06 2024-09-12T05:20:54.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878128+0000", 2024-09-12T05:20:54.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5320000000000001e-06 2024-09-12T05:20:54.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878134+0000", 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.083e-06 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924258+0000", 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046123551999999998 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924275+0000", 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7747000000000001e-05 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23605 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078653584, 2024-09-12T05:20:54.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046181315000000001, 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23605 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878147+0000", 2024-09-12T05:20:54.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5000000000000001e-07 2024-09-12T05:20:54.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878149+0000", 2024-09-12T05:20:54.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5150000000000001e-06 2024-09-12T05:20:54.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878168+0000", 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8505e-05 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878174+0000", 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5250000000000002e-06 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924319+0000", 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046145149000000003 2024-09-12T05:20:54.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924327+0000", 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7710000000000006e-06 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23606 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078615528, 2024-09-12T05:20:54.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046204501000000002, 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23606 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:54.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878187+0000", 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.667e-06 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878195+0000", 2024-09-12T05:20:54.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7319999999999998e-06 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878201+0000", 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.489e-06 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924374+0000", 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046172264999999997 2024-09-12T05:20:54.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924388+0000", 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4762e-05 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23607 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:54.982 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078553719, 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046215282000000003, 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23607 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3200000000000004e-07 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878250+0000", 2024-09-12T05:20:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1920000000000001e-06 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878258+0000", 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4279999999999996e-06 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878265+0000", 2024-09-12T05:20:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9539999999999998e-06 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924447+0000", 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046182198000000001 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924461+0000", 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3678e-05 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23608 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078479066, 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046219194999999998, 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23608 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878321+0000", 2024-09-12T05:20:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5899999999999995e-07 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878324+0000", 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9220000000000001e-06 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878332+0000", 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0620000000000001e-06 2024-09-12T05:20:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878339+0000", 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6440000000000003e-06 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924512+0000", 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046173120999999998 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924540+0000", 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7586999999999999e-05 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23609 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078451558999999, 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046254423000000003, 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23609 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878349+0000", 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4499999999999996e-07 2024-09-12T05:20:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878351+0000", 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7180000000000001e-06 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878368+0000", 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6801000000000001e-05 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878376+0000", 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3649999999999998e-06 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924593+0000", 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046217113999999997 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924602+0000", 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5799999999999998e-06 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23610 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078403623, 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046255375000000001, 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:54.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23610 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878399+0000", 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9919999999999999e-06 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878407+0000", 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9650000000000008e-06 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878414+0000", 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:54.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924641+0000", 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046226972999999998 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924651+0000", 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.03e-05 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23611 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078369335, 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046240949000000003, 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23611 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878431+0000", 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4099999999999999e-07 2024-09-12T05:20:55.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878433+0000", 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.632e-06 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878443+0000", 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0104e-05 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878450+0000", 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2620000000000004e-06 2024-09-12T05:20:55.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924666+0000", 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046216672 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924671+0000", 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:20:55.004 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23612 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078341521, 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046245959000000003, 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23612 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878459+0000", 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1900000000000001e-07 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878461+0000", 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4930000000000001e-06 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878473+0000", 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1756000000000001e-05 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878480+0000", 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7170000000000002e-06 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924694+0000", 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046214660999999997 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924704+0000", 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5130000000000002e-06 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23613 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078271303999999, 2024-09-12T05:20:55.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046232418999999997, 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23613 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:55.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878529+0000", 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.367e-06 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878535+0000", 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9680000000000003e-06 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878554+0000", 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8513e-05 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878567+0000", 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3492000000000001e-05 2024-09-12T05:20:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924749+0000", 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046181148999999998 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924760+0000", 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1929999999999999e-05 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23614 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078211536, 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046230298000000003, 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23614 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.014 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:55.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878589+0000", 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2750000000000001e-06 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878603+0000", 2024-09-12T05:20:55.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3626e-05 2024-09-12T05:20:55.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878618+0000", 2024-09-12T05:20:55.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5671999999999998e-05 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878631+0000", 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2206e-05 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924805+0000", 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046174814000000002 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924818+0000", 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2704999999999999e-05 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23615 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078147763, 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046210418000000003, 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.019 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23615 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878653+0000", 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.173e-06 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878658+0000", 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8890000000000001e-06 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878673+0000", 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5580999999999999e-05 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878687+0000", 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3565e-05 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924851+0000", 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046164226000000003 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924862+0000", 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0984e-05 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23616 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078076695, 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046184362, 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.024 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23616 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:55.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878724+0000", 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.649e-06 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878730+0000", 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878748+0000", 2024-09-12T05:20:55.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7271000000000001e-05 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878760+0000", 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2564e-05 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924897+0000", 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046136542000000003 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924907+0000", 2024-09-12T05:20:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0358e-05 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23617 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.078019954, 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046182312000000003, 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.028 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23617 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878781+0000", 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878786+0000", 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2850000000000002e-06 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878802+0000", 2024-09-12T05:20:55.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5837000000000001e-05 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878814+0000", 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2228e-05 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924949+0000", 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046135352999999997 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924962+0000", 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2255e-05 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23618 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.077964883, 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046185865, 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.032 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23618 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878835+0000", 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8199999999999998e-07 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878839+0000", 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5279999999999999e-06 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878848+0000", 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.653e-06 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878854+0000", 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6930000000000001e-06 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925008+0000", 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046153753999999998 2024-09-12T05:20:55.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925020+0000", 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2354999999999999e-05 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23619 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:55.036 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.077914431, 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046173694000000001, 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23619 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878886+0000", 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7400000000000003e-07 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878889+0000", 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878899+0000", 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0264e-05 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878906+0000", 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2350000000000002e-06 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925046+0000", 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046139927999999997 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925059+0000", 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2463000000000001e-05 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.040 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23620 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.077846985000001, 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046148199000000001, 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23620 2024-09-12T05:20:55.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878954+0000", 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1510000000000001e-06 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878959+0000", 2024-09-12T05:20:55.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5949999999999998e-06 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878975+0000", 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5790999999999998e-05 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878987+0000", 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1972e-05 2024-09-12T05:20:55.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925086+0000", 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046099049000000003 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925101+0000", 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4640999999999999e-05 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:24894 3.b 3:d0acdfbf:::rbd_data.1118d7e09baf.0000000000000041:e [read 324608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.018422488000001, 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046214719000000001, 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.046 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 24894 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943307+0000", 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049300769999999997 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943313+0000", 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4749999999999998e-06 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943332+0000", 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8261e-05 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943341+0000", 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9409999999999996e-06 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984427+0000", 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041085932999999998 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984510+0000", 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3432999999999999e-05 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984592+0000", 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599000000000003e-05 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:55.050 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:55.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:55.053 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:55.048+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:55.074 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:20:55.153 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:55.152+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:55.155 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:20:55.156 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:20:55.156 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T05:20:55.156 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.803534 2024-09-12T05:20:55.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.8035337120064497 2024-09-12T05:20:55.192 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:55.192 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:55.192 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:55.193 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:55.206 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone15 from 0x1dcbba8 (overlap 0x1dcbba8) to 0x0 2024-09-12T05:20:55.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:55.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:55.296+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:55.354 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:55.352+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:55.442 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:55.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:55.484+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:55.559 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:55.556+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:55.594 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53063 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316741+0000", 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29193266299999998, 2024-09-12T05:20:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043028697999999997, 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53063 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316741+0000", 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316741+0000", 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316741+0000", 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1699999999999998e-07 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316744+0000", 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.238e-06 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316747+0000", 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8089999999999999e-06 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316750+0000", 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8600000000000001e-06 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359688+0000", 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042937930999999999 2024-09-12T05:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359723+0000", 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4861999999999999e-05 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359769+0000", 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6480999999999998e-05 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53064 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316754+0000", 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29191930300000002, 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043120721000000001, 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53064 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316754+0000", 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316754+0000", 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316754+0000", 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-12T05:20:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316756+0000", 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.077e-06 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316759+0000", 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9840000000000001e-06 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316761+0000", 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.756e-06 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359795+0000", 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043033585999999999 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359829+0000", 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4335000000000002e-05 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359875+0000", 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5649000000000003e-05 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53065 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 144384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316765+0000", 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.291908852, 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216355999999997, 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53065 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316765+0000", 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316765+0000", 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316765+0000", 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1299999999999999e-07 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316766+0000", 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.068e-06 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316769+0000", 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.914e-06 2024-09-12T05:20:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316771+0000", 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.616e-06 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359900+0000", 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043128566 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359934+0000", 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4405e-05 2024-09-12T05:20:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359981+0000", 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6573999999999998e-05 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53066 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316775+0000", 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29189886100000001, 2024-09-12T05:20:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043313202000000002, 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53066 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316775+0000", 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316775+0000", 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316775+0000", 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3200000000000001e-07 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316776+0000", 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7900000000000007e-07 2024-09-12T05:20:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316779+0000", 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.819e-06 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316781+0000", 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.711e-06 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360007+0000", 2024-09-12T05:20:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043225461 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360041+0000", 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4584e-05 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360088+0000", 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6415999999999997e-05 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53067 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 173056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316784+0000", 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29188903300000002, 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043412596999999997, 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53067 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316784+0000", 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316784+0000", 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316785+0000", 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1299999999999999e-07 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316786+0000", 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0210000000000001e-06 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316789+0000", 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9720000000000001e-06 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316791+0000", 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7219999999999999e-06 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360113+0000", 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043321717000000003 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360148+0000", 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4678999999999998e-05 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360197+0000", 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9273000000000001e-05 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53068 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316794+0000", 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29187897000000002, 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043508646999999998, 2024-09-12T05:20:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53068 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316794+0000", 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316794+0000", 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316795+0000", 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3799999999999999e-07 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316796+0000", 2024-09-12T05:20:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.062e-06 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316799+0000", 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8289999999999999e-06 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316804+0000", 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6729999999999997e-06 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360221+0000", 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043417224999999997 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360256+0000", 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4795000000000001e-05 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360303+0000", 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6825e-05 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53069 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 131072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316808+0000", 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29186589800000001, 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043601422000000001, 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53069 2024-09-12T05:20:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316808+0000", 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316808+0000", 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316808+0000", 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.35e-07 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316809+0000", 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2389999999999999e-06 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316812+0000", 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316815+0000", 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3409999999999999e-06 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360328+0000", 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043513138 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360363+0000", 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4502000000000003e-05 2024-09-12T05:20:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360409+0000", 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6022000000000001e-05 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53070 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 145408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316819+0000", 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.291854844, 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043696608999999997, 2024-09-12T05:20:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53070 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316819+0000", 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316819+0000", 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316819+0000", 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316820+0000", 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1710000000000001e-06 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316823+0000", 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9239999999999999e-06 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316826+0000", 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7700000000000002e-06 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360434+0000", 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043608338000000003 2024-09-12T05:20:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360469+0000", 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5037999999999999e-05 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360515+0000", 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6128000000000003e-05 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53071 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 159744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316829+0000", 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.291844618, 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043796509999999997, 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53071 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316829+0000", 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316829+0000", 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316829+0000", 2024-09-12T05:20:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316830+0000", 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.116e-06 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316833+0000", 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.841e-06 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316836+0000", 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.729e-06 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360542+0000", 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043706765000000002 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360578+0000", 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5675e-05 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360625+0000", 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7144000000000001e-05 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53072 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316840+0000", 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29183373699999998, 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043896499999999998, 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53072 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316840+0000", 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316840+0000", 2024-09-12T05:20:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316840+0000", 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316841+0000", 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9199999999999999e-07 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316844+0000", 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0869999999999998e-06 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316847+0000", 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8990000000000001e-06 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360652+0000", 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043805397000000003 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360688+0000", 2024-09-12T05:20:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6189000000000002e-05 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360736+0000", 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7704999999999998e-05 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53073 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 188416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316850+0000", 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29182328899999999, 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043994617, 2024-09-12T05:20:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53073 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316850+0000", 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316850+0000", 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316850+0000", 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3200000000000001e-07 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316855+0000", 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0880000000000002e-06 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316859+0000", 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5260000000000002e-06 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316862+0000", 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6630000000000002e-06 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360762+0000", 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043900198000000001 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360797+0000", 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5170999999999999e-05 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360845+0000", 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7738999999999998e-05 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53074 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 132096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316865+0000", 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.291808334, 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044086368000000001, 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53074 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316865+0000", 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316865+0000", 2024-09-12T05:20:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316865+0000", 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316866+0000", 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316869+0000", 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9170000000000002e-06 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316873+0000", 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.393e-06 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360870+0000", 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043996809999999997 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360905+0000", 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5271999999999997e-05 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360951+0000", 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6622000000000002e-05 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53075 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316877+0000", 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29179686900000001, 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044183716999999997, 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53075 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316877+0000", 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316877+0000", 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316877+0000", 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316878+0000", 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.099e-06 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316882+0000", 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9759999999999997e-06 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316885+0000", 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9229999999999998e-06 2024-09-12T05:20:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360979+0000", 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044093827000000002 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361014+0000", 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5188000000000003e-05 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361060+0000", 2024-09-12T05:20:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6492000000000001e-05 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53076 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 160768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316888+0000", 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29178517199999998, 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044281181000000003, 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53076 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316888+0000", 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316888+0000", 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316888+0000", 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4400000000000001e-07 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316890+0000", 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316893+0000", 2024-09-12T05:20:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0290000000000001e-06 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316895+0000", 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.616e-06 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361085+0000", 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044190264 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361120+0000", 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4239999999999997e-05 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361169+0000", 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9691000000000002e-05 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53077 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 175104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316898+0000", 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29177493700000001, 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044377626000000003, 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53077 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316898+0000", 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316898+0000", 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316899+0000", 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0400000000000002e-07 2024-09-12T05:20:55.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316900+0000", 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316903+0000", 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316906+0000", 2024-09-12T05:20:55.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.128e-06 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361195+0000", 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044288974000000002 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361230+0000", 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4736000000000001e-05 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361276+0000", 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6406000000000003e-05 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53078 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316924+0000", 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29174939500000002, 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044464407999999997, 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53078 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316924+0000", 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316924+0000", 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316924+0000", 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316926+0000", 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.325e-06 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316929+0000", 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.394e-06 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316932+0000", 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8629999999999999e-06 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361303+0000", 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044370700999999999 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361337+0000", 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4150000000000003e-05 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361388+0000", 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1539000000000002e-05 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53079 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 133120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.682 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316936+0000", 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29173760300000001, 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044562729000000002, 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53079 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316936+0000", 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316936+0000", 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316938+0000", 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7370000000000001e-06 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316939+0000", 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4160000000000001e-06 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316942+0000", 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.027e-06 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316949+0000", 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5939999999999999e-06 2024-09-12T05:20:55.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361415+0000", 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044466404000000001 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361450+0000", 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4653000000000002e-05 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361499+0000", 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8897999999999998e-05 2024-09-12T05:20:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53080 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 147456~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316952+0000", 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29172100400000001, 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044653224999999998, 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53080 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316952+0000", 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316952+0000", 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317246+0000", 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029351300000000002 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317249+0000", 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.563e-06 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317259+0000", 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6080000000000002e-06 2024-09-12T05:20:55.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317266+0000", 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5760000000000002e-06 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361524+0000", 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044257913000000003 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361559+0000", 2024-09-12T05:20:55.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4919000000000002e-05 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361606+0000", 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7132999999999997e-05 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53081 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.317276+0000", 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29139709200000002, 2024-09-12T05:20:55.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044447685000000001, 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53081 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317276+0000", 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317276+0000", 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317277+0000", 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7899999999999999e-07 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317279+0000", 2024-09-12T05:20:55.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.345e-06 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317286+0000", 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3949999999999998e-06 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317290+0000", 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9450000000000001e-06 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361634+0000", 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044343936 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361671+0000", 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6405000000000001e-05 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361724+0000", 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3180000000000002e-05 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53082 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 176128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.317297+0000", 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.29137634600000001, 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044536918000000002, 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53082 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317297+0000", 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317297+0000", 2024-09-12T05:20:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.323457+0000", 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006160095 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.323462+0000", 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1139999999999997e-06 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:55.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.323486+0000", 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3496999999999999e-05 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.323760+0000", 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027389200000000003 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361750+0000", 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037990124 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361786+0000", 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5926000000000001e-05 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361834+0000", 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8269999999999997e-05 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:55.700 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:55.702 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:55.709 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:55.700+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:55.802 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:55.800+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:55.874 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:20:55.917 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:55.916+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:55.994 INFO:teuthology.orchestra.run.smithi059.stdout:2218 trunc from 0x1dcbba8 to 0x5646bde 2024-09-12T05:20:56.004 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:56.000+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:56.012 INFO:teuthology.orchestra.run.smithi059.stdout:2219 write 0x512c67a thru 0x512daf4 (0x147b bytes) 2024-09-12T05:20:56.018 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:56.018 INFO:teuthology.orchestra.run.smithi059.stdout:2222 writesame 0x2a75d10 thru 0x2a7681a data_size 0x1(0xb0b bytes) 2024-09-12T05:20:56.039 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:56.039 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:56.056 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:20:56.059 INFO:teuthology.orchestra.run.smithi059.stdout:2223 write 0x4bdb70a thru 0x4beabc0 (0xf4b7 bytes) 2024-09-12T05:20:56.077 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.0 primary-affinity to 0.803534 (8526602) 2024-09-12T05:20:56.077 INFO:teuthology.orchestra.run.smithi059.stdout:2224 trunc from 0x5646bde to 0x976ba2 2024-09-12T05:20:56.105 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:56.104+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:56.191 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4530 3.1d 3:b845397b:::rbd_object_map.1118e5842253:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.292163643000002, 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034828258000000001, 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4530 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:20:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898325+0000", 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898333+0000", 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3200000000000002e-06 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898372+0000", 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9403000000000002e-05 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898403+0000", 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1282999999999998e-05 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925774+0000", 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027371126999999999 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925885+0000", 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110536 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.926372+0000", 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048729900000000001 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.931755+0000", 2024-09-12T05:20:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053824099999999998 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.932970+0000", 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012150799999999999 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933079+0000", 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108736 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933152+0000", 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3910000000000002e-05 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.128337978000001, 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:20:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.128241955, 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:20:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:20:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.128182652, 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:20:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:20:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:20:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.128125946000001, 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:20:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:20:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.127098608000001, 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:20:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:20:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.127038751000001, 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:20:56.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:20:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.126950945000001, 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:20:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:20:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:20:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:20:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.126268506999999, 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:20:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:20:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.126181894999998, 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:20:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11057 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.119499813000001, 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034782517999999998, 2024-09-12T05:20:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11057 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070989+0000", 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.268e-06 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071050+0000", 2024-09-12T05:20:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0294000000000002e-05 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071068+0000", 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8683000000000001e-05 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071083+0000", 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5167999999999999e-05 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105540+0000", 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034457039000000002 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105657+0000", 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116248 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105771+0000", 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113818 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22384 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.512065373, 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035328432999999999, 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22384 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678423+0000", 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678427+0000", 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999998e-06 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678436+0000", 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8589999999999994e-06 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678444+0000", 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4959999999999996e-06 2024-09-12T05:20:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705279+0000", 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026834632000000001 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705520+0000", 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024076100000000001 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.706555+0000", 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001034933 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.710982+0000", 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044268010000000002 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713437+0000", 2024-09-12T05:20:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024553029999999998 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713623+0000", 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018639399999999999 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713751+0000", 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012766700000000001 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22385 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.512033264999999, 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037690591000000002, 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22385 2024-09-12T05:20:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678459+0000", 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7900000000000001e-06 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678468+0000", 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8890000000000008e-06 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678475+0000", 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8800000000000002e-06 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708857+0000", 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030381907999999999 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708999+0000", 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014186900000000001 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.709638+0000", 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063908400000000005 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715839+0000", 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062014890000000001 2024-09-12T05:20:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715882+0000", 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3188000000000001e-05 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716026+0000", 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014375999999999999 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716145+0000", 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011903700000000001 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22386 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.512003073000001, 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040447601, 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22386 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678496+0000", 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0623e-05 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678506+0000", 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7890000000000006e-06 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678513+0000", 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1359999999999999e-06 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711185+0000", 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032671814 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711506+0000", 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321417 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.712538+0000", 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010313760000000001 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716256+0000", 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037188350000000002 2024-09-12T05:20:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718706+0000", 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024499159999999999 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718856+0000", 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015012900000000001 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718932+0000", 2024-09-12T05:20:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5926000000000005e-05 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22387 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.511963861, 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040806824999999998, 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22387 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678525+0000", 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678529+0000", 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678538+0000", 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1060000000000006e-06 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678545+0000", 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0260000000000002e-06 2024-09-12T05:20:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713870+0000", 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035324960000000002 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714037+0000", 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167381 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714624+0000", 2024-09-12T05:20:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058681300000000005 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718968+0000", 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043441749999999996 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719059+0000", 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1019000000000004e-05 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719151+0000", 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1157999999999997e-05 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719331+0000", 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000180201 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23350 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 329728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.345150824999999, 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037806736000000001, 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23350 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845338+0000", 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845340+0000", 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.289e-06 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845347+0000", 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845353+0000", 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:20:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875603+0000", 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030250139999999998 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875670+0000", 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6791999999999993e-05 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.883144+0000", 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007473553 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23729 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 514048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.335096437000001, 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035315419000000001, 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23729 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855392+0000", 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855395+0000", 2024-09-12T05:20:56.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855403+0000", 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4980000000000006e-06 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855410+0000", 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6189999999999996e-06 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890120+0000", 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034710795000000003 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890630+0000", 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000509901 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890707+0000", 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6423999999999999e-05 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.279 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25449 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.893451334, 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036956818000000002, 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25449 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297037+0000", 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-07 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297041+0000", 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297052+0000", 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0866000000000001e-05 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297060+0000", 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7829999999999999e-06 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.327882+0000", 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0308218 2024-09-12T05:20:56.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328015+0000", 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133406 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328611+0000", 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059631400000000002 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333062+0000", 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044503540000000001 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333708+0000", 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064637699999999995 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333878+0000", 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016978800000000001 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333993+0000", 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115344 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25659 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.629968495, 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035645679, 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.286 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25659 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560520+0000", 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560523+0000", 2024-09-12T05:20:56.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0520000000000002e-06 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560529+0000", 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1330000000000004e-06 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560534+0000", 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589658+0000", 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029124035 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589799+0000", 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014103 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.590443+0000", 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064374400000000002 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:56.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.592625+0000", 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021819439999999999 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596057+0000", 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034316820000000001 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596119+0000", 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2811999999999994e-05 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596165+0000", 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5534999999999997e-05 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:54069 3.5 3:a432e2c0:::rbd_data.1118bf17036a.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.76355254299999997, 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037526320000000002, 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:56.292 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 54069 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426936+0000", 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431511+0000", 2024-09-12T05:20:56.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045748780000000001 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431528+0000", 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7353000000000001e-05 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431546+0000", 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.825e-05 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431625+0000", 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8514000000000001e-05 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431706+0000", 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1582999999999995e-05 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.432261+0000", 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000554997 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.450928+0000", 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018666187000000001 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464396+0000", 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013468707 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464436+0000", 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9338000000000002e-05 2024-09-12T05:20:56.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464462+0000", 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5891999999999999e-05 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:56.298 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:56.300 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:20:56.300 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:56.296+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:56.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:20:56.400 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:56.400+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:56.422 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:56.422 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:56.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:20:56.501 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:56.500+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:56.508 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:56.508 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:56.525 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:56.525 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:56.542 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:56.554 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:56.554 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:56.554 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:56.554 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:56.554 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:56.559 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:56.560 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:56.568 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:20:56.579 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:56.597 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:56.613 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:56.612+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:56.615 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:56.633 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:56.633 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:56.690 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:56.690 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:56.703 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:56.700+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:56.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:20:56.803 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:56.800+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:56.871 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:56.871 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:56.885 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:20:56.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:56.928+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:57.006 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:57.004+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:57.007 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:57.008 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:57.022 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:20:57.100 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:20:57.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:57.108+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:57.120 INFO:teuthology.orchestra.run.smithi059.stdout:2225 punch from 0x7ff46 to 0x89f9c, (0xa056 bytes) 2024-09-12T05:20:57.151 INFO:teuthology.orchestra.run.smithi059.stdout:2226 writesame 0x996856e thru 0x996fd63 data_size 0x25(0x77f6 bytes) 2024-09-12T05:20:57.151 INFO:teuthology.orchestra.run.smithi059.stdout:2227 write 0x28deebe thru 0x28e322f (0x4372 bytes) 2024-09-12T05:20:57.153 INFO:teuthology.orchestra.run.smithi059.stdout:2228 punch from 0x7f64429 to 0x7f6b1ed, (0x6dc4 bytes) 2024-09-12T05:20:57.153 INFO:teuthology.orchestra.run.smithi059.stdout:2229 punch from 0x6ed3435 to 0x6ed48e1, (0x14ac bytes) 2024-09-12T05:20:57.153 INFO:teuthology.orchestra.run.smithi059.stdout:2230 write 0x578e9f3 thru 0x579189b (0x2ea9 bytes) 2024-09-12T05:20:57.158 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:57.158 INFO:teuthology.orchestra.run.smithi059.stdout:2233 write 0x4959b71 thru 0x495a356 (0x7e6 bytes) 2024-09-12T05:20:57.161 INFO:teuthology.orchestra.run.smithi059.stdout:2235 read 0x4ea3f10 thru 0x4ea684d (0x293e bytes) 2024-09-12T05:20:57.161 INFO:teuthology.orchestra.run.smithi059.stdout:2237 write 0x4d2ce97 thru 0x4d2e98a (0x1af4 bytes) 2024-09-12T05:20:57.166 INFO:teuthology.orchestra.run.smithi059.stdout:2238 write 0x76f3d4a thru 0x76ff0e7 (0xb39e bytes) 2024-09-12T05:20:57.176 INFO:teuthology.orchestra.run.smithi059.stdout:2240 writesame 0x6c84514 thru 0x6c9045a data_size 0x1(0xbf47 bytes) 2024-09-12T05:20:57.196 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:57.196 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:57.207 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:57.204+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:57.210 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:20:57.223 INFO:teuthology.orchestra.run.smithi059.stdout:2241 read 0x4da9643 thru 0x4db11a0 (0x7b5e bytes) 2024-09-12T05:20:57.232 INFO:teuthology.orchestra.run.smithi059.stdout:2242 trunc from 0x996fd64 to 0x46804aa 2024-09-12T05:20:57.250 INFO:teuthology.orchestra.run.smithi059.stdout:2244 write 0x1bf0d0a thru 0x1bfbd55 (0xb04c bytes) 2024-09-12T05:20:57.271 INFO:teuthology.orchestra.run.smithi059.stdout:2245 write 0xb4906e4 thru 0xb4972b6 (0x6bd3 bytes) 2024-09-12T05:20:57.275 INFO:teuthology.orchestra.run.smithi059.stdout:2246 read 0xa974d6c thru 0xa983e9c (0xf131 bytes) 2024-09-12T05:20:57.280 INFO:teuthology.orchestra.run.smithi059.stdout:2247 trunc from 0xb4972b7 to 0xecdd57e 2024-09-12T05:20:57.287 INFO:teuthology.orchestra.run.smithi059.stdout:2248 write 0xe692355 thru 0xe69f039 (0xcce5 bytes) 2024-09-12T05:20:57.300 INFO:teuthology.orchestra.run.smithi059.stdout:2249 trunc from 0xecdd57e to 0xb87eb39 2024-09-12T05:20:57.309 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:57.308+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:57.322 INFO:teuthology.orchestra.run.smithi059.stdout:2250 read 0xa30c7f5 thru 0xa30faa8 (0x32b4 bytes) 2024-09-12T05:20:57.322 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:57.333 INFO:teuthology.orchestra.run.smithi059.stdout:2253 writesame 0xc7dd33e thru 0xc7e1bdb data_size 0x41(0x489e bytes) 2024-09-12T05:20:57.333 INFO:teuthology.orchestra.run.smithi059.stdout:2255 read 0x6b7107a thru 0x6b79692 (0x8619 bytes) 2024-09-12T05:20:57.333 INFO:teuthology.orchestra.run.smithi059.stdout:2256 punch from 0x2ae16bf to 0x2ae760f, (0x5f50 bytes) 2024-09-12T05:20:57.333 INFO:teuthology.orchestra.run.smithi059.stdout:2258 write 0x7c0d523 thru 0x7c12fb7 (0x5a95 bytes) 2024-09-12T05:20:57.349 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:57.349 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:57.353 INFO:teuthology.orchestra.run.smithi059.stdout:2259 write 0xe947454 thru 0xe94b6e5 (0x4292 bytes) 2024-09-12T05:20:57.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:20:57.376 INFO:teuthology.orchestra.run.smithi059.stdout:2260 trunc from 0xe94b6e6 to 0x45bc615 2024-09-12T05:20:57.410 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:57.408+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:57.419 INFO:teuthology.orchestra.run.smithi059.stdout:2261 writesame 0xc0168e0 thru 0xc025030 data_size 0x1(0xe751 bytes) 2024-09-12T05:20:57.435 INFO:teuthology.orchestra.run.smithi059.stdout:2262 trunc from 0xc025031 to 0x11c7bce 2024-09-12T05:20:57.471 INFO:teuthology.orchestra.run.smithi059.stdout:2265 writesame 0x31b3944 thru 0x31b414c data_size 0xb(0x809 bytes) 2024-09-12T05:20:57.492 INFO:teuthology.orchestra.run.smithi059.stdout:2266 writesame 0x946cf1c thru 0x94771f9 data_size 0x3(0xa2de bytes) 2024-09-12T05:20:57.492 INFO:teuthology.orchestra.run.smithi059.stdout:2267 read 0x8356e00 thru 0x8363741 (0xc942 bytes) 2024-09-12T05:20:57.508 INFO:teuthology.orchestra.run.smithi059.stdout:2268 write 0xd642687 thru 0xd65211e (0xfa98 bytes) 2024-09-12T05:20:57.509 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:57.508+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:57.516 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:57.516 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:57.516 INFO:teuthology.orchestra.run.smithi059.stdout:2269 writesame 0xc493cf2 thru 0xc49e54d data_size 0x32(0xa85c bytes) 2024-09-12T05:20:57.527 INFO:teuthology.orchestra.run.smithi059.stdout:2270 trunc from 0xd65211f to 0xc02a440 2024-09-12T05:20:57.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:20:57.541 INFO:teuthology.orchestra.run.smithi059.stdout:2271 read 0xab5547a thru 0xab5bc77 (0x67fe bytes) 2024-09-12T05:20:57.546 INFO:teuthology.orchestra.run.smithi059.stdout:2272 trunc from 0xc02a440 to 0x947ef75 2024-09-12T05:20:57.567 INFO:teuthology.orchestra.run.smithi059.stdout:2273 writesame 0x67ba1d8 thru 0x67be051 data_size 0xb(0x3e7a bytes) 2024-09-12T05:20:57.575 INFO:teuthology.orchestra.run.smithi059.stdout:2277 writesame 0x361f5d9 thru 0x3625612 data_size 0x2(0x603a bytes) 2024-09-12T05:20:57.610 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:57.608+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:57.611 INFO:teuthology.orchestra.run.smithi059.stdout:2278 write 0xdf5b46c thru 0xdf66413 (0xafa8 bytes) 2024-09-12T05:20:57.618 INFO:teuthology.orchestra.run.smithi059.stdout:2281 writesame 0x828e961 thru 0x829aa22 data_size 0xb(0xc0c2 bytes) 2024-09-12T05:20:57.626 INFO:teuthology.orchestra.run.smithi059.stdout:2282 read 0xc8440b8 thru 0xc84765c (0x35a5 bytes) 2024-09-12T05:20:57.637 INFO:teuthology.orchestra.run.smithi059.stdout:2283 writesame 0xea893fc thru 0xea8a459 data_size 0x5(0x105e bytes) 2024-09-12T05:20:57.637 INFO:teuthology.orchestra.run.smithi059.stdout:2284 write 0x8a224d8 thru 0x8a301bd (0xdce6 bytes) 2024-09-12T05:20:57.646 INFO:teuthology.orchestra.run.smithi059.stdout:2285 read 0x5208e8b thru 0x5218447 (0xf5bd bytes) 2024-09-12T05:20:57.648 INFO:teuthology.orchestra.run.smithi059.stdout:2286 read 0x5081025 thru 0x508e9f5 (0xd9d1 bytes) 2024-09-12T05:20:57.648 INFO:teuthology.orchestra.run.smithi059.stdout:2289 read 0x8e2862d thru 0x8e2e831 (0x6205 bytes) 2024-09-12T05:20:57.653 INFO:teuthology.orchestra.run.smithi059.stdout:2292 trunc from 0xea8a45a to 0xb57e31b 2024-09-12T05:20:57.672 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:57.672 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:57.673 INFO:teuthology.orchestra.run.smithi059.stdout:2293 trunc from 0xb57e31b to 0x786310a 2024-09-12T05:20:57.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:20:57.697 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:57.713 INFO:teuthology.orchestra.run.smithi059.stdout:2296 trunc from 0x786310a to 0xe7c359a 2024-09-12T05:20:57.714 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:20:57.712+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:20:57.725 INFO:teuthology.orchestra.run.smithi059.stdout:2298 write 0xc04d1f3 thru 0xc053e13 (0x6c21 bytes) 2024-09-12T05:20:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:2301 punch from 0x3e0278 to 0x3e8921, (0x86a9 bytes) 2024-09-12T05:20:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:2305 read 0x7d6a0a2 thru 0x7d79663 (0xf5c2 bytes) 2024-09-12T05:20:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:2306 write 0x4ed0f98 thru 0x4eded6d (0xddd6 bytes) 2024-09-12T05:20:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:2307 punch from 0x9ade100 to 0x9ade6ae, (0x5ae bytes) 2024-09-12T05:20:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:2308 punch from 0x97760cc to 0x9776941, (0x875 bytes) 2024-09-12T05:20:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:2309 read 0x9862cca thru 0x9863981 (0xcb8 bytes) 2024-09-12T05:20:57.741 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:57.754 INFO:teuthology.orchestra.run.smithi059.stdout:2311 trunc from 0xe7c359a to 0x659d787 2024-09-12T05:20:57.780 INFO:teuthology.orchestra.run.smithi059.stdout:2312 read 0x12026b7 thru 0x1209461 (0x6dab bytes) 2024-09-12T05:20:57.803 INFO:teuthology.orchestra.run.smithi059.stdout:2314 write 0xe25e84c thru 0xe26d8eb (0xf0a0 bytes) 2024-09-12T05:20:57.811 INFO:teuthology.orchestra.run.smithi059.stdout:2315 writesame 0x5050857 thru 0x505c5d3 data_size 0x1(0xbd7d bytes) 2024-09-12T05:20:57.812 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:57.808+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:57.831 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:57.831 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:57.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:20:57.849 INFO:teuthology.orchestra.run.smithi059.stdout:2316 write 0xaba434 thru 0xac78c9 (0xd496 bytes) 2024-09-12T05:20:57.853 INFO:teuthology.orchestra.run.smithi059.stdout:2317 write 0x52b98b3 thru 0x52bcaa5 (0x31f3 bytes) 2024-09-12T05:20:57.856 INFO:teuthology.orchestra.run.smithi059.stdout:2318 read 0x3ba34e7 thru 0x3bad620 (0xa13a bytes) 2024-09-12T05:20:57.857 INFO:teuthology.orchestra.run.smithi059.stdout:2319 write 0xdfdff76 thru 0xdfea0f8 (0xa183 bytes) 2024-09-12T05:20:57.865 INFO:teuthology.orchestra.run.smithi059.stdout:2321 punch from 0x5526564 to 0x5535f3a, (0xf9d6 bytes) 2024-09-12T05:20:57.865 INFO:teuthology.orchestra.run.smithi059.stdout:2322 punch from 0x669764b to 0x6698df9, (0x17ae bytes) 2024-09-12T05:20:57.865 INFO:teuthology.orchestra.run.smithi059.stdout:2325 writesame 0x93af615 thru 0x93b6377 data_size 0x1(0x6d63 bytes) 2024-09-12T05:20:57.908 INFO:teuthology.orchestra.run.smithi059.stdout:2327 write 0x84d8492 thru 0x84dd495 (0x5004 bytes) 2024-09-12T05:20:57.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:57.912+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:57.916 INFO:teuthology.orchestra.run.smithi059.stdout:2328 punch from 0xa7e0379 to 0xa7eeb7d, (0xe804 bytes) 2024-09-12T05:20:57.917 INFO:teuthology.orchestra.run.smithi059.stdout:2330 punch from 0x913dca2 to 0x914c5cb, (0xe929 bytes) 2024-09-12T05:20:57.930 INFO:teuthology.orchestra.run.smithi059.stdout:2332 trunc from 0xe26d8ec to 0x792d4be 2024-09-12T05:20:57.958 INFO:teuthology.orchestra.run.smithi059.stdout:2334 read 0x6105807 thru 0x6114993 (0xf18d bytes) 2024-09-12T05:20:57.958 INFO:teuthology.orchestra.run.smithi059.stdout:2337 write 0x2d541c4 thru 0x2d54fa0 (0xddd bytes) 2024-09-12T05:20:57.963 INFO:teuthology.orchestra.run.smithi059.stdout:2338 read 0x4cc751 thru 0x4d3672 (0x6f22 bytes) 2024-09-12T05:20:57.964 INFO:teuthology.orchestra.run.smithi059.stdout:2339 read 0x149bab1 thru 0x14a64b2 (0xaa02 bytes) 2024-09-12T05:20:57.965 INFO:teuthology.orchestra.run.smithi059.stdout:2340 punch from 0x58b335d to 0x58b33d3, (0x76 bytes) 2024-09-12T05:20:57.983 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:57.983 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:57.988 INFO:teuthology.orchestra.run.smithi059.stdout:2341 writesame 0xc2f6002 thru 0xc302da3 data_size 0x1(0xcda2 bytes) 2024-09-12T05:20:57.988 INFO:teuthology.orchestra.run.smithi059.stdout:2342 read 0x768c86a thru 0x7696d8d (0xa524 bytes) 2024-09-12T05:20:58.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:20:58.005 INFO:teuthology.orchestra.run.smithi059.stdout:2343 trunc from 0xc302da4 to 0x53a5dc5 2024-09-12T05:20:58.014 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:58.012+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:58.030 INFO:teuthology.orchestra.run.smithi059.stdout:2344 write 0x4c890c0 thru 0x4c8e721 (0x5662 bytes) 2024-09-12T05:20:58.039 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:58.055 INFO:teuthology.orchestra.run.smithi059.stdout:2346 write 0x95fcc27 thru 0x95fd0b2 (0x48c bytes) 2024-09-12T05:20:58.061 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:58.061 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:58.061 INFO:teuthology.orchestra.run.smithi059.stdout:2350 writesame 0x4a4aca thru 0x4a69c6 data_size 0x1(0x1efd bytes) 2024-09-12T05:20:58.074 INFO:teuthology.orchestra.run.smithi059.stdout:2352 write 0x20f6035 thru 0x20ff37e (0x934a bytes) 2024-09-12T05:20:58.084 INFO:teuthology.orchestra.run.smithi059.stdout:2353 trunc from 0x95fd0b3 to 0xd2ca033 2024-09-12T05:20:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:2354 read 0x4ed6379 thru 0x4edf123 (0x8dab bytes) 2024-09-12T05:20:58.095 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:58.095 INFO:teuthology.orchestra.run.smithi059.stdout:2357 punch from 0x16a7f30 to 0x16adf3e, (0x600e bytes) 2024-09-12T05:20:58.095 INFO:teuthology.orchestra.run.smithi059.stdout:2358 punch from 0x2f6f110 to 0x2f77dde, (0x8cce bytes) 2024-09-12T05:20:58.102 INFO:teuthology.orchestra.run.smithi059.stdout:2359 trunc from 0xd2ca033 to 0x8be6e5d 2024-09-12T05:20:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:20:58.114 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:58.112+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:58.130 INFO:teuthology.orchestra.run.smithi059.stdout:2360 punch from 0x372d797 to 0x3732b34, (0x539d bytes) 2024-09-12T05:20:58.130 INFO:teuthology.orchestra.run.smithi059.stdout:2361 writesame 0x45162fd thru 0x451cef3 data_size 0x25(0x6bf7 bytes) 2024-09-12T05:20:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:2362 writesame 0x4599636 thru 0x45a1312 data_size 0x5(0x7cdd bytes) 2024-09-12T05:20:58.145 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:58.145 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:58.161 INFO:teuthology.orchestra.run.smithi059.stdout:2363 trunc from 0x8be6e5d to 0x57b263 2024-09-12T05:20:58.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:20:58.228 INFO:teuthology.orchestra.run.smithi059.stdout:2364 writesame 0xab5fda6 thru 0xab63391 data_size 0x44(0x35ec bytes) 2024-09-12T05:20:58.228 INFO:teuthology.orchestra.run.smithi059.stdout:2365 write 0x4cbe8ca thru 0x4cc4596 (0x5ccd bytes) 2024-09-12T05:20:58.228 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:58.224+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:58.254 INFO:teuthology.orchestra.run.smithi059.stdout:2366 trunc from 0xab63392 to 0xd824fb 2024-09-12T05:20:58.299 INFO:teuthology.orchestra.run.smithi059.stdout:2367 trunc from 0xd824fb to 0xa3abab7 2024-09-12T05:20:58.317 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:58.316+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:58.327 INFO:teuthology.orchestra.run.smithi059.stdout:2368 write 0xe0fd2ac thru 0xe103d87 (0x6adc bytes) 2024-09-12T05:20:58.337 INFO:teuthology.orchestra.run.smithi059.stdout:2369 punch from 0x662b2c6 to 0x662c48f, (0x11c9 bytes) 2024-09-12T05:20:58.338 INFO:teuthology.orchestra.run.smithi059.stdout:2370 read 0x8a5f4df thru 0x8a5fcb6 (0x7d8 bytes) 2024-09-12T05:20:58.338 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:58.338 INFO:teuthology.orchestra.run.smithi059.stdout:2372 write 0x966df1f thru 0x966f631 (0x1713 bytes) 2024-09-12T05:20:58.345 INFO:teuthology.orchestra.run.smithi059.stdout:2374 punch from 0x1fde46f to 0x1fe2905, (0x4496 bytes) 2024-09-12T05:20:58.345 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:58.345 INFO:teuthology.orchestra.run.smithi059.stdout:2376 punch from 0xb11a2e4 to 0xb124679, (0xa395 bytes) 2024-09-12T05:20:58.345 INFO:teuthology.orchestra.run.smithi059.stdout:2377 write 0xbe7bf12 thru 0xbe7f30d (0x33fc bytes) 2024-09-12T05:20:58.350 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:58.351 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:58.354 INFO:teuthology.orchestra.run.smithi059.stdout:2378 writesame 0x8c561af thru 0x8c5e359 data_size 0x5(0x81ab bytes) 2024-09-12T05:20:58.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:20:58.376 INFO:teuthology.orchestra.run.smithi059.stdout:2380 trunc from 0xe103d88 to 0xb593bee 2024-09-12T05:20:58.399 INFO:teuthology.orchestra.run.smithi059.stdout:2381 punch from 0x60fdc2c to 0x61049f4, (0x6dc8 bytes) 2024-09-12T05:20:58.400 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:58.400 INFO:teuthology.orchestra.run.smithi059.stdout:2383 write 0x55df7e2 thru 0x55ebcd7 (0xc4f6 bytes) 2024-09-12T05:20:58.417 INFO:teuthology.orchestra.run.smithi059.stdout:2384 trunc from 0xb593bee to 0x5cfc975 2024-09-12T05:20:58.418 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:58.416+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:58.465 INFO:teuthology.orchestra.run.smithi059.stdout:2386 write 0xa19f85d thru 0xa1a9aaa (0xa24e bytes) 2024-09-12T05:20:58.472 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:58.487 INFO:teuthology.orchestra.run.smithi059.stdout:2388 trunc from 0xa1a9aab to 0x387a89e 2024-09-12T05:20:58.510 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:58.510 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:58.521 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:58.520+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:58.523 INFO:teuthology.orchestra.run.smithi059.stdout:2390 clone 17 order 25 su 2097152 sc 3 2024-09-12T05:20:58.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:20:58.623 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:58.620+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:58.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:20:58.698 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:58.698 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:58.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:20:58.723 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:58.720+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:58.822 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:20:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:20:58.824 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:58.820+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:58.839 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:20:58.840 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:20:58.847 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:20:58.847 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:20:58.857 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:20:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:20:58.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:20:58.875 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:20:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:20:58.896 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:20:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:20:58.917 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:20:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:20:58.924 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:20:58.924+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:20:58.939 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:20:58.939 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:20:58.960 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:20:58.961 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:20:58.980 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:58.980 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:20:58.980 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:20:58.980 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:20:58.980 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:58.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:20:59.026 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:20:59.024+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:20:59.126 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:20:59.124+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23601 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.294174801, 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046132175999999997, 2024-09-12T05:20:59.174 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23601 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877966+0000", 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877967+0000", 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9299999999999996e-07 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877970+0000", 2024-09-12T05:20:59.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6600000000000001e-06 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877987+0000", 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7033000000000001e-05 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.877997+0000", 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8970000000000003e-06 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924083+0000", 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046086037000000003 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924098+0000", 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4656e-05 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23602 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:59.178 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.294091899000001, 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046134982999999997, 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23602 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:59.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878049+0000", 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878050+0000", 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0299999999999998e-07 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878060+0000", 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0008e-05 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878069+0000", 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0699999999999996e-06 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878076+0000", 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8990000000000004e-06 2024-09-12T05:20:59.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924152+0000", 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046076735000000001 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924184+0000", 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1467999999999998e-05 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23604 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.294023508999999, 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046158181, 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23604 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878117+0000", 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878118+0000", 2024-09-12T05:20:59.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7299999999999996e-07 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878120+0000", 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.694e-06 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878128+0000", 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5320000000000001e-06 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878134+0000", 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.083e-06 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924258+0000", 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046123551999999998 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924275+0000", 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7747000000000001e-05 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23605 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293994827999999, 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046181315000000001, 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23605 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878146+0000", 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878147+0000", 2024-09-12T05:20:59.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5000000000000001e-07 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878149+0000", 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5150000000000001e-06 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878168+0000", 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8505e-05 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878174+0000", 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5250000000000002e-06 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924319+0000", 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046145149000000003 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924327+0000", 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7710000000000006e-06 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23606 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293956772000001, 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046204501000000002, 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23606 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.191 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878184+0000", 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:59.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878187+0000", 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.667e-06 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878195+0000", 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7319999999999998e-06 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878201+0000", 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.489e-06 2024-09-12T05:20:59.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924374+0000", 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046172264999999997 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924388+0000", 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4762e-05 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23607 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293894963, 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046215282000000003, 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23607 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878246+0000", 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3200000000000004e-07 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878250+0000", 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1920000000000001e-06 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878258+0000", 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4279999999999996e-06 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878265+0000", 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9539999999999998e-06 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924447+0000", 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046182198000000001 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924461+0000", 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3678e-05 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23608 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.198 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293820310000001, 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046219194999999998, 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23608 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878320+0000", 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878321+0000", 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5899999999999995e-07 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878324+0000", 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9220000000000001e-06 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878332+0000", 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0620000000000001e-06 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878339+0000", 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6440000000000003e-06 2024-09-12T05:20:59.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924512+0000", 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046173120999999998 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924540+0000", 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7586999999999999e-05 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23609 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293792802999999, 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046254423000000003, 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23609 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878348+0000", 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878349+0000", 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4499999999999996e-07 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878351+0000", 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7180000000000001e-06 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878368+0000", 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6801000000000001e-05 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878376+0000", 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3649999999999998e-06 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924593+0000", 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046217113999999997 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924602+0000", 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5799999999999998e-06 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.206 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23610 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293744867000001, 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046255375000000001, 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23610 2024-09-12T05:20:59.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878396+0000", 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878399+0000", 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9919999999999999e-06 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878407+0000", 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9650000000000008e-06 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878414+0000", 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924641+0000", 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046226972999999998 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924651+0000", 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.03e-05 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.210 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23611 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293710578999999, 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046240949000000003, 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23611 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878430+0000", 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878431+0000", 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4099999999999999e-07 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878433+0000", 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.632e-06 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878443+0000", 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0104e-05 2024-09-12T05:20:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878450+0000", 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2620000000000004e-06 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924666+0000", 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046216672 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924671+0000", 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:20:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23612 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293682765, 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046245959000000003, 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.215 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23612 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878458+0000", 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878459+0000", 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1900000000000001e-07 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878461+0000", 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4930000000000001e-06 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878473+0000", 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1756000000000001e-05 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878480+0000", 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7170000000000002e-06 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924694+0000", 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046214660999999997 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924704+0000", 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5130000000000002e-06 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.218 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23613 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293612547999999, 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046232418999999997, 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23613 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.219 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878528+0000", 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878529+0000", 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.367e-06 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878535+0000", 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9680000000000003e-06 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878554+0000", 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8513e-05 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878567+0000", 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3492000000000001e-05 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924749+0000", 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046181148999999998 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924760+0000", 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1929999999999999e-05 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23614 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293552779999999, 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046230298000000003, 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23614 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878588+0000", 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878589+0000", 2024-09-12T05:20:59.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2750000000000001e-06 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878603+0000", 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3626e-05 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878618+0000", 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5671999999999998e-05 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878631+0000", 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2206e-05 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924805+0000", 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046174814000000002 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924818+0000", 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2704999999999999e-05 2024-09-12T05:20:59.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23615 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293489007000002, 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046210418000000003, 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23615 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878652+0000", 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878653+0000", 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.173e-06 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878658+0000", 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8890000000000001e-06 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878673+0000", 2024-09-12T05:20:59.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5580999999999999e-05 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878687+0000", 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3565e-05 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924851+0000", 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046164226000000003 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924862+0000", 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0984e-05 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23616 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293417939000001, 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046184362, 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23616 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878723+0000", 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878724+0000", 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.649e-06 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878730+0000", 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878748+0000", 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7271000000000001e-05 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878760+0000", 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2564e-05 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924897+0000", 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046136542000000003 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924907+0000", 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0358e-05 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23617 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293361197999999, 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046182312000000003, 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.235 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23617 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878779+0000", 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878781+0000", 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878786+0000", 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2850000000000002e-06 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878802+0000", 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5837000000000001e-05 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878814+0000", 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2228e-05 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924949+0000", 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046135352999999997 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.924962+0000", 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2255e-05 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23618 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293306127000001, 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046185865, 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23618 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878834+0000", 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878835+0000", 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8199999999999998e-07 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878839+0000", 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5279999999999999e-06 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878848+0000", 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.653e-06 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878854+0000", 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6930000000000001e-06 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925008+0000", 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046153753999999998 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925020+0000", 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2354999999999999e-05 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23619 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293255675000001, 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046173694000000001, 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.243 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23619 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878885+0000", 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878886+0000", 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7400000000000003e-07 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878889+0000", 2024-09-12T05:20:59.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878899+0000", 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0264e-05 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878906+0000", 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2350000000000002e-06 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925046+0000", 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046139927999999997 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925059+0000", 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2463000000000001e-05 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:23620 3.b 3.fdfb350b (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.293188228999998, 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046148199000000001, 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 23620 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878952+0000", 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878954+0000", 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1510000000000001e-06 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878959+0000", 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5949999999999998e-06 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878975+0000", 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5790999999999998e-05 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.878987+0000", 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1972e-05 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925086+0000", 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046099049000000003 2024-09-12T05:20:59.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.925101+0000", 2024-09-12T05:20:59.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4640999999999999e-05 2024-09-12T05:20:59.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.252 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:24894 3.b 3:d0acdfbf:::rbd_data.1118d7e09baf.0000000000000041:e [read 324608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.233763732, 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046214719000000001, 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 24894 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.253 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.938377+0000", 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:20:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943307+0000", 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049300769999999997 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943313+0000", 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4749999999999998e-06 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943332+0000", 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8261e-05 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.943341+0000", 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9409999999999996e-06 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984427+0000", 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041085932999999998 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984510+0000", 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3432999999999999e-05 2024-09-12T05:20:59.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:40.984592+0000", 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1599000000000003e-05 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:20:59.257 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:20:59.259 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:20:59.259 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:59.256+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:59.307 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone16 2024-09-12T05:20:59.360 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:59.356+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:59.392 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:59.392 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:59.392 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:20:59.392 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:59.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:20:59.463 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-12T05:20:59.466 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:59.475 INFO:teuthology.orchestra.run.smithi059.stdout:2393 trunc from 0x387a89e to 0x3842f2 2024-09-12T05:20:59.497 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:20:59.496+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:20:59.515 INFO:teuthology.orchestra.run.smithi059.stdout:2395 read 0x21f6a1 thru 0x22a698 (0xaff8 bytes) 2024-09-12T05:20:59.516 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:59.516 INFO:teuthology.orchestra.run.smithi059.stdout:2397 punch from 0x379f9d to 0x37aa52, (0xab5 bytes) 2024-09-12T05:20:59.541 INFO:teuthology.orchestra.run.smithi059.stdout:2398 writesame 0x513fd83 thru 0x514d661 data_size 0x1(0xd8df bytes) 2024-09-12T05:20:59.544 INFO:teuthology.orchestra.run.smithi059.stdout:2400 read 0x6fdd4e thru 0x70814a (0xa3fd bytes) 2024-09-12T05:20:59.561 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:20:59.560+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:20:59.574 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:59.575 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:20:59.575 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:20:59.575 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:20:59.575 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:59.575 INFO:teuthology.orchestra.run.smithi059.stdout:2401 write 0xa0ffacb thru 0xa10284d (0x2d83 bytes) 2024-09-12T05:20:59.583 INFO:teuthology.orchestra.run.smithi059.stdout:2402 write 0x3ff1ad9 thru 0x3ff3507 (0x1a2f bytes) 2024-09-12T05:20:59.587 INFO:teuthology.orchestra.run.smithi059.stdout:2403 read 0x25bec07 thru 0x25c5566 (0x6960 bytes) 2024-09-12T05:20:59.588 INFO:teuthology.orchestra.run.smithi059.stdout:2404 writesame 0x4325da2 thru 0x4330142 data_size 0x3(0xa3a1 bytes) 2024-09-12T05:20:59.589 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:20:59.609 INFO:teuthology.orchestra.run.smithi059.stdout:2405 write 0x7f46438 thru 0x7f4c54f (0x6118 bytes) 2024-09-12T05:20:59.622 INFO:teuthology.orchestra.run.smithi059.stdout:2406 trunc from 0xa10284e to 0xba45251 2024-09-12T05:20:59.637 INFO:teuthology.orchestra.run.smithi059.stdout:2407 writesame 0x46c48c2 thru 0x46cce07 data_size 0x7(0x8546 bytes) 2024-09-12T05:20:59.653 INFO:teuthology.orchestra.run.smithi059.stdout:2408 trunc from 0xba45251 to 0xa75d0f7 2024-09-12T05:20:59.677 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:20:59.676+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:20:59.691 INFO:teuthology.orchestra.run.smithi059.stdout:2409 write 0xce7f76c thru 0xce86e3f (0x76d4 bytes) 2024-09-12T05:20:59.698 INFO:teuthology.orchestra.run.smithi059.stdout:2410 punch from 0xa18da21 to 0xa1993a8, (0xb987 bytes) 2024-09-12T05:20:59.698 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:59.698 INFO:teuthology.orchestra.run.smithi059.stdout:2415 read 0x7a45064 thru 0x7a5228e (0xd22b bytes) 2024-09-12T05:20:59.698 INFO:teuthology.orchestra.run.smithi059.stdout:2417 writesame 0x51aca83 thru 0x51b5417 data_size 0x1(0x8995 bytes) 2024-09-12T05:20:59.748 INFO:teuthology.orchestra.run.smithi059.stdout:2418 write 0xda5c1b thru 0xdac412 (0x67f8 bytes) 2024-09-12T05:20:59.753 INFO:teuthology.orchestra.run.smithi059.stdout:2419 punch from 0x6927719 to 0x693524e, (0xdb35 bytes) 2024-09-12T05:20:59.753 INFO:teuthology.orchestra.run.smithi059.stdout:2420 writesame 0x60bdd7a thru 0x60cd70c data_size 0x1f(0xf993 bytes) 2024-09-12T05:20:59.759 INFO:teuthology.orchestra.run.smithi059.stdout:2421 punch from 0x922d589 to 0x922f8a2, (0x2319 bytes) 2024-09-12T05:20:59.759 INFO:teuthology.orchestra.run.smithi059.stdout:2422 read 0x3349730 thru 0x334a767 (0x1038 bytes) 2024-09-12T05:20:59.761 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:20:59.761 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:20:59.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53064 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316754+0000", 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4440637460000003, 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043120721000000001, 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53064 2024-09-12T05:20:59.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316754+0000", 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316754+0000", 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316754+0000", 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316756+0000", 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.077e-06 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316759+0000", 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9840000000000001e-06 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316761+0000", 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.756e-06 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359795+0000", 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043033585999999999 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359829+0000", 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4335000000000002e-05 2024-09-12T05:20:59.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359875+0000", 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5649000000000003e-05 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53065 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 144384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316765+0000", 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4440532949999998, 2024-09-12T05:20:59.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216355999999997, 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53065 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316765+0000", 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316765+0000", 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316765+0000", 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1299999999999999e-07 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316766+0000", 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.068e-06 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316769+0000", 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.914e-06 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316771+0000", 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.616e-06 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359900+0000", 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043128566 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359934+0000", 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4405e-05 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.359981+0000", 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6573999999999998e-05 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.770 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53066 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316775+0000", 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.444043304, 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043313202000000002, 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53066 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316775+0000", 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316775+0000", 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316775+0000", 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3200000000000001e-07 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316776+0000", 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7900000000000007e-07 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316779+0000", 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.819e-06 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316781+0000", 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.711e-06 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360007+0000", 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043225461 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360041+0000", 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4584e-05 2024-09-12T05:20:59.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360088+0000", 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6415999999999997e-05 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53067 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 173056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316784+0000", 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4440334759999995, 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043412596999999997, 2024-09-12T05:20:59.775 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53067 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316784+0000", 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316784+0000", 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316785+0000", 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1299999999999999e-07 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316786+0000", 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0210000000000001e-06 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316789+0000", 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9720000000000001e-06 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316791+0000", 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7219999999999999e-06 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360113+0000", 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043321717000000003 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360148+0000", 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4678999999999998e-05 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360197+0000", 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9273000000000001e-05 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.779 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53068 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316794+0000", 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.444023413, 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043508646999999998, 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.780 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53068 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316794+0000", 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316794+0000", 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316795+0000", 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3799999999999999e-07 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316796+0000", 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.062e-06 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316799+0000", 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8289999999999999e-06 2024-09-12T05:20:59.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316804+0000", 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6729999999999997e-06 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360221+0000", 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043417224999999997 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360256+0000", 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4795000000000001e-05 2024-09-12T05:20:59.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360303+0000", 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6825e-05 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53069 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 131072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316808+0000", 2024-09-12T05:20:59.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4440103410000003, 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043601422000000001, 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53069 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316808+0000", 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316808+0000", 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316808+0000", 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.35e-07 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316809+0000", 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2389999999999999e-06 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316812+0000", 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316815+0000", 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3409999999999999e-06 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360328+0000", 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043513138 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360363+0000", 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4502000000000003e-05 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360409+0000", 2024-09-12T05:20:59.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6022000000000001e-05 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53070 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 145408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316819+0000", 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4439992870000005, 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043696608999999997, 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53070 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316819+0000", 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316819+0000", 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316819+0000", 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316820+0000", 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1710000000000001e-06 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316823+0000", 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9239999999999999e-06 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316826+0000", 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7700000000000002e-06 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360434+0000", 2024-09-12T05:20:59.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043608338000000003 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360469+0000", 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5037999999999999e-05 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360515+0000", 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6128000000000003e-05 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53071 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 159744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316829+0000", 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4439890609999999, 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043796509999999997, 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53071 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316829+0000", 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316829+0000", 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316829+0000", 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316830+0000", 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.116e-06 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316833+0000", 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.841e-06 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316836+0000", 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.729e-06 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360542+0000", 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043706765000000002 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360578+0000", 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5675e-05 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360625+0000", 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7144000000000001e-05 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53072 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316840+0000", 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4439781800000002, 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043896499999999998, 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53072 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316840+0000", 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316840+0000", 2024-09-12T05:20:59.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316840+0000", 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316841+0000", 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9199999999999999e-07 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316844+0000", 2024-09-12T05:20:59.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0869999999999998e-06 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316847+0000", 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8990000000000001e-06 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360652+0000", 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043805397000000003 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360688+0000", 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6189000000000002e-05 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360736+0000", 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7704999999999998e-05 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53073 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 188416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316850+0000", 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4439677319999999, 2024-09-12T05:20:59.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043994617, 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53073 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316850+0000", 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316850+0000", 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316850+0000", 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3200000000000001e-07 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316855+0000", 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0880000000000002e-06 2024-09-12T05:20:59.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316859+0000", 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5260000000000002e-06 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316862+0000", 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6630000000000002e-06 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360762+0000", 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043900198000000001 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360797+0000", 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5170999999999999e-05 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360845+0000", 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7738999999999998e-05 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53074 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 132096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316865+0000", 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4439527769999998, 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044086368000000001, 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.807 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53074 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316865+0000", 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316865+0000", 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316865+0000", 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316866+0000", 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.114e-06 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316869+0000", 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9170000000000002e-06 2024-09-12T05:20:59.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316873+0000", 2024-09-12T05:20:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.393e-06 2024-09-12T05:20:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360870+0000", 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043996809999999997 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360905+0000", 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5271999999999997e-05 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360951+0000", 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6622000000000002e-05 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53075 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316877+0000", 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4439413119999998, 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044183716999999997, 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53075 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316877+0000", 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316877+0000", 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316877+0000", 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316878+0000", 2024-09-12T05:20:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.099e-06 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316882+0000", 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9759999999999997e-06 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316885+0000", 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9229999999999998e-06 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.360979+0000", 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044093827000000002 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361014+0000", 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5188000000000003e-05 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361060+0000", 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6492000000000001e-05 2024-09-12T05:20:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53076 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 160768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316888+0000", 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4439296150000001, 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044281181000000003, 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53076 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316888+0000", 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316888+0000", 2024-09-12T05:20:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316888+0000", 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4400000000000001e-07 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316890+0000", 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316893+0000", 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0290000000000001e-06 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316895+0000", 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.616e-06 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361085+0000", 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044190264 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361120+0000", 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4239999999999997e-05 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361169+0000", 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9691000000000002e-05 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53077 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 175104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316898+0000", 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4439193799999996, 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044377626000000003, 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53077 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316898+0000", 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316898+0000", 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316899+0000", 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0400000000000002e-07 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316900+0000", 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316903+0000", 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316906+0000", 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.128e-06 2024-09-12T05:20:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361195+0000", 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044288974000000002 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361230+0000", 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4736000000000001e-05 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361276+0000", 2024-09-12T05:20:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6406000000000003e-05 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53078 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316924+0000", 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4438938380000002, 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044464407999999997, 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53078 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316924+0000", 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316924+0000", 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316924+0000", 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316926+0000", 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.325e-06 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316929+0000", 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.394e-06 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316932+0000", 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8629999999999999e-06 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361303+0000", 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044370700999999999 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361337+0000", 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4150000000000003e-05 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361388+0000", 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1539000000000002e-05 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53079 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 133120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316936+0000", 2024-09-12T05:20:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4438820459999997, 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044562729000000002, 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53079 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316936+0000", 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316936+0000", 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316938+0000", 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7370000000000001e-06 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316939+0000", 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4160000000000001e-06 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316942+0000", 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.027e-06 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316949+0000", 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5939999999999999e-06 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361415+0000", 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044466404000000001 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361450+0000", 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4653000000000002e-05 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361499+0000", 2024-09-12T05:20:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8897999999999998e-05 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53080 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 147456~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.316952+0000", 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4438654470000003, 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044653224999999998, 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53080 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316952+0000", 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.316952+0000", 2024-09-12T05:20:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317246+0000", 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029351300000000002 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317249+0000", 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.563e-06 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317259+0000", 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6080000000000002e-06 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317266+0000", 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5760000000000002e-06 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361524+0000", 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044257913000000003 2024-09-12T05:20:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361559+0000", 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4919000000000002e-05 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361606+0000", 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7132999999999997e-05 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53081 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.317276+0000", 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4435415349999996, 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044447685000000001, 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53081 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317276+0000", 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317276+0000", 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317277+0000", 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7899999999999999e-07 2024-09-12T05:20:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317279+0000", 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.345e-06 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317286+0000", 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3949999999999998e-06 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317290+0000", 2024-09-12T05:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9450000000000001e-06 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361634+0000", 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044343936 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361671+0000", 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6405000000000001e-05 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361724+0000", 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3180000000000002e-05 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:53082 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 176128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.317297+0000", 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4435207889999999, 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044536918000000002, 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 53082 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317297+0000", 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.317297+0000", 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.323457+0000", 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006160095 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.323462+0000", 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1139999999999997e-06 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.323486+0000", 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3496999999999999e-05 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.323760+0000", 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027389200000000003 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361750+0000", 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037990124 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361786+0000", 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5926000000000001e-05 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.361834+0000", 2024-09-12T05:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8269999999999997e-05 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:55337 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:10 [read 175104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.684356+0000", 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0764622279999996, 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044986792999999997, 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 55337 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.684356+0000", 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.684356+0000", 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.684356+0000", 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3900000000000001e-07 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.684357+0000", 2024-09-12T05:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6109999999999999e-06 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.684362+0000", 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5569999999999997e-06 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.684366+0000", 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1629999999999998e-06 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.725118+0000", 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040751452000000001 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.725183+0000", 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5382000000000005e-05 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.729342+0000", 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041593890000000003 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:20:59.855 INFO:teuthology.orchestra.run.smithi059.stdout:2423 trunc from 0xce86e40 to 0x26b6848 2024-09-12T05:20:59.856 INFO:teuthology.orchestra.run.smithi059.stdout:2424 punch from 0x212d8e7 to 0x213580c, (0x7f25 bytes) 2024-09-12T05:20:59.856 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:20:59.856 INFO:teuthology.orchestra.run.smithi059.stdout:2426 writesame 0x9c7cc5c thru 0x9c80e76 data_size 0x1(0x421b bytes) 2024-09-12T05:20:59.856 INFO:teuthology.orchestra.run.smithi059.stdout:2427 writesame 0x5cf3c0b thru 0x5cfca73 data_size 0x1(0x8e69 bytes) 2024-09-12T05:20:59.856 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:59.852+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:59.856 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:20:59.899 INFO:teuthology.orchestra.run.smithi059.stdout:2428 read 0x82a4704 thru 0x82a6e53 (0x2750 bytes) 2024-09-12T05:20:59.900 INFO:teuthology.orchestra.run.smithi059.stdout:2429 punch from 0x182c0d to 0x18504f, (0x2442 bytes) 2024-09-12T05:20:59.903 INFO:teuthology.orchestra.run.smithi059.stdout:2430 trunc from 0x9c80e77 to 0x8864857 2024-09-12T05:20:59.917 INFO:teuthology.orchestra.run.smithi059.stdout:2431 writesame 0x3321ce6 thru 0x3327465 data_size 0x38(0x5780 bytes) 2024-09-12T05:20:59.922 INFO:teuthology.orchestra.run.smithi059.stdout:2432 trunc from 0x8864857 to 0x931157f 2024-09-12T05:20:59.934 INFO:teuthology.orchestra.run.smithi059.stdout:2433 write 0x897b867 thru 0x898a7a4 (0xef3e bytes) 2024-09-12T05:20:59.942 INFO:teuthology.orchestra.run.smithi059.stdout:2434 writesame 0x24f944a thru 0x24faafd data_size 0x2(0x16b4 bytes) 2024-09-12T05:20:59.947 INFO:teuthology.orchestra.run.smithi059.stdout:2435 read 0x8aecb3f thru 0x8af991a (0xcddc bytes) 2024-09-12T05:20:59.947 INFO:teuthology.orchestra.run.smithi059.stdout:2437 read 0x782eb0e thru 0x783a1ac (0xb69f bytes) 2024-09-12T05:20:59.957 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:20:59.956+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:20:59.972 INFO:teuthology.orchestra.run.smithi059.stdout:2438 write 0xd7cc211 thru 0xd7d490b (0x86fb bytes) 2024-09-12T05:20:59.989 INFO:teuthology.orchestra.run.smithi059.stdout:2440 trunc from 0xd7d490c to 0x9ea3ed9 2024-09-12T05:21:00.017 INFO:teuthology.orchestra.run.smithi059.stdout:2443 write 0x8fb95c0 thru 0x8fc4149 (0xab8a bytes) 2024-09-12T05:21:00.021 INFO:teuthology.orchestra.run.smithi059.stdout:2444 read 0x8c3b25f thru 0x8c44935 (0x96d7 bytes) 2024-09-12T05:21:00.021 INFO:teuthology.orchestra.run.smithi059.stdout:2446 read 0x60bd2c thru 0x616d19 (0xafee bytes) 2024-09-12T05:21:00.031 INFO:teuthology.orchestra.run.smithi059.stdout:2447 trunc from 0x9ea3ed9 to 0x69c8f9b 2024-09-12T05:21:00.050 INFO:teuthology.orchestra.run.smithi059.stdout:2448 punch from 0x12a9597 to 0x12afc7b, (0x66e4 bytes) 2024-09-12T05:21:00.050 INFO:teuthology.orchestra.run.smithi059.stdout:2449 punch from 0xc53065 to 0xc62d02, (0xfc9d bytes) 2024-09-12T05:21:00.050 INFO:teuthology.orchestra.run.smithi059.stdout:2450 punch from 0xdf9acc to 0xe096e9, (0xfc1d bytes) 2024-09-12T05:21:00.051 INFO:teuthology.orchestra.run.smithi059.stdout:2451 punch from 0x55e87f8 to 0x55f81e1, (0xf9e9 bytes) 2024-09-12T05:21:00.053 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:00.053 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:00.053 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:00.054 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:00.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:00.056+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:00.069 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:00.080 INFO:teuthology.orchestra.run.smithi059.stdout:2452 write 0xd31be1b thru 0xd321c21 (0x5e07 bytes) 2024-09-12T05:21:00.088 INFO:teuthology.orchestra.run.smithi059.stdout:2455 write 0x4736082 thru 0x4740ba4 (0xab23 bytes) 2024-09-12T05:21:00.108 INFO:teuthology.orchestra.run.smithi059.stdout:2456 write 0xdd3fba8 thru 0xdd4ad1e (0xb177 bytes) 2024-09-12T05:21:00.114 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.115 INFO:teuthology.orchestra.run.smithi059.stdout:2459 read 0x44c4d2 thru 0x45b970 (0xf49f bytes) 2024-09-12T05:21:00.116 INFO:teuthology.orchestra.run.smithi059.stdout:2460 punch from 0x45398ee to 0x454051a, (0x6c2c bytes) 2024-09-12T05:21:00.116 INFO:teuthology.orchestra.run.smithi059.stdout:2461 writesame 0x5ca6a54 thru 0x5cb09c1 data_size 0x1(0x9f6e bytes) 2024-09-12T05:21:00.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:21:00.165 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:00.164+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:00.175 INFO:teuthology.orchestra.run.smithi059.stdout:2462 trunc from 0xdd4ad1f to 0xeb5f3b8 2024-09-12T05:21:00.187 INFO:teuthology.orchestra.run.smithi059.stdout:2463 read 0xb2ce769 thru 0xb2d1758 (0x2ff0 bytes) 2024-09-12T05:21:00.191 INFO:teuthology.orchestra.run.smithi059.stdout:2465 trunc from 0xeb5f3b8 to 0xd5ca775 2024-09-12T05:21:00.205 INFO:teuthology.orchestra.run.smithi059.stdout:2466 punch from 0xd0198f to 0xd08cd0, (0x7341 bytes) 2024-09-12T05:21:00.206 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.206 INFO:teuthology.orchestra.run.smithi059.stdout:2470 write 0x113b6d7 thru 0x114247f (0x6da9 bytes) 2024-09-12T05:21:00.209 INFO:teuthology.orchestra.run.smithi059.stdout:2472 write 0x887b1b2 thru 0x887e45e (0x32ad bytes) 2024-09-12T05:21:00.212 INFO:teuthology.orchestra.run.smithi059.stdout:2473 write 0xb34f35e thru 0xb3503b2 (0x1055 bytes) 2024-09-12T05:21:00.215 INFO:teuthology.orchestra.run.smithi059.stdout:2474 read 0x568f6e9 thru 0x569670a (0x7022 bytes) 2024-09-12T05:21:00.216 INFO:teuthology.orchestra.run.smithi059.stdout:2475 write 0x700b64 thru 0x70b610 (0xaaad bytes) 2024-09-12T05:21:00.219 INFO:teuthology.orchestra.run.smithi059.stdout:2476 read 0x551c87f thru 0x5529ab2 (0xd234 bytes) 2024-09-12T05:21:00.220 INFO:teuthology.orchestra.run.smithi059.stdout:2477 punch from 0x2cd592f to 0x2cde225, (0x88f6 bytes) 2024-09-12T05:21:00.220 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.220 INFO:teuthology.orchestra.run.smithi059.stdout:2479 punch from 0x9827f75 to 0x9829f60, (0x1feb bytes) 2024-09-12T05:21:00.221 INFO:teuthology.orchestra.run.smithi059.stdout:2481 writesame 0x2a8bf67 thru 0x2a9a350 data_size 0x1(0xe3ea bytes) 2024-09-12T05:21:00.239 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:00.239 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:00.240 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:00.240 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:00.240 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:00.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:00.258 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:00.256+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:00.276 INFO:teuthology.orchestra.run.smithi059.stdout:2483 writesame 0x5a03386 thru 0x5a10ff7 data_size 0x8b(0xdc72 bytes) 2024-09-12T05:21:00.287 INFO:teuthology.orchestra.run.smithi059.stdout:2485 writesame 0xd93b94e thru 0xd940db7 data_size 0x5(0x546a bytes) 2024-09-12T05:21:00.289 INFO:teuthology.orchestra.run.smithi059.stdout:2486 write 0x22967ad thru 0x22a33ab (0xcbff bytes) 2024-09-12T05:21:00.291 INFO:teuthology.orchestra.run.smithi059.stdout:2488 read 0x6701803 thru 0x6708330 (0x6b2e bytes) 2024-09-12T05:21:00.291 INFO:teuthology.orchestra.run.smithi059.stdout:2489 write 0x136c29 thru 0x13aff0 (0x43c8 bytes) 2024-09-12T05:21:00.315 INFO:teuthology.orchestra.run.smithi059.stdout:2491 trunc from 0xd940db8 to 0x490cc8 2024-09-12T05:21:00.340 INFO:teuthology.orchestra.run.smithi059.stdout:2492 write 0x21430c6 thru 0x214d98e (0xa8c9 bytes) 2024-09-12T05:21:00.342 INFO:teuthology.orchestra.run.smithi059.stdout:2493 punch from 0x1258b45 to 0x125f81d, (0x6cd8 bytes) 2024-09-12T05:21:00.342 INFO:teuthology.orchestra.run.smithi059.stdout:2494 read 0x1c837ad thru 0x1c87949 (0x419d bytes) 2024-09-12T05:21:00.343 INFO:teuthology.orchestra.run.smithi059.stdout:2495 read 0xc50ed9 thru 0xc56dc6 (0x5eee bytes) 2024-09-12T05:21:00.359 INFO:teuthology.orchestra.run.smithi059.stdout:2496 trunc from 0x214d98f to 0xbd2b479 2024-09-12T05:21:00.359 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:00.356+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:00.369 INFO:teuthology.orchestra.run.smithi059.stdout:2497 trunc from 0xbd2b479 to 0xaa8ef45 2024-09-12T05:21:00.377 INFO:teuthology.orchestra.run.smithi059.stdout:2498 read 0x363cda7 thru 0x363d7c4 (0xa1e bytes) 2024-09-12T05:21:00.377 INFO:teuthology.orchestra.run.smithi059.stdout:2499 read 0x794c0fa thru 0x7957cf5 (0xbbfc bytes) 2024-09-12T05:21:00.377 INFO:teuthology.orchestra.run.smithi059.stdout:2501 write 0x9a2258 thru 0x9b08d4 (0xe67d bytes) 2024-09-12T05:21:00.380 INFO:teuthology.orchestra.run.smithi059.stdout:2502 read 0x91be88c thru 0x91ce11a (0xf88f bytes) 2024-09-12T05:21:00.380 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.380 INFO:teuthology.orchestra.run.smithi059.stdout:2505 read 0x9ffe576 thru 0xa009b6f (0xb5fa bytes) 2024-09-12T05:21:00.380 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.394 INFO:teuthology.orchestra.run.smithi059.stdout:2507 writesame 0xccb333a thru 0xccbd03c data_size 0x1(0x9d03 bytes) 2024-09-12T05:21:00.394 INFO:teuthology.orchestra.run.smithi059.stdout:2508 punch from 0x9b8f4d2 to 0x9b95dc9, (0x68f7 bytes) 2024-09-12T05:21:00.394 INFO:teuthology.orchestra.run.smithi059.stdout:2509 writesame 0x24c4bd7 thru 0x24cdef5 data_size 0x1(0x931f bytes) 2024-09-12T05:21:00.416 INFO:teuthology.orchestra.run.smithi059.stdout:2510 write 0x53c1bfe thru 0x53ce947 (0xcd4a bytes) 2024-09-12T05:21:00.420 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.420 INFO:teuthology.orchestra.run.smithi059.stdout:2513 write 0x43c6b40 thru 0x43c7e71 (0x1332 bytes) 2024-09-12T05:21:00.423 INFO:teuthology.orchestra.run.smithi059.stdout:2514 read 0xa17d2e3 thru 0xa18d223 (0xff41 bytes) 2024-09-12T05:21:00.423 INFO:teuthology.orchestra.run.smithi059.stdout:2515 read 0x64956fe thru 0x6496da4 (0x16a7 bytes) 2024-09-12T05:21:00.438 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4530 3.1d 3:b845397b:::rbd_object_map.1118e5842253:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.539218955000003, 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034828258000000001, 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4530 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898325+0000", 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898333+0000", 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3200000000000002e-06 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898372+0000", 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9403000000000002e-05 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898403+0000", 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1282999999999998e-05 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925774+0000", 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027371126999999999 2024-09-12T05:21:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925885+0000", 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110536 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.926372+0000", 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048729900000000001 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.931755+0000", 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053824099999999998 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.932970+0000", 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012150799999999999 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933079+0000", 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108736 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933152+0000", 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3910000000000002e-05 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.375393289999998, 2024-09-12T05:21:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:21:00.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:21:00.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.375297267000001, 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:21:00.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.454 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.375237964, 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.455 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:21:00.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:21:00.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:00.459 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.375181257999998, 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.463 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.374153919999998, 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.464 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:21:00.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:21:00.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.374094063000001, 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:00.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:21:00.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.472 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.374006256999998, 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.473 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:21:00.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.477 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.373323818999999, 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.373237207000003, 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.482 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:00.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.486 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11057 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.366555124999998, 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034782517999999998, 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11057 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070989+0000", 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.268e-06 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071050+0000", 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0294000000000002e-05 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071068+0000", 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8683000000000001e-05 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071083+0000", 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5167999999999999e-05 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105540+0000", 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034457039000000002 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105657+0000", 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116248 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105771+0000", 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113818 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22384 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.759120684999999, 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035328432999999999, 2024-09-12T05:21:00.491 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22384 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678423+0000", 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678427+0000", 2024-09-12T05:21:00.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999998e-06 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678436+0000", 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8589999999999994e-06 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678444+0000", 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4959999999999996e-06 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705279+0000", 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026834632000000001 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705520+0000", 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024076100000000001 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.706555+0000", 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001034933 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.710982+0000", 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044268010000000002 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713437+0000", 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024553029999999998 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713623+0000", 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018639399999999999 2024-09-12T05:21:00.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713751+0000", 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012766700000000001 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22385 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.759088577, 2024-09-12T05:21:00.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037690591000000002, 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22385 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678459+0000", 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7900000000000001e-06 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678468+0000", 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8890000000000008e-06 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678475+0000", 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8800000000000002e-06 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708857+0000", 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030381907999999999 2024-09-12T05:21:00.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708999+0000", 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014186900000000001 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.709638+0000", 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063908400000000005 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:00.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715839+0000", 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062014890000000001 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715882+0000", 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3188000000000001e-05 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716026+0000", 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014375999999999999 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716145+0000", 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011903700000000001 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22386 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.759058384999999, 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040447601, 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.503 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22386 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678496+0000", 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0623e-05 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678506+0000", 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7890000000000006e-06 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678513+0000", 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1359999999999999e-06 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711185+0000", 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032671814 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711506+0000", 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321417 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.712538+0000", 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010313760000000001 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716256+0000", 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037188350000000002 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718706+0000", 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024499159999999999 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718856+0000", 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015012900000000001 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718932+0000", 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5926000000000005e-05 2024-09-12T05:21:00.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22387 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.759019172999999, 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040806824999999998, 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:00.509 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22387 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:00.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678525+0000", 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678529+0000", 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678538+0000", 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1060000000000006e-06 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678545+0000", 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0260000000000002e-06 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713870+0000", 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035324960000000002 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714037+0000", 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167381 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714624+0000", 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058681300000000005 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718968+0000", 2024-09-12T05:21:00.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043441749999999996 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719059+0000", 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1019000000000004e-05 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719151+0000", 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1157999999999997e-05 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719331+0000", 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000180201 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23350 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 329728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:00.515 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.592206137000002, 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037806736000000001, 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23350 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845338+0000", 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845340+0000", 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.289e-06 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845347+0000", 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845353+0000", 2024-09-12T05:21:00.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875603+0000", 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030250139999999998 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875670+0000", 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6791999999999993e-05 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.883144+0000", 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007473553 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23729 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 514048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.582151749000001, 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035315419000000001, 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.520 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23729 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855392+0000", 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855395+0000", 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855403+0000", 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4980000000000006e-06 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855410+0000", 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6189999999999996e-06 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890120+0000", 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034710795000000003 2024-09-12T05:21:00.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890630+0000", 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000509901 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890707+0000", 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6423999999999999e-05 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25449 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.140506645999999, 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036956818000000002, 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25449 2024-09-12T05:21:00.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297037+0000", 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-07 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297041+0000", 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297052+0000", 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0866000000000001e-05 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297060+0000", 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7829999999999999e-06 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.327882+0000", 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0308218 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328015+0000", 2024-09-12T05:21:00.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133406 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328611+0000", 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059631400000000002 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333062+0000", 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044503540000000001 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333708+0000", 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064637699999999995 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333878+0000", 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016978800000000001 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333993+0000", 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115344 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.530 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25659 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.877023807, 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035645679, 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.531 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25659 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560520+0000", 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560523+0000", 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0520000000000002e-06 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560529+0000", 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1330000000000004e-06 2024-09-12T05:21:00.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560534+0000", 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589658+0000", 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029124035 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589799+0000", 2024-09-12T05:21:00.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014103 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.590443+0000", 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064374400000000002 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.592625+0000", 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021819439999999999 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596057+0000", 2024-09-12T05:21:00.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034316820000000001 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596119+0000", 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2811999999999994e-05 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596165+0000", 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5534999999999997e-05 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:54069 3.5 3:a432e2c0:::rbd_data.1118bf17036a.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0106078549999999, 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037526320000000002, 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 54069 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.537 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426936+0000", 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:00.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431511+0000", 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045748780000000001 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431528+0000", 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7353000000000001e-05 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431546+0000", 2024-09-12T05:21:00.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.825e-05 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431625+0000", 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8514000000000001e-05 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431706+0000", 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1582999999999995e-05 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:00.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.432261+0000", 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000554997 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.450928+0000", 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018666187000000001 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464396+0000", 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013468707 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:00.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464436+0000", 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9338000000000002e-05 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464462+0000", 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5891999999999999e-05 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:00.542 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:00.544 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:00.545 INFO:teuthology.orchestra.run.smithi059.stdout:2517 writesame 0xe55ba0b thru 0xe569899 data_size 0x35(0xde8f bytes) 2024-09-12T05:21:00.545 INFO:teuthology.orchestra.run.smithi059.stdout:2518 writesame 0x5c998ee thru 0x5c9b131 data_size 0x2(0x1844 bytes) 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2519 write 0x5f228e5 thru 0x5f31333 (0xea4f bytes) 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2520 write 0x2e0f101 thru 0x2e1a826 (0xb726 bytes) 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2524 trunc from 0xe56989a to 0xc670bc4 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2525 read 0x6c63115 thru 0x6c72b00 (0xf9ec bytes) 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2527 write 0x1af9b63 thru 0x1afd07a (0x3518 bytes) 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2530 write 0x11fbe7f thru 0x11fffa7 (0x4129 bytes) 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2532 read 0x4cc565a thru 0x4cd2445 (0xcdec bytes) 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2533 trunc from 0xc670bc4 to 0x3b45b1e 2024-09-12T05:21:00.546 INFO:teuthology.orchestra.run.smithi059.stdout:2534 write 0xa83692c thru 0xa838e74 (0x2549 bytes) 2024-09-12T05:21:00.546 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:00.540+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:00.549 INFO:teuthology.orchestra.run.smithi059.stdout:2536 writesame 0x188772e thru 0x189064c data_size 0x1b(0x8f1f bytes) 2024-09-12T05:21:00.563 INFO:teuthology.orchestra.run.smithi059.stdout:2537 write 0xad50bdf thru 0xad5b303 (0xa725 bytes) 2024-09-12T05:21:00.583 INFO:teuthology.orchestra.run.smithi059.stdout:2538 writesame 0xb248fcd thru 0xb25094e data_size 0x2(0x7982 bytes) 2024-09-12T05:21:00.595 INFO:teuthology.orchestra.run.smithi059.stdout:2542 trunc from 0xb25094f to 0xe55f8d6 2024-09-12T05:21:00.608 INFO:teuthology.orchestra.run.smithi059.stdout:2544 punch from 0x8bf0194 to 0x8bf2a45, (0x28b1 bytes) 2024-09-12T05:21:00.608 INFO:teuthology.orchestra.run.smithi059.stdout:2545 write 0x482df1 thru 0x4885d3 (0x57e3 bytes) 2024-09-12T05:21:00.611 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:00.611 INFO:teuthology.orchestra.run.smithi059.stdout:2548 write 0x798e31c thru 0x7995415 (0x70fa bytes) 2024-09-12T05:21:00.615 INFO:teuthology.orchestra.run.smithi059.stdout:2549 clone 18 order 19 su 32768 sc 11 2024-09-12T05:21:00.645 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:21:00.640+0000 7f0506b04640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26493) UID: 0 2024-09-12T05:21:00.674 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:00.674 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:00.674 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:00.674 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:00.688 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:00.745 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:00.744+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:00.846 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:00.844+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:00.855 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:00.856 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:00.869 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:00.947 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:00.944+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:00.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:01.033 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.862185342, 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.034 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:21:01.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.038 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.861483822, 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:21:01.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:21:01.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.861361087999999, 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.043 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:21:01.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.047 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.861298874999999, 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:21:01.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.051 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.861232057999999, 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.052 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:21:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:01.056 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.861172024999998, 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:01.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.861092089, 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.061 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:01.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:21:01.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:21:01.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.861032527999999, 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.065 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:21:01.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860957739, 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860820339, 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:21:01.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22197 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 98304~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173330+0000", 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860740663000001, 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042975831999999999, 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22197 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173330+0000", 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173330+0000", 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173332+0000", 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3960000000000001e-06 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173338+0000", 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2559999999999999e-06 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173362+0000", 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3808999999999999e-05 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173378+0000", 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6049000000000002e-05 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216034+0000", 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042656010000000001 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216131+0000", 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6835000000000004e-05 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216306+0000", 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175477 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860668604000001, 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:01.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860605629999998, 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860469737999999, 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:21:01.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860405778000001, 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:21:01.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:21:01.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860321525, 2024-09-12T05:21:01.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:21:01.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:21:01.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860262165000002, 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:21:01.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:21:01.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860201898, 2024-09-12T05:21:01.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:21:01.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.860138904999999, 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:01.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:01.119 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.859978297000001, 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:01.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:01.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:01.124 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:01.124 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:01.124 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:21:01.124 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:01.124 INFO:tasks.thrashosds.thrasher:Killing osd 4, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T05:21:01.125 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T05:21:01.125 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:21:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:21:01.126 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:01.124+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:01.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:01.145 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:01.145 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:01.162 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:01.179 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:01.179 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:01.196 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:01.197 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:01.220 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T05:21:01.220 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.4 2024-09-12T05:21:01.220 INFO:tasks.thrashosds.thrasher:remote for osd 4 is ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:21:01.220 DEBUG:teuthology.orchestra.run.smithi194:> type ceph-objectstore-tool 2024-09-12T05:21:01.226 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T05:21:01.226 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op list-pgs 2024-09-12T05:21:01.226 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:01.224+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:01.246 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:01.246 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:01.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:01.327 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:01.324+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:01.425 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:01.425 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:01.428 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:01.424+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:01.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:01.528 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:01.528+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:01.609 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:01.609 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:01.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:01.629 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:01.628+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:01.730 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:01.728+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:01.750 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:01.750 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:01.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:01.780 INFO:teuthology.orchestra.run.smithi194.stdout:3.11 2024-09-12T05:21:01.780 INFO:teuthology.orchestra.run.smithi194.stdout:3.13 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.1 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.1a 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.1c 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.1d 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.3 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.9 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.14 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.1b 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.a 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.e 2024-09-12T05:21:01.781 INFO:teuthology.orchestra.run.smithi194.stdout:3.f 2024-09-12T05:21:01.853 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:01.852+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:01.931 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:01.928+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:01.937 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:01.937 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:01.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:02.031 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:02.028+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:02.079 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op export --pgid 3.e --file /var/log/ceph/exp.3.e.4 2024-09-12T05:21:02.121 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:02.121 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:02.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:02.165 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:02.164+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:02.233 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:02.232+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:02.256 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:02.256 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:02.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:02.362 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:02.360+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:02.436 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:02.432+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:02.441 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:02.441 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:02.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:02.540 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:02.540+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:02.625 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:02.626 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:02.637 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:02.636+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:02.640 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:02.641 INFO:teuthology.orchestra.run.smithi194.stderr:Exporting 3.e info 3.e( v 57'192 (0'0,57'192] local-lis/les=23/24 n=41 ec=23/23 lis/c=23/23 les/c/f=24/24/0 sis=23) 2024-09-12T05:21:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:701f6bf6:::rbd_data.11187bfcbd74.000000000000001e:head# 2024-09-12T05:21:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:70335606:::rbd_data.11187bfcbd74.000000000000017a:head# 2024-09-12T05:21:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7065ac44:::rbd_data.1118e5842253.000000000000003e:head# 2024-09-12T05:21:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:709e6f38:::rbd_data.11187bfcbd74.0000000000000176:head# 2024-09-12T05:21:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:712770eb:::rbd_data.11187bfcbd74.0000000000000023:head# 2024-09-12T05:21:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7129332a:::rbd_data.11187bfcbd74.0000000000000021:head# 2024-09-12T05:21:02.646 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:713f9620:::rbd_data.1118e5842253.0000000000000019:head# 2024-09-12T05:21:02.646 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:71a492df:::rbd_object_map.1118bda01480:head# 2024-09-12T05:21:02.646 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:71d65270:::rbd_data.11187bfcbd74.00000000000002ae:head# 2024-09-12T05:21:02.646 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:71f2ce27:::rbd_data.111887da7c95.0000000000000009:head# 2024-09-12T05:21:02.647 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:725d86d7:::rbd_data.1118bd2b1382.0000000000000093:4# 2024-09-12T05:21:02.647 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:725d86d7:::rbd_data.1118bd2b1382.0000000000000093:head# 2024-09-12T05:21:02.647 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:728bb404:::rbd_data.11187bfcbd74.00000000000001aa:head# 2024-09-12T05:21:02.647 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:73ef2315:::rbd_data.11182c6d9c71.0000000000000021:head# 2024-09-12T05:21:02.648 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:74327403:::rbd_data.11187bfcbd74.00000000000002ea:head# 2024-09-12T05:21:02.648 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:744d36fe:::rbd_data.1118a362a851.000000000000000b:6# 2024-09-12T05:21:02.650 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:744d36fe:::rbd_data.1118a362a851.000000000000000b:head# 2024-09-12T05:21:02.650 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7453e475:::rbd_data.1118e5842253.0000000000000001:7# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7453e475:::rbd_data.1118e5842253.0000000000000001:head# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:746ecde1:::rbd_data.11187bfcbd74.00000000000002ff:head# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:74817d98:::rbd_data.11187bfcbd74.0000000000000104:head# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:74a62455:::rbd_data.11187bfcbd74.0000000000000226:head# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:74bcc65a:::rbd_data.11187bfcbd74.0000000000000311:head# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:74f2f263:::rbd_data.1118e5842253.0000000000000058:head# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7525745f:::rbd_data.111887da7c95.000000000000008a:f# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7525745f:::rbd_data.111887da7c95.000000000000008a:head# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:75c708a7:::rbd_data.111887da7c95.0000000000000029:head# 2024-09-12T05:21:02.652 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:76178cbe:::rbd_data.111887da7c95.0000000000000243:f# 2024-09-12T05:21:02.653 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:76178cbe:::rbd_data.111887da7c95.0000000000000243:head# 2024-09-12T05:21:02.653 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:761f4963:::rbd_data.11187bfcbd74.00000000000002a3:head# 2024-09-12T05:21:02.653 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:762aec90:::rbd_data.1118feb697f7.000000000000000b:head# 2024-09-12T05:21:02.654 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7631854f:::rbd_data.111887da7c95.0000000000000378:f# 2024-09-12T05:21:02.654 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7631854f:::rbd_data.111887da7c95.0000000000000378:head# 2024-09-12T05:21:02.654 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7688fbfd:::rbd_data.1118e5842253.0000000000000009:7# 2024-09-12T05:21:02.656 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:7688fbfd:::rbd_data.1118e5842253.0000000000000009:head# 2024-09-12T05:21:02.656 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:76e905ee:::rbd_data.11187bfcbd74.0000000000000293:head# 2024-09-12T05:21:02.656 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:779e1584:::rbd_data.11187bfcbd74.0000000000000322:head# 2024-09-12T05:21:02.656 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:779e9e6d:::rbd_data.111887da7c95.000000000000007d:head# 2024-09-12T05:21:02.656 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:77b0b111:::rbd_data.11187bfcbd74.00000000000001d6:11# 2024-09-12T05:21:02.657 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:77b0b111:::rbd_data.11187bfcbd74.00000000000001d6:head# 2024-09-12T05:21:02.657 INFO:teuthology.orchestra.run.smithi194.stderr:Read #3:77b6cef9:::rbd_data.11187bfcbd74.000000000000029d:head# 2024-09-12T05:21:02.657 INFO:teuthology.orchestra.run.smithi194.stderr:Export successful 2024-09-12T05:21:02.738 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:02.736+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:02.805 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:02.805 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:02.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:02.868 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:02.868+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:02.940 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:02.940+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:02.948 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:02.949 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:02.961 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --force --op remove --pgid 3.e 2024-09-12T05:21:02.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:03.045 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:03.044+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:03.131 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:03.131 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:03.142 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:03.140+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:03.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:21:03.149 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:03.242 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone17 2024-09-12T05:21:03.242 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:03.240+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:03.278 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:03.278 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:03.278 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:03.278 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:03.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:03.381 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:03.380+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:03.444 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:03.444+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:03.448 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-12T05:21:03.454 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:03.454 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:03.454 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:03.454 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:03.454 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:03.468 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:03.546 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:03.544+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:03.593 INFO:teuthology.orchestra.run.smithi059.stdout:2550 writesame 0xddd16c5 thru 0xddd607a data_size 0x33(0x49b6 bytes) 2024-09-12T05:21:03.605 INFO:teuthology.orchestra.run.smithi059.stdout:2551 read 0x35773c2 thru 0x3585b66 (0xe7a5 bytes) 2024-09-12T05:21:03.607 INFO:teuthology.orchestra.run.smithi059.stdout:2552 trunc from 0xe55f8d6 to 0xe2c9925 2024-09-12T05:21:03.641 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:03.641 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:03.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:03.641 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:03.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.641 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4530 3.1d 3:b845397b:::rbd_object_map.1118e5842253:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:21:03.641 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.738689026999999, 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034828258000000001, 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4530 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898325+0000", 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898333+0000", 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3200000000000002e-06 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898372+0000", 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9403000000000002e-05 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898403+0000", 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1282999999999998e-05 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925774+0000", 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027371126999999999 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925885+0000", 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110536 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.926372+0000", 2024-09-12T05:21:03.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048729900000000001 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.931755+0000", 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053824099999999998 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.932970+0000", 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012150799999999999 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:03.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933079+0000", 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108736 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933152+0000", 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3910000000000002e-05 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:03.647 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.574863362000002, 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.651 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.574767338999997, 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.652 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:21:03.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.656 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.574708035999997, 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.574651330000002, 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:21:03.661 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:21:03.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.573623992000002, 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:21:03.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:21:03.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.573564134999998, 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:21:03.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:21:03.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.573476329000002, 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:21:03.675 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:21:03.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:21:03.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.572793891000003, 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:21:03.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.572707278999999, 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.685 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11057 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 36.566025197000002, 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034782517999999998, 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.690 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11057 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070989+0000", 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.268e-06 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071050+0000", 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0294000000000002e-05 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071068+0000", 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8683000000000001e-05 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071083+0000", 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5167999999999999e-05 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105540+0000", 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034457039000000002 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105657+0000", 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116248 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105771+0000", 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113818 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22384 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.958590757, 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035328432999999999, 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22384 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678423+0000", 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678427+0000", 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999998e-06 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678436+0000", 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8589999999999994e-06 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678444+0000", 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4959999999999996e-06 2024-09-12T05:21:03.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705279+0000", 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026834632000000001 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705520+0000", 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024076100000000001 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.706555+0000", 2024-09-12T05:21:03.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001034933 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.710982+0000", 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044268010000000002 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713437+0000", 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024553029999999998 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713623+0000", 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018639399999999999 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713751+0000", 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012766700000000001 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22385 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:03.700 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.958558649, 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037690591000000002, 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22385 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678459+0000", 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7900000000000001e-06 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678468+0000", 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8890000000000008e-06 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678475+0000", 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8800000000000002e-06 2024-09-12T05:21:03.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708857+0000", 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030381907999999999 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708999+0000", 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014186900000000001 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:03.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.709638+0000", 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063908400000000005 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715839+0000", 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062014890000000001 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715882+0000", 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3188000000000001e-05 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716026+0000", 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014375999999999999 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716145+0000", 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011903700000000001 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22386 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.958528457, 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040447601, 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22386 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678496+0000", 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0623e-05 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678506+0000", 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7890000000000006e-06 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678513+0000", 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1359999999999999e-06 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711185+0000", 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032671814 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711506+0000", 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321417 2024-09-12T05:21:03.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.712538+0000", 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010313760000000001 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716256+0000", 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037188350000000002 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:03.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718706+0000", 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024499159999999999 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718856+0000", 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015012900000000001 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718932+0000", 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5926000000000005e-05 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22387 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.958489244999999, 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040806824999999998, 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22387 2024-09-12T05:21:03.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678525+0000", 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678529+0000", 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678538+0000", 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1060000000000006e-06 2024-09-12T05:21:03.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678545+0000", 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0260000000000002e-06 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713870+0000", 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035324960000000002 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714037+0000", 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167381 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714624+0000", 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058681300000000005 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718968+0000", 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043441749999999996 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719059+0000", 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1019000000000004e-05 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719151+0000", 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1157999999999997e-05 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719331+0000", 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000180201 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.718 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23350 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 329728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.791676208999998, 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037806736000000001, 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.719 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23350 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845338+0000", 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845340+0000", 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.289e-06 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845347+0000", 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845353+0000", 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875603+0000", 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030250139999999998 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875670+0000", 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6791999999999993e-05 2024-09-12T05:21:03.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.883144+0000", 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007473553 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23729 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 514048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.781621821000002, 2024-09-12T05:21:03.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035315419000000001, 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23729 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855392+0000", 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855395+0000", 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855403+0000", 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4980000000000006e-06 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855410+0000", 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6189999999999996e-06 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890120+0000", 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034710795000000003 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890630+0000", 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000509901 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890707+0000", 2024-09-12T05:21:03.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6423999999999999e-05 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25449 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.339976717999999, 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036956818000000002, 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:03.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25449 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:03.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297037+0000", 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-07 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297041+0000", 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297052+0000", 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0866000000000001e-05 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297060+0000", 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7829999999999999e-06 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.327882+0000", 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0308218 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328015+0000", 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133406 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328611+0000", 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059631400000000002 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333062+0000", 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044503540000000001 2024-09-12T05:21:03.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333708+0000", 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064637699999999995 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333878+0000", 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016978800000000001 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333993+0000", 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115344 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25659 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.076493879000001, 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035645679, 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:03.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25659 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:03.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560520+0000", 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560523+0000", 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0520000000000002e-06 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560529+0000", 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1330000000000004e-06 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560534+0000", 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589658+0000", 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029124035 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589799+0000", 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014103 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.590443+0000", 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064374400000000002 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.592625+0000", 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021819439999999999 2024-09-12T05:21:03.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596057+0000", 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034316820000000001 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596119+0000", 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2811999999999994e-05 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596165+0000", 2024-09-12T05:21:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5534999999999997e-05 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:54069 3.5 3:a432e2c0:::rbd_data.1118bf17036a.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.2100779270000004, 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037526320000000002, 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:03.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 54069 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:03.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426936+0000", 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431511+0000", 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045748780000000001 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431528+0000", 2024-09-12T05:21:03.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7353000000000001e-05 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431546+0000", 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.825e-05 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431625+0000", 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8514000000000001e-05 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431706+0000", 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1582999999999995e-05 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.432261+0000", 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000554997 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.450928+0000", 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018666187000000001 2024-09-12T05:21:03.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464396+0000", 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013468707 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464436+0000", 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9338000000000002e-05 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464462+0000", 2024-09-12T05:21:03.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5891999999999999e-05 2024-09-12T05:21:03.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.747 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:03.747 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:03.747 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:03.749 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:03.750 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:03.744+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:03.750 INFO:teuthology.orchestra.run.smithi059.stdout:2553 punch from 0x9fb26c7 to 0x9fb8f13, (0x684c bytes) 2024-09-12T05:21:03.750 INFO:teuthology.orchestra.run.smithi059.stdout:2554 read 0xcba8618 thru 0xcbaeabd (0x64a6 bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2556 punch from 0x6e139fe to 0x6e144f4, (0xaf6 bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2557 read 0xd2f2611 thru 0xd2fc1ad (0x9b9d bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2558 read 0xc0f29da thru 0xc0f3cca (0x12f1 bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2560 writesame 0x29c7db2 thru 0x29d319a data_size 0x35(0xb3e9 bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2561 read 0x5112bb0 thru 0x511f577 (0xc9c8 bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2564 write 0xc0791d3 thru 0xc089109 (0xff37 bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2566 write 0xd5b8f90 thru 0xd5c7a78 (0xeae9 bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2568 write 0x990624e thru 0x9914c1c (0xe9cf bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2569 writesame 0xe69f4f5 thru 0xe6a3492 data_size 0x2(0x3f9e bytes) 2024-09-12T05:21:03.751 INFO:teuthology.orchestra.run.smithi059.stdout:2570 writesame 0xd54cf4a thru 0xd55b564 data_size 0x1(0xe61b bytes) 2024-09-12T05:21:03.765 INFO:teuthology.orchestra.run.smithi059.stdout:2571 read 0x124991c thru 0x1250413 (0x6af8 bytes) 2024-09-12T05:21:03.767 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:03.776 INFO:teuthology.orchestra.run.smithi059.stdout:2574 trunc from 0xe6a3493 to 0xc3b99f3 2024-09-12T05:21:03.843 INFO:teuthology.orchestra.run.smithi059.stdout:2575 trunc from 0xc3b99f3 to 0x7a2f9b8 2024-09-12T05:21:03.849 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:03.848+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:03.902 INFO:teuthology.orchestra.run.smithi059.stdout:2576 read 0x5d5715 thru 0x5dcb14 (0x7400 bytes) 2024-09-12T05:21:03.903 INFO:teuthology.orchestra.run.smithi059.stdout:2577 punch from 0x113522d to 0x1140f56, (0xbd29 bytes) 2024-09-12T05:21:03.905 INFO:teuthology.orchestra.run.smithi059.stdout:2579 trunc from 0x7a2f9b8 to 0x7192581 2024-09-12T05:21:03.939 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:03.939 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:03.939 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:03.939 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:03.950 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:03.948+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:03.955 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:03.966 INFO:teuthology.orchestra.run.smithi059.stdout:2580 read 0x49f1f64 thru 0x49f605a (0x40f7 bytes) 2024-09-12T05:21:03.966 INFO:teuthology.orchestra.run.smithi059.stdout:2581 read 0x3e456f6 thru 0x3e50605 (0xaf10 bytes) 2024-09-12T05:21:03.968 INFO:teuthology.orchestra.run.smithi059.stdout:2582 writesame 0x65eca6e thru 0x65f3659 data_size 0x2(0x6bec bytes) 2024-09-12T05:21:03.981 INFO:teuthology.orchestra.run.smithi059.stdout:2583 writesame 0x4cbd251 thru 0x4cc23a1 data_size 0x1b(0x5151 bytes) 2024-09-12T05:21:03.995 INFO:teuthology.orchestra.run.smithi059.stdout:2584 write 0x68957c7 thru 0x689cbe6 (0x7420 bytes) 2024-09-12T05:21:04.005 INFO:teuthology.orchestra.run.smithi059.stdout:2587 write 0x15cd7ab thru 0x15d04c4 (0x2d1a bytes) 2024-09-12T05:21:04.021 INFO:teuthology.orchestra.run.smithi059.stdout:2588 read 0x1f7ddde thru 0x1f88ad0 (0xacf3 bytes) 2024-09-12T05:21:04.042 INFO:teuthology.orchestra.run.smithi059.stdout:2589 trunc from 0x7192581 to 0x3410c5 2024-09-12T05:21:04.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:04.048+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:04.120 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:04.120 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:04.120 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:04.121 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:04.121 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:04.136 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:04.152 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:04.148+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:21:04.179 INFO:teuthology.orchestra.run.smithi059.stdout:2590 write 0xa9bcfb2 thru 0xa9bf2e9 (0x2338 bytes) 2024-09-12T05:21:04.185 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.186 INFO:teuthology.orchestra.run.smithi059.stdout:2593 read 0x7bc82b6 thru 0x7bcb030 (0x2d7b bytes) 2024-09-12T05:21:04.186 INFO:teuthology.orchestra.run.smithi059.stdout:2595 read 0x548f6e6 thru 0x54982ab (0x8bc6 bytes) 2024-09-12T05:21:04.186 INFO:teuthology.orchestra.run.smithi059.stdout:2596 write 0x8ab5878 thru 0x8ac1bc9 (0xc352 bytes) 2024-09-12T05:21:04.198 INFO:teuthology.orchestra.run.smithi059.stdout:2597 punch from 0x130a0cc to 0x13187e7, (0xe71b bytes) 2024-09-12T05:21:04.213 INFO:teuthology.orchestra.run.smithi059.stdout:2598 trunc from 0xa9bf2ea to 0x237ece5 2024-09-12T05:21:04.246 INFO:teuthology.orchestra.run.smithi059.stdout:2599 trunc from 0x237ece5 to 0xb4916b6 2024-09-12T05:21:04.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:04.252+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:04.258 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.261 INFO:teuthology.orchestra.run.smithi059.stdout:2604 trunc from 0xb4916b6 to 0x98818e1 2024-09-12T05:21:04.272 INFO:teuthology.orchestra.run.smithi059.stdout:2605 read 0x364a29 thru 0x36d385 (0x895d bytes) 2024-09-12T05:21:04.273 INFO:teuthology.orchestra.run.smithi059.stdout:2606 read 0x36cde1a thru 0x36d0f25 (0x310c bytes) 2024-09-12T05:21:04.273 INFO:teuthology.orchestra.run.smithi059.stdout:2607 read 0x54d807e thru 0x54e7c29 (0xfbac bytes) 2024-09-12T05:21:04.273 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.292 INFO:teuthology.orchestra.run.smithi059.stdout:2610 write 0xbf64c2a thru 0xbf68a5e (0x3e35 bytes) 2024-09-12T05:21:04.302 INFO:teuthology.orchestra.run.smithi059.stdout:2611 write 0x1cbcd5 thru 0x1d4784 (0x8ab0 bytes) 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.139181423, 2024-09-12T05:21:04.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:21:04.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:21:04.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:04.317 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.138479903, 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:21:04.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:21:04.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.138357168999999, 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.138294955999999, 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.326 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:21:04.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:04.330 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.138228138999999, 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:04.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:21:04.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:21:04.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:21:04.334 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.138168105999998, 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.335 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:21:04.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.339 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.13808817, 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:04.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:21:04.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.138028608999999, 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.344 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:21:04.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:21:04.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.13795382, 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.352 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.13781642, 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22197 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 98304~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173330+0000", 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137736744000001, 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042975831999999999, 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22197 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173330+0000", 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173330+0000", 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173332+0000", 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3960000000000001e-06 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173338+0000", 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2559999999999999e-06 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173362+0000", 2024-09-12T05:21:04.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3808999999999999e-05 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173378+0000", 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6049000000000002e-05 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216034+0000", 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042656010000000001 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216131+0000", 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6835000000000004e-05 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216306+0000", 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000175477 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137664685000001, 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.363 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137601710999999, 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:21:04.367 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.371 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137465818999999, 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:21:04.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137401859000001, 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.376 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137317606, 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:21:04.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137258245999998, 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.385 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.389 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137197979, 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:21:04.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:21:04.393 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.137134986, 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.394 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:21:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.136974378000001, 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:21:04.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:21:04.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.402 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:04.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:04.405 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:04.400+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:04.405 INFO:teuthology.orchestra.run.smithi059.stdout:2612 trunc from 0xbf68a5f to 0xec4f03e 2024-09-12T05:21:04.405 INFO:teuthology.orchestra.run.smithi059.stdout:2614 write 0x9f49acd thru 0x9f4ef18 (0x544c bytes) 2024-09-12T05:21:04.405 INFO:teuthology.orchestra.run.smithi059.stdout:2616 read 0x200776e thru 0x200812f (0x9c2 bytes) 2024-09-12T05:21:04.405 INFO:teuthology.orchestra.run.smithi059.stdout:2617 read 0x9b4af76 thru 0x9b5973b (0xe7c6 bytes) 2024-09-12T05:21:04.405 INFO:teuthology.orchestra.run.smithi059.stdout:2618 trunc from 0xec4f03e to 0xc3dcc46 2024-09-12T05:21:04.405 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.405 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.406 INFO:teuthology.orchestra.run.smithi059.stdout:2621 punch from 0x30f1112 to 0x30ff8d1, (0xe7bf bytes) 2024-09-12T05:21:04.406 INFO:teuthology.orchestra.run.smithi059.stdout:2623 writesame 0xc9e1a8e thru 0xc9e3807 data_size 0x31(0x1d7a bytes) 2024-09-12T05:21:04.406 INFO:teuthology.orchestra.run.smithi059.stdout:2624 write 0x4d75fe4 thru 0x4d7a1c5 (0x41e2 bytes) 2024-09-12T05:21:04.406 INFO:teuthology.orchestra.run.smithi059.stdout:2625 write 0xebe77f2 thru 0xebe945c (0x1c6b bytes) 2024-09-12T05:21:04.410 INFO:teuthology.orchestra.run.smithi059.stdout:2626 punch from 0xcd979ec to 0xcd9fa1a, (0x802e bytes) 2024-09-12T05:21:04.410 INFO:teuthology.orchestra.run.smithi059.stdout:2627 read 0x19a4e4e thru 0x19b06a9 (0xb85c bytes) 2024-09-12T05:21:04.410 INFO:teuthology.orchestra.run.smithi059.stdout:2628 write 0x20cfec5 thru 0x20dc2e1 (0xc41d bytes) 2024-09-12T05:21:04.423 INFO:teuthology.orchestra.run.smithi059.stdout:2629 write 0x98e2c76 thru 0x98ed814 (0xab9f bytes) 2024-09-12T05:21:04.435 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.436 INFO:teuthology.orchestra.run.smithi059.stdout:2631 read 0x7d16a79 thru 0x7d22d9b (0xc323 bytes) 2024-09-12T05:21:04.464 INFO:teuthology.orchestra.run.smithi059.stdout:2632 trunc from 0xebe945d to 0x499c0cb 2024-09-12T05:21:04.495 INFO:teuthology.orchestra.run.smithi059.stdout:2634 trunc from 0x499c0cb to 0x5d9c2eb 2024-09-12T05:21:04.504 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:04.500+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:04.535 INFO:teuthology.orchestra.run.smithi059.stdout:2636 write 0x8f02456 thru 0x8f02f56 (0xb01 bytes) 2024-09-12T05:21:04.543 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.567 INFO:teuthology.orchestra.run.smithi059.stdout:2638 write 0xbcd9476 thru 0xbcd9e54 (0x9df bytes) 2024-09-12T05:21:04.569 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:04.569 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:04.569 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:04.569 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:04.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:04.597 INFO:teuthology.orchestra.run.smithi059.stdout:2639 write 0xd7d0824 thru 0xd7d4460 (0x3c3d bytes) 2024-09-12T05:21:04.604 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.605 INFO:teuthology.orchestra.run.smithi059.stdout:2643 punch from 0x3c358a to 0x3cbfca, (0x8a40 bytes) 2024-09-12T05:21:04.605 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:04.605 INFO:teuthology.orchestra.run.smithi059.stdout:2645 punch from 0xd0e51b7 to 0xd0e60a4, (0xeed bytes) 2024-09-12T05:21:04.605 INFO:teuthology.orchestra.run.smithi059.stdout:2646 write 0xc0af8fe thru 0xc0aff9f (0x6a2 bytes) 2024-09-12T05:21:04.605 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:04.604+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:04.615 INFO:teuthology.orchestra.run.smithi059.stdout:2647 trunc from 0xd7d4461 to 0xe9788c8 2024-09-12T05:21:04.630 INFO:teuthology.orchestra.run.smithi059.stdout:2648 read 0x6ea305e thru 0x6ea3361 (0x304 bytes) 2024-09-12T05:21:04.652 INFO:teuthology.orchestra.run.smithi059.stdout:2649 trunc from 0xe9788c8 to 0x66b3e0d 2024-09-12T05:21:04.678 INFO:teuthology.orchestra.run.smithi059.stdout:2650 read 0x42ee70d thru 0x42f6d97 (0x868b bytes) 2024-09-12T05:21:04.681 INFO:teuthology.orchestra.run.smithi059.stdout:2652 trunc from 0x66b3e0d to 0x5783e2f 2024-09-12T05:21:04.698 INFO:teuthology.orchestra.run.smithi059.stdout:2653 read 0x67c9e0 thru 0x68bbd4 (0xf1f5 bytes) 2024-09-12T05:21:04.698 INFO:teuthology.orchestra.run.smithi059.stdout:2654 write 0x159fd41 thru 0x15ab549 (0xb809 bytes) 2024-09-12T05:21:04.705 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:04.704+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:04.711 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:04.711 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:04.712 INFO:teuthology.orchestra.run.smithi059.stdout:2655 write 0x2d856c7 thru 0x2d865bc (0xef6 bytes) 2024-09-12T05:21:04.719 INFO:teuthology.orchestra.run.smithi059.stdout:2658 write 0x38b1ab7 thru 0x38c10b6 (0xf600 bytes) 2024-09-12T05:21:04.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:04.732 INFO:teuthology.orchestra.run.smithi059.stdout:2659 writesame 0x1ef072b thru 0x1efc4de data_size 0x8e(0xbdb4 bytes) 2024-09-12T05:21:04.744 INFO:teuthology.orchestra.run.smithi059.stdout:2660 punch from 0x40f2de4 to 0x41013ee, (0xe60a bytes) 2024-09-12T05:21:04.744 INFO:teuthology.orchestra.run.smithi059.stdout:2661 clone 19 order 24 su 65536 sc 2 2024-09-12T05:21:04.807 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:04.804+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:04.892 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:04.892 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:04.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:04.892 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:04.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.892 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.013676109000002, 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.10902002500000001, 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:21:04.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878726+0000", 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878741+0000", 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4696e-05 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878767+0000", 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5812999999999998e-05 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878789+0000", 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.179e-05 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878868+0000", 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9116999999999995e-05 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878878+0000", 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8549999999999997e-06 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.984853+0000", 2024-09-12T05:21:04.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.105974939 2024-09-12T05:21:04.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985185+0000", 2024-09-12T05:21:04.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000332827 2024-09-12T05:21:04.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:21:04.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985604+0000", 2024-09-12T05:21:04.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000418477 2024-09-12T05:21:04.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.986868+0000", 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001264004 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987594+0000", 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072604400000000002 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987679+0000", 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4826000000000004e-05 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987744+0000", 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4716999999999997e-05 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4322 3.13 3:ceb672dc:::rbd_data.1118e5842253.0000000000000068:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:21:04.901 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.251006222999997, 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056729952, 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4322 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641396+0000", 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0970000000000002e-06 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641409+0000", 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.291e-05 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641440+0000", 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0380000000000001e-05 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641456+0000", 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5906999999999999e-05 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641572+0000", 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116452 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641803+0000", 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000230671 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.651415+0000", 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096118660000000002 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697868+0000", 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046453047999999997 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697904+0000", 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6313000000000003e-05 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:04.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697997+0000", 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3356000000000005e-05 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.698123+0000", 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125952 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22115 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1523712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166366+0000", 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.726033812000001, 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052083004000000002, 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22115 2024-09-12T05:21:04.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166366+0000", 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166366+0000", 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166367+0000", 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859999999999999e-06 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166386+0000", 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166406+0000", 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9514999999999999e-05 2024-09-12T05:21:04.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166420+0000", 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4583000000000001e-05 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218056+0000", 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051635161999999998 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218259+0000", 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020350000000000001 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218449+0000", 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018969500000000001 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22116 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1753088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.912 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166442+0000", 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725957952999998, 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052484348, 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22116 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166442+0000", 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166442+0000", 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166443+0000", 2024-09-12T05:21:04.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2529999999999999e-06 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166448+0000", 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3029999999999999e-06 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166466+0000", 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7612999999999999e-05 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166483+0000", 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7105999999999999e-05 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218547+0000", 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052064423999999998 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218749+0000", 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020144999999999999 2024-09-12T05:21:04.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218926+0000", 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017719900000000001 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22118 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1982464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725897426, 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052766258000000003, 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22118 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:04.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166503+0000", 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1629999999999999e-06 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166508+0000", 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166526+0000", 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7699000000000001e-05 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166540+0000", 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4286e-05 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219002+0000", 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052461397999999999 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219106+0000", 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104694 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219268+0000", 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000162015 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22161 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.922 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725839932, 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052998134000000002, 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22161 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.923 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:04.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:04.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166561+0000", 2024-09-12T05:21:04.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:04.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166566+0000", 2024-09-12T05:21:04.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5860000000000004e-06 2024-09-12T05:21:04.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166584+0000", 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166598+0000", 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3665999999999999e-05 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219347+0000", 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052748841999999997 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219439+0000", 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2453000000000004e-05 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219558+0000", 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011851800000000001 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22163 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725782322000001, 2024-09-12T05:21:04.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053262859000000003, 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22163 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166618+0000", 2024-09-12T05:21:04.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1659999999999999e-06 2024-09-12T05:21:04.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166624+0000", 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3299999999999998e-06 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166641+0000", 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7016000000000001e-05 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166655+0000", 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4358999999999999e-05 2024-09-12T05:21:04.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219631+0000", 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052976286999999997 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219740+0000", 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108663 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219880+0000", 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014003799999999999 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22165 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 491520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725724671999998, 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.05349143, 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.935 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22165 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166677+0000", 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-06 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166682+0000", 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-12T05:21:04.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166706+0000", 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4063e-05 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166721+0000", 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4851999999999999e-05 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219948+0000", 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053227479000000001 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220029+0000", 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0564999999999999e-05 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220166+0000", 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013738499999999999 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22167 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 720896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.940 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725657261999999, 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053842714, 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22167 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166744+0000", 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166750+0000", 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0499999999999997e-06 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166768+0000", 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7918999999999999e-05 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166781+0000", 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3784999999999999e-05 2024-09-12T05:21:04.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220258+0000", 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053476165999999999 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220447+0000", 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018942699999999999 2024-09-12T05:21:04.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220585+0000", 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013815 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22168 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 950272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725599202000001, 2024-09-12T05:21:04.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054040510999999999, 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22168 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166802+0000", 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166807+0000", 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1460000000000004e-06 2024-09-12T05:21:04.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166828+0000", 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0752999999999999e-05 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166842+0000", 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4405e-05 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220648+0000", 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053806172999999999 2024-09-12T05:21:04.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220728+0000", 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0175999999999999e-05 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220841+0000", 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011250400000000001 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22170 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1048576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725537711000001, 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054240254000000002, 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.950 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22170 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166863+0000", 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166868+0000", 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2000000000000002e-06 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166886+0000", 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7462e-05 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166899+0000", 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3059e-05 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220904+0000", 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054004732999999999 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221006+0000", 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102895 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221102+0000", 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22172 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1277952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725481624, 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054417, 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22172 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166919+0000", 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.173e-06 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166925+0000", 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166942+0000", 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7246000000000001e-05 2024-09-12T05:21:04.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166957+0000", 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4419e-05 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221168+0000", 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054211102999999997 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221251+0000", 2024-09-12T05:21:04.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2956999999999999e-05 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221335+0000", 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4122000000000005e-05 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22174 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725424187000002, 2024-09-12T05:21:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054612105000000001, 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22174 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166977+0000", 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.156e-06 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166982+0000", 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167000+0000", 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7336000000000001e-05 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167013+0000", 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3106e-05 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221400+0000", 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054387255000000002 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221493+0000", 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3117999999999999e-05 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221588+0000", 2024-09-12T05:21:04.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4524000000000005e-05 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22176 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725365799999999, 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054762312, 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22176 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167035+0000", 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167064+0000", 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459e-05 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167098+0000", 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4041000000000002e-05 2024-09-12T05:21:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167156+0000", 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7401000000000002e-05 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221640+0000", 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054484170999999998 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221714+0000", 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4345999999999996e-05 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221796+0000", 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1757999999999999e-05 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22178 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.725219151000001, 2024-09-12T05:21:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054845368999999998, 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22178 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167182+0000", 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167189+0000", 2024-09-12T05:21:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.81e-06 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167221+0000", 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2400999999999997e-05 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167237+0000", 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5693e-05 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221845+0000", 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054608139 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221934+0000", 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9586000000000006e-05 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.222026+0000", 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1466999999999997e-05 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:55996 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.1943852279999998, 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054112130000000001, 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 55996 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698015+0000", 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.82e-07 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698017+0000", 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1799999999999999e-06 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698024+0000", 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5830000000000003e-06 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698028+0000", 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7299999999999996e-06 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748691+0000", 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050662709 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748758+0000", 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6920000000000003e-05 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752127+0000", 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033684259999999999 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56145 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.1888506890000006, 2024-09-12T05:21:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053461886, 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56145 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703552+0000", 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3879999999999998e-06 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703559+0000", 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5059999999999998e-06 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703565+0000", 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.964e-06 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752009+0000", 2024-09-12T05:21:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.048444050000000002 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752076+0000", 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7083999999999997e-05 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757011+0000", 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049343850000000003 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56146 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.1888265469999997, 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053664649000000002, 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56146 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703574+0000", 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5699999999999998e-07 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703581+0000", 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5560000000000002e-06 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703589+0000", 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4420000000000001e-06 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703595+0000", 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0070000000000003e-06 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757060+0000", 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053465909999999998 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757143+0000", 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2974999999999998e-05 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757238+0000", 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4302000000000006e-05 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56147 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.1887969250000001, 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054033454000000002, 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56147 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703606+0000", 2024-09-12T05:21:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.305e-06 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703613+0000", 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1720000000000001e-06 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703618+0000", 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7339999999999996e-06 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757277+0000", 2024-09-12T05:21:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053658748999999999 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757529+0000", 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025211199999999997 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757636+0000", 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010683600000000001 2024-09-12T05:21:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56148 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.1887739370000006, 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054391660000000001, 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56148 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703629+0000", 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4339999999999999e-06 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703636+0000", 2024-09-12T05:21:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1999999999999997e-06 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703642+0000", 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1829999999999999e-06 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757667+0000", 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054025148000000002 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757737+0000", 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9640000000000004e-05 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.758017+0000", 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000280594 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:04.997 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:04.998 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:04.996+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:04.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:05.099 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:05.096+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:05.133 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:05.133 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:05.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:05.199 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:05.196+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:05.267 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone18 2024-09-12T05:21:05.286 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:05.287 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:05.301 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:05.300+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:05.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:05.388 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-12T05:21:05.402 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:05.400+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:05.490 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:05.491 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:05.503 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:05.500+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:05.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:05.535 INFO:teuthology.orchestra.run.smithi194.stdout: marking collection for removal 2024-09-12T05:21:05.535 INFO:teuthology.orchestra.run.smithi194.stdout:setting '_remove' omap key 2024-09-12T05:21:05.535 INFO:teuthology.orchestra.run.smithi194.stdout:finish_remove_pgs 3.e_head removing 3.e 2024-09-12T05:21:05.540 INFO:teuthology.orchestra.run.smithi194.stdout:Remove successful 2024-09-12T05:21:05.604 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:05.600+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:05.693 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:05.693 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:05.705 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:05.704+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:05.709 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:05.791 INFO:teuthology.orchestra.run.smithi059.stdout:2662 read 0x4619a1e thru 0x46270ae (0xd691 bytes) 2024-09-12T05:21:05.806 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:05.804+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:05.822 INFO:teuthology.orchestra.run.smithi059.stdout:2663 writesame 0xda761ea thru 0xda83373 data_size 0x1(0xd18a bytes) 2024-09-12T05:21:05.822 INFO:teuthology.orchestra.run.smithi059.stdout:2665 writesame 0x25ca1c6 thru 0x25d078c data_size 0x2d(0x65c7 bytes) 2024-09-12T05:21:05.839 INFO:teuthology.orchestra.run.smithi059.stdout:2666 write 0xbf1339a thru 0xbf1f2a5 (0xbf0c bytes) 2024-09-12T05:21:05.846 INFO:teuthology.orchestra.run.smithi059.stdout:2667 read 0x2d09fc5 thru 0x2d15cd6 (0xbd12 bytes) 2024-09-12T05:21:05.846 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:05.846 INFO:teuthology.orchestra.run.smithi059.stdout:2670 read 0xa8574d7 thru 0xa858363 (0xe8d bytes) 2024-09-12T05:21:05.851 INFO:teuthology.orchestra.run.smithi059.stdout:2671 trunc from 0xda83374 to 0xb68cd24 2024-09-12T05:21:05.864 INFO:teuthology.orchestra.run.smithi059.stdout:2672 read 0xf1aa8 thru 0xf4c93 (0x31ec bytes) 2024-09-12T05:21:05.869 INFO:teuthology.orchestra.run.smithi059.stdout:2673 trunc from 0xb68cd24 to 0x8ddae43 2024-09-12T05:21:05.885 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:05.886 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:05.893 INFO:teuthology.orchestra.run.smithi059.stdout:2675 read 0x7c73272 thru 0x7c77f77 (0x4d06 bytes) 2024-09-12T05:21:05.894 INFO:teuthology.orchestra.run.smithi059.stdout:2676 write 0x39f9c84 thru 0x3a03b90 (0x9f0d bytes) 2024-09-12T05:21:05.899 INFO:teuthology.orchestra.run.smithi059.stdout:2677 read 0x3b6ce29 thru 0x3b769f2 (0x9bca bytes) 2024-09-12T05:21:05.900 INFO:teuthology.orchestra.run.smithi059.stdout:2681 read 0x55f93fb thru 0x55fe8b4 (0x54ba bytes) 2024-09-12T05:21:05.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:05.902 INFO:teuthology.orchestra.run.smithi059.stdout:2682 read 0x1921f0b thru 0x192d7a2 (0xb898 bytes) 2024-09-12T05:21:05.914 INFO:teuthology.orchestra.run.smithi059.stdout:2683 write 0x9e18bb2 thru 0x9e19241 (0x690 bytes) 2024-09-12T05:21:05.915 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:05.912+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:05.920 INFO:teuthology.orchestra.run.smithi059.stdout:2685 read 0x3460d3 thru 0x348a81 (0x29af bytes) 2024-09-12T05:21:05.924 INFO:teuthology.orchestra.run.smithi059.stdout:2686 trunc from 0x9e19242 to 0xb767d52 2024-09-12T05:21:05.936 INFO:teuthology.orchestra.run.smithi059.stdout:2688 write 0x341d7de thru 0x3422642 (0x4e65 bytes) 2024-09-12T05:21:05.942 INFO:teuthology.orchestra.run.smithi059.stdout:2690 write 0xb1847bb thru 0xb18750e (0x2d54 bytes) 2024-09-12T05:21:05.948 INFO:teuthology.orchestra.run.smithi059.stdout:2691 write 0x48f2ed1 thru 0x48fddec (0xaf1c bytes) 2024-09-12T05:21:05.957 INFO:teuthology.orchestra.run.smithi059.stdout:2693 read 0x3176862 thru 0x317691c (0xbb bytes) 2024-09-12T05:21:05.958 INFO:teuthology.orchestra.run.smithi059.stdout:2695 read 0xac45e41 thru 0xac4a15c (0x431c bytes) 2024-09-12T05:21:05.977 INFO:teuthology.orchestra.run.smithi059.stdout:2696 trunc from 0xb767d52 to 0x19bbb0a 2024-09-12T05:21:06.008 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:06.004+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:06.024 INFO:teuthology.orchestra.run.smithi059.stdout:2697 punch from 0xcaff7c to 0xcb5d98, (0x5e1c bytes) 2024-09-12T05:21:06.045 INFO:teuthology.orchestra.run.smithi059.stdout:2698 write 0x8970d10 thru 0x8976940 (0x5c31 bytes) 2024-09-12T05:21:06.050 INFO:teuthology.orchestra.run.smithi059.stdout:2699 read 0x1d7a483 thru 0x1d7b714 (0x1292 bytes) 2024-09-12T05:21:06.051 INFO:teuthology.orchestra.run.smithi059.stdout:2700 read 0x5e979e3 thru 0x5ea2e06 (0xb424 bytes) 2024-09-12T05:21:06.051 INFO:teuthology.orchestra.run.smithi059.stdout:2701 write 0x7721c59 thru 0x7722d0c (0x10b4 bytes) 2024-09-12T05:21:06.057 INFO:teuthology.orchestra.run.smithi059.stdout:2705 writesame 0xe8103c thru 0xe83e93 data_size 0x4(0x2e58 bytes) 2024-09-12T05:21:06.062 INFO:teuthology.orchestra.run.smithi059.stdout:2707 read 0x77a3369 thru 0x77acd9b (0x9a33 bytes) 2024-09-12T05:21:06.063 INFO:teuthology.orchestra.run.smithi059.stdout:2710 read 0x4e52eb8 thru 0x4e5f990 (0xcad9 bytes) 2024-09-12T05:21:06.063 INFO:teuthology.orchestra.run.smithi059.stdout:2711 write 0x514f23a thru 0x515421b (0x4fe2 bytes) 2024-09-12T05:21:06.067 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:06.067 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:06.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.e.4 2024-09-12T05:21:06.074 INFO:teuthology.orchestra.run.smithi059.stdout:2712 trunc from 0x8976941 to 0xa7a3d7a 2024-09-12T05:21:06.086 INFO:teuthology.orchestra.run.smithi059.stdout:2713 trunc from 0xa7a3d7a to 0xc520bd2 2024-09-12T05:21:06.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:06.109 INFO:teuthology.orchestra.run.smithi059.stdout:2714 writesame 0xd7ae45f thru 0xd7b8a76 data_size 0x14(0xa618 bytes) 2024-09-12T05:21:06.109 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:06.108+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:06.112 INFO:teuthology.orchestra.run.smithi059.stdout:2715 trunc from 0xd7b8a77 to 0xb994370 2024-09-12T05:21:06.122 INFO:teuthology.orchestra.run.smithi059.stdout:2716 writesame 0x4d1f68 thru 0x4d5168 data_size 0x11(0x3201 bytes) 2024-09-12T05:21:06.125 INFO:teuthology.orchestra.run.smithi059.stdout:2717 punch from 0x9922d5c to 0x9926e1c, (0x40c0 bytes) 2024-09-12T05:21:06.125 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:06.127 INFO:teuthology.orchestra.run.smithi059.stdout:2718 trunc from 0xb994370 to 0xa28e299 2024-09-12T05:21:06.135 INFO:teuthology.orchestra.run.smithi059.stdout:2721 read 0x79c9384 thru 0x79d603f (0xccbc bytes) 2024-09-12T05:21:06.136 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.136 INFO:teuthology.orchestra.run.smithi059.stdout:2726 writesame 0xa1e9e0b thru 0xa1f7302 data_size 0x14(0xd4f8 bytes) 2024-09-12T05:21:06.142 INFO:teuthology.orchestra.run.smithi059.stdout:2728 write 0x2e3369b thru 0x2e40cd1 (0xd637 bytes) 2024-09-12T05:21:06.145 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:06.145 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:06.149 INFO:teuthology.orchestra.run.smithi059.stdout:2729 punch from 0x6c39a93 to 0x6c426d2, (0x8c3f bytes) 2024-09-12T05:21:06.161 INFO:teuthology.orchestra.run.smithi059.stdout:2730 write 0xd440dfd thru 0xd443e8f (0x3093 bytes) 2024-09-12T05:21:06.164 INFO:teuthology.orchestra.run.smithi059.stdout:2733 punch from 0x22fdcf5 to 0x2301a7d, (0x3d88 bytes) 2024-09-12T05:21:06.164 INFO:teuthology.orchestra.run.smithi059.stdout:2734 read 0xac0ac34 thru 0xac10fb9 (0x6386 bytes) 2024-09-12T05:21:06.165 INFO:teuthology.orchestra.run.smithi059.stdout:2735 read 0xcc99634 thru 0xcc9e3df (0x4dac bytes) 2024-09-12T05:21:06.165 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.165 INFO:teuthology.orchestra.run.smithi059.stdout:2737 punch from 0xde7a50 to 0xde7c5d, (0x20d bytes) 2024-09-12T05:21:06.166 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:06.166 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:06.166 INFO:teuthology.orchestra.run.smithi059.stdout:2738 writesame 0x7705012 thru 0x770e1ca data_size 0x1(0x91b9 bytes) 2024-09-12T05:21:06.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:21:06.181 INFO:teuthology.orchestra.run.smithi059.stdout:2739 read 0xc46a808 thru 0xc4792f6 (0xeaef bytes) 2024-09-12T05:21:06.181 INFO:teuthology.orchestra.run.smithi059.stdout:2740 write 0xab6b54d thru 0xab70dc8 (0x587c bytes) 2024-09-12T05:21:06.183 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:06.187 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:06.188 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:06.191 INFO:teuthology.orchestra.run.smithi059.stdout:2741 write 0xdf68667 thru 0xdf73405 (0xad9f bytes) 2024-09-12T05:21:06.195 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.195 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.195 INFO:teuthology.orchestra.run.smithi059.stdout:2745 punch from 0x213c810 to 0x2148cce, (0xc4be bytes) 2024-09-12T05:21:06.195 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.195 INFO:teuthology.orchestra.run.smithi059.stdout:2747 write 0x97cefa thru 0x98c9d6 (0xfadd bytes) 2024-09-12T05:21:06.197 INFO:teuthology.orchestra.run.smithi059.stdout:2748 read 0xbe4365f thru 0xbe51d08 (0xe6aa bytes) 2024-09-12T05:21:06.198 INFO:teuthology.orchestra.run.smithi059.stdout:2749 write 0xc00e552 thru 0xc019cc3 (0xb772 bytes) 2024-09-12T05:21:06.199 INFO:teuthology.orchestra.run.smithi059.stdout:2750 writesame 0x1484a60 thru 0x148acc5 data_size 0xb(0x6266 bytes) 2024-09-12T05:21:06.202 INFO:teuthology.orchestra.run.smithi059.stdout:2751 writesame 0x555c850 thru 0x55694a2 data_size 0x1(0xcc53 bytes) 2024-09-12T05:21:06.210 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:06.208+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:06.226 INFO:teuthology.orchestra.run.smithi059.stdout:2753 read 0x776a795 thru 0x777a261 (0xfacd bytes) 2024-09-12T05:21:06.227 INFO:teuthology.orchestra.run.smithi059.stdout:2755 punch from 0x409a8f8 to 0x409ba8a, (0x1192 bytes) 2024-09-12T05:21:06.227 INFO:teuthology.orchestra.run.smithi059.stdout:2757 read 0x7f7b757 thru 0x7f85e9c (0xa746 bytes) 2024-09-12T05:21:06.227 INFO:teuthology.orchestra.run.smithi059.stdout:2758 write 0x3137c17 thru 0x3142405 (0xa7ef bytes) 2024-09-12T05:21:06.230 INFO:teuthology.orchestra.run.smithi059.stdout:2759 write 0x847372d thru 0x8476187 (0x2a5b bytes) 2024-09-12T05:21:06.232 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.235 INFO:teuthology.orchestra.run.smithi059.stdout:2762 trunc from 0xdf73406 to 0xbe32557 2024-09-12T05:21:06.240 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:06.240 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:06.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:06.272 INFO:teuthology.orchestra.run.smithi059.stdout:2763 trunc from 0xbe32557 to 0x12f40f8 2024-09-12T05:21:06.295 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.295 INFO:teuthology.orchestra.run.smithi059.stdout:2766 read 0xa5e547 thru 0xa6dac5 (0xf57f bytes) 2024-09-12T05:21:06.295 INFO:teuthology.orchestra.run.smithi059.stdout:2767 read 0x389a6e thru 0x398e98 (0xf42b bytes) 2024-09-12T05:21:06.296 INFO:teuthology.orchestra.run.smithi059.stdout:2768 read 0x669065 thru 0x677e30 (0xedcc bytes) 2024-09-12T05:21:06.296 INFO:teuthology.orchestra.run.smithi059.stdout:2770 punch from 0x121b17e to 0x122aafa, (0xf97c bytes) 2024-09-12T05:21:06.306 INFO:teuthology.orchestra.run.smithi059.stdout:2772 writesame 0x1e49a56 thru 0x1e599c5 data_size 0x86(0xff70 bytes) 2024-09-12T05:21:06.311 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:06.308+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:06.313 INFO:teuthology.orchestra.run.smithi059.stdout:2773 trunc from 0x1e599c6 to 0x4c0815f 2024-09-12T05:21:06.342 INFO:teuthology.orchestra.run.smithi059.stdout:2774 write 0xb54c795 thru 0xb55adca (0xe636 bytes) 2024-09-12T05:21:06.352 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.352 INFO:teuthology.orchestra.run.smithi059.stdout:2777 write 0x5efefaf thru 0x5f09722 (0xa774 bytes) 2024-09-12T05:21:06.362 INFO:teuthology.orchestra.run.smithi059.stdout:2778 read 0x1b22fa2 thru 0x1b2d11a (0xa179 bytes) 2024-09-12T05:21:06.363 INFO:teuthology.orchestra.run.smithi059.stdout:2780 read 0x4d21821 thru 0x4d2c9f0 (0xb1d0 bytes) 2024-09-12T05:21:06.363 INFO:teuthology.orchestra.run.smithi059.stdout:2782 write 0x36e6857 thru 0x36f18cd (0xb077 bytes) 2024-09-12T05:21:06.375 INFO:teuthology.orchestra.run.smithi059.stdout:2784 write 0x25ad84f thru 0x25bac71 (0xd423 bytes) 2024-09-12T05:21:06.381 INFO:teuthology.orchestra.run.smithi059.stdout:2785 writesame 0xb0c7ebe thru 0xb0cf64f data_size 0x5(0x7792 bytes) 2024-09-12T05:21:06.399 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:06.400 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:06.408 INFO:teuthology.orchestra.run.smithi059.stdout:2788 trunc from 0xb55adcb to 0x300b71a 2024-09-12T05:21:06.411 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:06.408+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:06.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:06.433 INFO:teuthology.orchestra.run.smithi059.stdout:2789 read 0x288baac thru 0x289649d (0xa9f2 bytes) 2024-09-12T05:21:06.435 INFO:teuthology.orchestra.run.smithi059.stdout:2790 punch from 0x2a6e8fc to 0x2a72609, (0x3d0d bytes) 2024-09-12T05:21:06.446 INFO:teuthology.orchestra.run.smithi059.stdout:2794 writesame 0x304f6df thru 0x3059e4b data_size 0x27(0xa76d bytes) 2024-09-12T05:21:06.449 INFO:teuthology.orchestra.run.smithi059.stdout:2795 writesame 0x1510e30 thru 0x1516a2b data_size 0x3a(0x5bfc bytes) 2024-09-12T05:21:06.452 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.452 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.455 INFO:teuthology.orchestra.run.smithi059.stdout:2798 trunc from 0x3059e4c to 0xf358fd 2024-09-12T05:21:06.490 INFO:teuthology.orchestra.run.smithi059.stdout:2800 writesame 0x4cea552 thru 0x4cf5ef6 data_size 0x5(0xb9a5 bytes) 2024-09-12T05:21:06.490 INFO:teuthology.orchestra.run.smithi059.stdout:2801 trunc from 0x4cf5ef7 to 0x4e385f1 2024-09-12T05:21:06.499 INFO:teuthology.orchestra.run.smithi059.stdout:2802 read 0x1904792 thru 0x19094d9 (0x4d48 bytes) 2024-09-12T05:21:06.512 INFO:teuthology.orchestra.run.smithi059.stdout:2803 write 0x5c5fd1c thru 0x5c6706e (0x7353 bytes) 2024-09-12T05:21:06.512 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:06.512+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:06.535 INFO:teuthology.orchestra.run.smithi059.stdout:2805 trunc from 0x5c6706f to 0xd12883a 2024-09-12T05:21:06.543 INFO:teuthology.orchestra.run.smithi059.stdout:2806 write 0xc30b3c1 thru 0xc311459 (0x6099 bytes) 2024-09-12T05:21:06.547 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.548 INFO:teuthology.orchestra.run.smithi059.stdout:2808 write 0x7e47271 thru 0x7e4c187 (0x4f17 bytes) 2024-09-12T05:21:06.551 INFO:teuthology.orchestra.run.smithi059.stdout:2809 write 0x90f5753 thru 0x9104163 (0xea11 bytes) 2024-09-12T05:21:06.564 INFO:teuthology.orchestra.run.smithi059.stdout:2810 write 0xdff9445 thru 0xdff9478 (0x34 bytes) 2024-09-12T05:21:06.566 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:06.566 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:06.570 INFO:teuthology.orchestra.run.smithi059.stdout:2813 read 0x916481 thru 0x91e1e8 (0x7d68 bytes) 2024-09-12T05:21:06.571 INFO:teuthology.orchestra.run.smithi059.stdout:2814 trunc from 0xdff9479 to 0xe723150 2024-09-12T05:21:06.580 INFO:teuthology.orchestra.run.smithi059.stdout:2815 read 0x9519577 thru 0x95204c7 (0x6f51 bytes) 2024-09-12T05:21:06.581 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.581 INFO:teuthology.orchestra.run.smithi059.stdout:2818 read 0xe295343 thru 0xe29b9ed (0x66ab bytes) 2024-09-12T05:21:06.583 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:06.602 INFO:teuthology.orchestra.run.smithi059.stdout:2819 trunc from 0xe723150 to 0x2c13227 2024-09-12T05:21:06.613 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:06.612+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:06.627 INFO:teuthology.orchestra.run.smithi059.stdout:2820 write 0x1546ff7 thru 0x1552384 (0xb38e bytes) 2024-09-12T05:21:06.630 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.630 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.636 INFO:teuthology.orchestra.run.smithi059.stdout:2825 trunc from 0x2c13227 to 0x64ce434 2024-09-12T05:21:06.648 INFO:teuthology.orchestra.run.smithi059.stdout:2827 read 0x15ad291 thru 0x15b27e7 (0x5557 bytes) 2024-09-12T05:21:06.666 INFO:teuthology.orchestra.run.smithi059.stdout:2828 writesame 0x85588cf thru 0x855d455 data_size 0x5(0x4b87 bytes) 2024-09-12T05:21:06.666 INFO:teuthology.orchestra.run.smithi059.stdout:2829 read 0x2e6a66 thru 0x2f19d7 (0xaf72 bytes) 2024-09-12T05:21:06.667 INFO:teuthology.orchestra.run.smithi059.stdout:2830 read 0x122d51c thru 0x123d3e3 (0xfec8 bytes) 2024-09-12T05:21:06.668 INFO:teuthology.orchestra.run.smithi059.stdout:2832 write 0x5436cf0 thru 0x5442a80 (0xbd91 bytes) 2024-09-12T05:21:06.677 INFO:teuthology.orchestra.run.smithi059.stdout:2833 read 0x1c4658 thru 0x1d4654 (0xfffd bytes) 2024-09-12T05:21:06.695 INFO:teuthology.orchestra.run.smithi059.stdout:2836 trunc from 0x855d456 to 0xdb0395 2024-09-12T05:21:06.714 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:06.712+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:06.729 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.735 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:06.735 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:06.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:06.771 INFO:teuthology.orchestra.run.smithi059.stdout:2839 write 0xe00465f thru 0xe005af2 (0x1494 bytes) 2024-09-12T05:21:06.780 INFO:teuthology.orchestra.run.smithi059.stdout:2844 write 0x7f8a518 thru 0x7f92863 (0x834c bytes) 2024-09-12T05:21:06.789 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.790 INFO:teuthology.orchestra.run.smithi059.stdout:2847 write 0xb1e0e0 thru 0xb27fce (0x9eef bytes) 2024-09-12T05:21:06.793 INFO:teuthology.orchestra.run.smithi059.stdout:2848 read 0xd7dba6b thru 0xd7e83ff (0xc995 bytes) 2024-09-12T05:21:06.811 INFO:teuthology.orchestra.run.smithi059.stdout:2849 trunc from 0xe005af3 to 0x5e95143 2024-09-12T05:21:06.815 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:06.812+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:06.833 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.833 INFO:teuthology.orchestra.run.smithi059.stdout:2852 read 0x56b0b00 thru 0x56b605e (0x555f bytes) 2024-09-12T05:21:06.833 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.833 INFO:teuthology.orchestra.run.smithi059.stdout:2854 read 0xa13c09 thru 0xa1ab9a (0x6f92 bytes) 2024-09-12T05:21:06.834 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.834 INFO:teuthology.orchestra.run.smithi059.stdout:2857 read 0x17799cb thru 0x1785904 (0xbf3a bytes) 2024-09-12T05:21:06.835 INFO:teuthology.orchestra.run.smithi059.stdout:2860 read 0xa1d03d thru 0xa28a09 (0xb9cd bytes) 2024-09-12T05:21:06.835 INFO:teuthology.orchestra.run.smithi059.stdout:2861 write 0x43d068c thru 0x43d92be (0x8c33 bytes) 2024-09-12T05:21:06.840 INFO:teuthology.orchestra.run.smithi059.stdout:2862 punch from 0x325b8fc to 0x326ab0b, (0xf20f bytes) 2024-09-12T05:21:06.853 INFO:teuthology.orchestra.run.smithi059.stdout:2863 trunc from 0x5e95143 to 0xb9cab44 2024-09-12T05:21:06.863 INFO:teuthology.orchestra.run.smithi059.stdout:2865 read 0xac1524e thru 0xac1d4df (0x8292 bytes) 2024-09-12T05:21:06.878 INFO:teuthology.orchestra.run.smithi059.stdout:2866 writesame 0xcc7e37a thru 0xcc8529d data_size 0x6(0x6f24 bytes) 2024-09-12T05:21:06.878 INFO:teuthology.orchestra.run.smithi059.stdout:2867 punch from 0xaad3dbc to 0xaadd191, (0x93d5 bytes) 2024-09-12T05:21:06.878 INFO:teuthology.orchestra.run.smithi059.stdout:2868 read 0x454f360 thru 0x4552579 (0x321a bytes) 2024-09-12T05:21:06.878 INFO:teuthology.orchestra.run.smithi059.stdout:2869 writesame 0xb5f743d thru 0xb5f93d2 data_size 0xd(0x1f96 bytes) 2024-09-12T05:21:06.898 INFO:teuthology.orchestra.run.smithi059.stdout:2871 writesame 0xd5820dc thru 0xd58e750 data_size 0xf(0xc675 bytes) 2024-09-12T05:21:06.898 INFO:teuthology.orchestra.run.smithi059.stdout:2872 write 0x5773db7 thru 0x577737b (0x35c5 bytes) 2024-09-12T05:21:06.901 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:06.901 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:06.902 INFO:teuthology.orchestra.run.smithi059.stdout:2873 write 0xd24079c thru 0xd24c6a1 (0xbf06 bytes) 2024-09-12T05:21:06.907 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:06.907 INFO:teuthology.orchestra.run.smithi059.stdout:2875 punch from 0xde1df0 to 0xde4285, (0x2495 bytes) 2024-09-12T05:21:06.907 INFO:teuthology.orchestra.run.smithi059.stdout:2876 writesame 0xcf0e6d8 thru 0xcf0f945 data_size 0x7(0x126e bytes) 2024-09-12T05:21:06.909 INFO:teuthology.orchestra.run.smithi059.stdout:2877 read 0x6150bf thru 0x61e0a2 (0x8fe4 bytes) 2024-09-12T05:21:06.910 INFO:teuthology.orchestra.run.smithi059.stdout:2881 clone 20 order 19 su 8192 sc 9 2024-09-12T05:21:06.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:06.916 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:06.912+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:07.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:07.012+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:07.082 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:07.083 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:07.097 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:07.141 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:07.140+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:07.169 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:21:07.218 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:07.216+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:07.225 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:07.225 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:07.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:07.291 INFO:teuthology.orchestra.run.smithi059.stdout:leaving image image_client.0-clone19 intact 2024-09-12T05:21:07.329 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:07.328+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:07.409 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:07.409 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:07.420 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:07.416+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:07.423 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:07.521 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:07.520+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:07.541 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-12T05:21:07.591 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:07.591 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:07.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:07.649 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:07.648+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:07.696 INFO:teuthology.orchestra.run.smithi194.stdout:get_pg_num_history pg_num_history pg_num_history(e58 pg_nums {1={16=1},2={19=8},3={23=32}} deleted_pools ) 2024-09-12T05:21:07.696 INFO:teuthology.orchestra.run.smithi194.stdout:Importing pgid 3.e 2024-09-12T05:21:07.696 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:701f6bf6:::rbd_data.11187bfcbd74.000000000000001e:head# 2024-09-12T05:21:07.696 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 0=[]:{} 2024-09-12T05:21:07.699 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:70335606:::rbd_data.11187bfcbd74.000000000000017a:head# 2024-09-12T05:21:07.699 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.702 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7065ac44:::rbd_data.1118e5842253.000000000000003e:head# 2024-09-12T05:21:07.702 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 7=[]:{} 2024-09-12T05:21:07.704 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:709e6f38:::rbd_data.11187bfcbd74.0000000000000176:head# 2024-09-12T05:21:07.705 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.707 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:712770eb:::rbd_data.11187bfcbd74.0000000000000023:head# 2024-09-12T05:21:07.707 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 0=[]:{} 2024-09-12T05:21:07.710 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7129332a:::rbd_data.11187bfcbd74.0000000000000021:head# 2024-09-12T05:21:07.710 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 0=[]:{} 2024-09-12T05:21:07.713 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:713f9620:::rbd_data.1118e5842253.0000000000000019:head# 2024-09-12T05:21:07.713 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 7=[]:{} 2024-09-12T05:21:07.713 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:71a492df:::rbd_object_map.1118bda01480:head# 2024-09-12T05:21:07.713 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 0=[]:{} 2024-09-12T05:21:07.716 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:71d65270:::rbd_data.11187bfcbd74.00000000000002ae:head# 2024-09-12T05:21:07.716 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.718 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:71f2ce27:::rbd_data.111887da7c95.0000000000000009:head# 2024-09-12T05:21:07.719 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 0=[]:{} 2024-09-12T05:21:07.719 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:725d86d7:::rbd_data.1118bd2b1382.0000000000000093:4# 2024-09-12T05:21:07.722 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:725d86d7:::rbd_data.1118bd2b1382.0000000000000093:head# 2024-09-12T05:21:07.722 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 4=[]:{4=[4]} 2024-09-12T05:21:07.722 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:07.720+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:07.724 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:728bb404:::rbd_data.11187bfcbd74.00000000000001aa:head# 2024-09-12T05:21:07.725 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.727 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:73ef2315:::rbd_data.11182c6d9c71.0000000000000021:head# 2024-09-12T05:21:07.727 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 0=[]:{} 2024-09-12T05:21:07.728 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:74327403:::rbd_data.11187bfcbd74.00000000000002ea:head# 2024-09-12T05:21:07.728 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.729 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:744d36fe:::rbd_data.1118a362a851.000000000000000b:6# 2024-09-12T05:21:07.734 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:744d36fe:::rbd_data.1118a362a851.000000000000000b:head# 2024-09-12T05:21:07.734 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 6=[]:{6=[6]} 2024-09-12T05:21:07.734 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7453e475:::rbd_data.1118e5842253.0000000000000001:7# 2024-09-12T05:21:07.737 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7453e475:::rbd_data.1118e5842253.0000000000000001:head# 2024-09-12T05:21:07.737 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 7=[]:{7=[7]} 2024-09-12T05:21:07.738 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:746ecde1:::rbd_data.11187bfcbd74.00000000000002ff:head# 2024-09-12T05:21:07.738 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.740 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:74817d98:::rbd_data.11187bfcbd74.0000000000000104:head# 2024-09-12T05:21:07.740 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.740 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:74a62455:::rbd_data.11187bfcbd74.0000000000000226:head# 2024-09-12T05:21:07.740 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.743 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:74bcc65a:::rbd_data.11187bfcbd74.0000000000000311:head# 2024-09-12T05:21:07.743 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.743 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:74f2f263:::rbd_data.1118e5842253.0000000000000058:head# 2024-09-12T05:21:07.744 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 7=[]:{} 2024-09-12T05:21:07.746 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7525745f:::rbd_data.111887da7c95.000000000000008a:f# 2024-09-12T05:21:07.747 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7525745f:::rbd_data.111887da7c95.000000000000008a:head# 2024-09-12T05:21:07.747 INFO:teuthology.orchestra.run.smithi194.stdout:snapset f=[]:{f=[f]} 2024-09-12T05:21:07.749 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:75c708a7:::rbd_data.111887da7c95.0000000000000029:head# 2024-09-12T05:21:07.749 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 0=[]:{} 2024-09-12T05:21:07.750 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:76178cbe:::rbd_data.111887da7c95.0000000000000243:f# 2024-09-12T05:21:07.750 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:76178cbe:::rbd_data.111887da7c95.0000000000000243:head# 2024-09-12T05:21:07.751 INFO:teuthology.orchestra.run.smithi194.stdout:snapset f=[]:{f=[f]} 2024-09-12T05:21:07.751 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:761f4963:::rbd_data.11187bfcbd74.00000000000002a3:head# 2024-09-12T05:21:07.751 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.751 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:762aec90:::rbd_data.1118feb697f7.000000000000000b:head# 2024-09-12T05:21:07.752 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 0=[]:{} 2024-09-12T05:21:07.755 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7631854f:::rbd_data.111887da7c95.0000000000000378:f# 2024-09-12T05:21:07.757 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7631854f:::rbd_data.111887da7c95.0000000000000378:head# 2024-09-12T05:21:07.757 INFO:teuthology.orchestra.run.smithi194.stdout:snapset f=[]:{f=[f]} 2024-09-12T05:21:07.759 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7688fbfd:::rbd_data.1118e5842253.0000000000000009:7# 2024-09-12T05:21:07.761 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:7688fbfd:::rbd_data.1118e5842253.0000000000000009:head# 2024-09-12T05:21:07.761 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 7=[]:{7=[7]} 2024-09-12T05:21:07.762 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:76e905ee:::rbd_data.11187bfcbd74.0000000000000293:head# 2024-09-12T05:21:07.762 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.765 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:779e1584:::rbd_data.11187bfcbd74.0000000000000322:head# 2024-09-12T05:21:07.765 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.768 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:779e9e6d:::rbd_data.111887da7c95.000000000000007d:head# 2024-09-12T05:21:07.768 INFO:teuthology.orchestra.run.smithi194.stdout:snapset f=[]:{} 2024-09-12T05:21:07.770 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:77b0b111:::rbd_data.11187bfcbd74.00000000000001d6:11# 2024-09-12T05:21:07.773 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:77b0b111:::rbd_data.11187bfcbd74.00000000000001d6:head# 2024-09-12T05:21:07.773 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{11=[11]} 2024-09-12T05:21:07.776 INFO:teuthology.orchestra.run.smithi194.stdout:Write #3:77b6cef9:::rbd_data.11187bfcbd74.000000000000029d:head# 2024-09-12T05:21:07.776 INFO:teuthology.orchestra.run.smithi194.stdout:snapset 11=[]:{} 2024-09-12T05:21:07.777 INFO:teuthology.orchestra.run.smithi194.stdout:write_pg epoch 57 info 3.e( v 57'192 (0'0,57'192] local-lis/les=23/24 n=41 ec=23/23 lis/c=23/23 les/c/f=24/24/0 sis=23) 2024-09-12T05:21:07.777 INFO:teuthology.orchestra.run.smithi059.stdout:2882 read 0xb5d32e1 thru 0xb5dc639 (0x9359 bytes) 2024-09-12T05:21:07.781 INFO:teuthology.orchestra.run.smithi059.stdout:2884 writesame 0x5e49eec thru 0x5e54bcc data_size 0x1(0xace1 bytes) 2024-09-12T05:21:07.783 INFO:teuthology.orchestra.run.smithi194.stdout:Import successful 2024-09-12T05:21:07.785 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:07.785 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:07.802 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:07.823 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:07.820+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:07.851 INFO:teuthology.orchestra.run.smithi059.stdout:2886 write 0x3f15bff thru 0x3f1db97 (0x7f99 bytes) 2024-09-12T05:21:07.888 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:07.888 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:07.903 INFO:teuthology.orchestra.run.smithi059.stdout:2890 trunc from 0xd58e751 to 0x5d28f80 2024-09-12T05:21:07.924 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:07.920+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:07.964 INFO:teuthology.orchestra.run.smithi059.stdout:2891 write 0xccbda7f thru 0xccbf54f (0x1ad1 bytes) 2024-09-12T05:21:07.971 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:07.971 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:07.971 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:07.971 INFO:teuthology.orchestra.run.smithi059.stdout:2893 read 0x36dc4d0 thru 0x36ea2ae (0xdddf bytes) 2024-09-12T05:21:07.971 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:07.972 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:07.972 INFO:teuthology.orchestra.run.smithi059.stdout:2898 clone 21 order 19 su 16384 sc 5 2024-09-12T05:21:07.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:08.025 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:08.024+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:08.109 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:08.109 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:08.123 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:08.125 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:08.124+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:08.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:08.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:08.224+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:08.244 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:08.244 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:08.259 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:08.309 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone20 from 0xccbf550 (overlap 0x5d28f80) to 0x37e5619 2024-09-12T05:21:08.327 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:08.324+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:08.352 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /var/log/ceph/exp.3.e.4 2024-09-12T05:21:08.369 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:08.370 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:08.399 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:08.399 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:08.425 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:08.426 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:08.427 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:08.424+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:08.432 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:08.432 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:08.447 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:08.449 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:08.449 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:08.449 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:08.474 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:08.475 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:08.499 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:08.530 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:08.531 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:08.535 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:08.535 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:08.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:08.540+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:08.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:08.624+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:08.630 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:08.630 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:08.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:08.630 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:08.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.750836695000004, 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.10902002500000001, 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878726+0000", 2024-09-12T05:21:08.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878741+0000", 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4696e-05 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878767+0000", 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5812999999999998e-05 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878789+0000", 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.179e-05 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878868+0000", 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9116999999999995e-05 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878878+0000", 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8549999999999997e-06 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.984853+0000", 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.105974939 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985185+0000", 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000332827 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985604+0000", 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000418477 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.986868+0000", 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001264004 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987594+0000", 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072604400000000002 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987679+0000", 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4826000000000004e-05 2024-09-12T05:21:08.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987744+0000", 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4716999999999997e-05 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4322 3.13 3:ceb672dc:::rbd_data.1118e5842253.0000000000000068:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.988166808999999, 2024-09-12T05:21:08.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056729952, 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4322 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641396+0000", 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0970000000000002e-06 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641409+0000", 2024-09-12T05:21:08.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.291e-05 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641440+0000", 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0380000000000001e-05 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641456+0000", 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5906999999999999e-05 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641572+0000", 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116452 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641803+0000", 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000230671 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.651415+0000", 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096118660000000002 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697868+0000", 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046453047999999997 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697904+0000", 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6313000000000003e-05 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697997+0000", 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3356000000000005e-05 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.698123+0000", 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125952 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22115 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1523712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166366+0000", 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.463194397999999, 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052083004000000002, 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.643 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22115 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166366+0000", 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166366+0000", 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166367+0000", 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859999999999999e-06 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166386+0000", 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9162999999999999e-05 2024-09-12T05:21:08.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166406+0000", 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9514999999999999e-05 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166420+0000", 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4583000000000001e-05 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218056+0000", 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051635161999999998 2024-09-12T05:21:08.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218259+0000", 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020350000000000001 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218449+0000", 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018969500000000001 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.647 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22116 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1753088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166442+0000", 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.463118539, 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052484348, 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22116 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166442+0000", 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166442+0000", 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166443+0000", 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2529999999999999e-06 2024-09-12T05:21:08.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166448+0000", 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3029999999999999e-06 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166466+0000", 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7612999999999999e-05 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166483+0000", 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7105999999999999e-05 2024-09-12T05:21:08.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218547+0000", 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052064423999999998 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218749+0000", 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020144999999999999 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218926+0000", 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017719900000000001 2024-09-12T05:21:08.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22118 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1982464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.463058012000001, 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052766258000000003, 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22118 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166503+0000", 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1629999999999999e-06 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166508+0000", 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166526+0000", 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7699000000000001e-05 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166540+0000", 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4286e-05 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219002+0000", 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052461397999999999 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219106+0000", 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104694 2024-09-12T05:21:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219268+0000", 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000162015 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22161 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.463000518000001, 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052998134000000002, 2024-09-12T05:21:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22161 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166561+0000", 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166566+0000", 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5860000000000004e-06 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166584+0000", 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166598+0000", 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3665999999999999e-05 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219347+0000", 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052748841999999997 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219439+0000", 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2453000000000004e-05 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219558+0000", 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011851800000000001 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22163 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462942907999999, 2024-09-12T05:21:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053262859000000003, 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22163 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166618+0000", 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1659999999999999e-06 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166624+0000", 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3299999999999998e-06 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166641+0000", 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7016000000000001e-05 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166655+0000", 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4358999999999999e-05 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219631+0000", 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052976286999999997 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219740+0000", 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108663 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219880+0000", 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014003799999999999 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22165 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 491520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462885258, 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.05349143, 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22165 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166677+0000", 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-06 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166682+0000", 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166706+0000", 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4063e-05 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166721+0000", 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4851999999999999e-05 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219948+0000", 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053227479000000001 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220029+0000", 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0564999999999999e-05 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220166+0000", 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013738499999999999 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22167 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 720896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462817848, 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053842714, 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22167 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166744+0000", 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166750+0000", 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0499999999999997e-06 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166768+0000", 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7918999999999999e-05 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166781+0000", 2024-09-12T05:21:08.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3784999999999999e-05 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220258+0000", 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053476165999999999 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220447+0000", 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018942699999999999 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220585+0000", 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013815 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22168 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 950272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462759788, 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054040510999999999, 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22168 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166802+0000", 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166807+0000", 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1460000000000004e-06 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166828+0000", 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0752999999999999e-05 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166842+0000", 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4405e-05 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220648+0000", 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053806172999999999 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220728+0000", 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0175999999999999e-05 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220841+0000", 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011250400000000001 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22170 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1048576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462698296999999, 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054240254000000002, 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22170 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:08.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166863+0000", 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166868+0000", 2024-09-12T05:21:08.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2000000000000002e-06 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166886+0000", 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7462e-05 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166899+0000", 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3059e-05 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220904+0000", 2024-09-12T05:21:08.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054004732999999999 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221006+0000", 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102895 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221102+0000", 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22172 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1277952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462642209999998, 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054417, 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22172 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166919+0000", 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.173e-06 2024-09-12T05:21:08.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166925+0000", 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166942+0000", 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7246000000000001e-05 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166957+0000", 2024-09-12T05:21:08.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4419e-05 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221168+0000", 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054211102999999997 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221251+0000", 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2956999999999999e-05 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221335+0000", 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4122000000000005e-05 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22174 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462584773, 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054612105000000001, 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22174 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166977+0000", 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.156e-06 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166982+0000", 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167000+0000", 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7336000000000001e-05 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167013+0000", 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3106e-05 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221400+0000", 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054387255000000002 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221493+0000", 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3117999999999999e-05 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221588+0000", 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4524000000000005e-05 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22176 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.690 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462526386, 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054762312, 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22176 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:08.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167035+0000", 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167064+0000", 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459e-05 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167098+0000", 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4041000000000002e-05 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167156+0000", 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7401000000000002e-05 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221640+0000", 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054484170999999998 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221714+0000", 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4345999999999996e-05 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221796+0000", 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1757999999999999e-05 2024-09-12T05:21:08.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22178 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.462379736999999, 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054845368999999998, 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22178 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167182+0000", 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167189+0000", 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.81e-06 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167221+0000", 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2400999999999997e-05 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167237+0000", 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5693e-05 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221845+0000", 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054608139 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221934+0000", 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9586000000000006e-05 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.222026+0000", 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1466999999999997e-05 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:55996 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:08.699 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.931545814, 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054112130000000001, 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 55996 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698015+0000", 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.82e-07 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698017+0000", 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1799999999999999e-06 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698024+0000", 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5830000000000003e-06 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698028+0000", 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7299999999999996e-06 2024-09-12T05:21:08.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748691+0000", 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050662709 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748758+0000", 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6920000000000003e-05 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752127+0000", 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033684259999999999 2024-09-12T05:21:08.703 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56145 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.926011275, 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053461886, 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.704 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56145 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703552+0000", 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3879999999999998e-06 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703559+0000", 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5059999999999998e-06 2024-09-12T05:21:08.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703565+0000", 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.964e-06 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752009+0000", 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.048444050000000002 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752076+0000", 2024-09-12T05:21:08.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7083999999999997e-05 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757011+0000", 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049343850000000003 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56146 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.925987133, 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053664649000000002, 2024-09-12T05:21:08.708 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56146 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703574+0000", 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5699999999999998e-07 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703581+0000", 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5560000000000002e-06 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703589+0000", 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4420000000000001e-06 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703595+0000", 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0070000000000003e-06 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757060+0000", 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053465909999999998 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757143+0000", 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2974999999999998e-05 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757238+0000", 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4302000000000006e-05 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56147 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.925957511, 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054033454000000002, 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56147 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703606+0000", 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.305e-06 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703613+0000", 2024-09-12T05:21:08.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1720000000000001e-06 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703618+0000", 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7339999999999996e-06 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757277+0000", 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053658748999999999 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757529+0000", 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025211199999999997 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757636+0000", 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010683600000000001 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56148 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:08.717 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.925934523, 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054391660000000001, 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56148 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:08.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703629+0000", 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4339999999999999e-06 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703636+0000", 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1999999999999997e-06 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703642+0000", 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1829999999999999e-06 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757667+0000", 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054025148000000002 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757737+0000", 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9640000000000004e-05 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.758017+0000", 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000280594 2024-09-12T05:21:08.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.722 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.722 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.722 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:08.722 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:08.722 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:08.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:08.769 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:08.768+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:08.809 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-12T05:21:08.830 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:08.828+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:08.857 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:08.857 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:08.857 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:08.857 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:08.874 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:08.965 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:08.964+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:09.033 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:09.028+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:09.043 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:09.043 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:09.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:09.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:09.132+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:09.196 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:21:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:2900 read 0x2b3d3b8 thru 0x2b43730 (0x6379 bytes) 2024-09-12T05:21:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:2901 read 0x8bfd4da thru 0x8c02549 (0x5070 bytes) 2024-09-12T05:21:09.225 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:09.225 INFO:teuthology.orchestra.run.smithi059.stdout:2903 write 0x8877742 thru 0x887fd6b (0x862a bytes) 2024-09-12T05:21:09.227 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:09.227 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:09.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:09.227 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:13426 3.1 3:861ced81:::rbd_data.11184248d50f.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:31.803856+0000", 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.424239366999998, 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026593286000000001, 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.228 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 13426 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803856+0000", 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803856+0000", 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803858+0000", 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.086e-06 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803868+0000", 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0355e-05 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803896+0000", 2024-09-12T05:21:09.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7733e-05 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803909+0000", 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3572e-05 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.804027+0000", 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011738799999999999 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.804254+0000", 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022718 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.808390+0000", 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041364469999999997 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.830128+0000", 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021737759999999998 2024-09-12T05:21:09.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.830238+0000", 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010963600000000001 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.830331+0000", 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3311000000000002e-05 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.830449+0000", 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000117818 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:42157 3.6 3:673f2d0c:::rbd_data.11182d2a28db.0000000000000205:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:50.306121+0000", 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.921974037999998, 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032117895, 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.234 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 42157 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306121+0000", 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306121+0000", 2024-09-12T05:21:09.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306122+0000", 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4559999999999999e-06 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306129+0000", 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306148+0000", 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8850000000000001e-05 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306159+0000", 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0179e-05 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306242+0000", 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3552000000000002e-05 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306437+0000", 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019511499999999999 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.312096+0000", 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056583670000000001 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.338033+0000", 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025937469000000001 2024-09-12T05:21:09.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.338103+0000", 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0166000000000005e-05 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.338176+0000", 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3029999999999997e-05 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.338239+0000", 2024-09-12T05:21:09.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2569000000000004e-05 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:51291 3.1f 3:ff230e3c:::rbd_data.11182d2a28db.0000000000000036:10 [read 115712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.228357+0000", 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.999738045000001, 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018412527000000001, 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 51291 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228357+0000", 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228357+0000", 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228357+0000", 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3300000000000003e-07 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228360+0000", 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4940000000000002e-06 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228368+0000", 2024-09-12T05:21:09.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2810000000000008e-06 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228374+0000", 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1500000000000004e-06 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.246529+0000", 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018154547 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.246634+0000", 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010536500000000001 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.246769+0000", 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013525700000000001 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:51292 3.1f 3:ff230e3c:::rbd_data.11182d2a28db.0000000000000036:10 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:09.244 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.228384+0000", 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.999710468, 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018629696000000001, 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 51292 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228384+0000", 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228384+0000", 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228385+0000", 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5300000000000004e-07 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228388+0000", 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5330000000000001e-06 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228394+0000", 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5950000000000004e-06 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.228398+0000", 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9129999999999996e-06 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.246807+0000", 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018409412999999999 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.246898+0000", 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0667000000000005e-05 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.247014+0000", 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011602199999999999 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:52890 3.1f 3:ff230e3c:::rbd_data.11182d2a28db.0000000000000036:10 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.278364+0000", 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.949730551, 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018242092000000001, 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.249 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 52890 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278364+0000", 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278364+0000", 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278365+0000", 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278367+0000", 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.928e-06 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278373+0000", 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9830000000000001e-06 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278378+0000", 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8899999999999998e-06 2024-09-12T05:21:09.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.296436+0000", 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018058188999999999 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.296514+0000", 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8033000000000003e-05 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.296606+0000", 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2699000000000001e-05 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:52891 3.1f 3:ff230e3c:::rbd_data.11182d2a28db.0000000000000036:10 [read 48128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.278384+0000", 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.949711223, 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018438475999999999, 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.254 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 52891 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278384+0000", 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278384+0000", 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278384+0000", 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8000000000000001e-07 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278386+0000", 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9080000000000002e-06 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278396+0000", 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0068000000000001e-05 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278401+0000", 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2360000000000004e-06 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.296636+0000", 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018235175999999999 2024-09-12T05:21:09.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.296706+0000", 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9376999999999997e-05 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.296822+0000", 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011633099999999999 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:52892 3.1f 3:ff230e3c:::rbd_data.11182d2a28db.0000000000000036:10 [read 62464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.278409+0000", 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.949686331000001, 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018603366999999999, 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 52892 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278409+0000", 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278409+0000", 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278409+0000", 2024-09-12T05:21:09.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3300000000000003e-07 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278411+0000", 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9850000000000001e-06 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278420+0000", 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4429999999999992e-06 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.278426+0000", 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.13e-06 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.296852+0000", 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018426349000000002 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.296934+0000", 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2435999999999995e-05 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.297012+0000", 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7590999999999996e-05 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:52965 3.1f 3:fa43ed6a:::rbd_data.11187bfcbd74.0000000000000041:11 [read 252928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.280749+0000", 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.947345800000001, 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018289030000000001, 2024-09-12T05:21:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 52965 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.280749+0000", 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.280749+0000", 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.280750+0000", 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5700000000000002e-07 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.280753+0000", 2024-09-12T05:21:09.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1020000000000001e-06 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.280761+0000", 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5960000000000004e-06 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.280768+0000", 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1700000000000002e-06 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.298898+0000", 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018130668999999999 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.298964+0000", 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5602e-05 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.299038+0000", 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4233999999999994e-05 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.267 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:54053 3.17 3:ecc2f56c:::rbd_data.1118bf17036a.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.375055+0000", 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.853039515000001, 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018304739, 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.268 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 54053 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.375055+0000", 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.375055+0000", 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.375057+0000", 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8989999999999999e-06 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.376312+0000", 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012549309999999999 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.376338+0000", 2024-09-12T05:21:09.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5831999999999999e-05 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.376357+0000", 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8420999999999999e-05 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.376424+0000", 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7188999999999997e-05 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.376493+0000", 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9202000000000006e-05 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.376772+0000", 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027926900000000001 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.390843+0000", 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014070424999999999 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.393232+0000", 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023895930000000002 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.393304+0000", 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1948999999999998e-05 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.393360+0000", 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6029000000000002e-05 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.273 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58807 3.17 3:ecc2f56c:::rbd_data.1118bf17036a.0000000000000000:12 [sparse-read 655360~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101606+0000", 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.126489309, 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018435487, 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.274 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58807 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101606+0000", 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101606+0000", 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101607+0000", 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8700000000000004e-07 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101610+0000", 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.14e-06 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101619+0000", 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2280000000000004e-06 2024-09-12T05:21:09.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101627+0000", 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7570000000000004e-06 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.119291+0000", 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017664208000000001 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.119403+0000", 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011205900000000001 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.120041+0000", 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00063820800000000003 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58808 3.17 3:ecc2f56c:::rbd_data.1118bf17036a.0000000000000000:12 [sparse-read 1310720~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:09.278 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101637+0000", 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.126457595, 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019093657, 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58808 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101637+0000", 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101637+0000", 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101638+0000", 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3e-07 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101641+0000", 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0809999999999998e-06 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101650+0000", 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9060000000000008e-06 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101657+0000", 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4719999999999998e-06 2024-09-12T05:21:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.120097+0000", 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018439580000000001 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.120169+0000", 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1749999999999996e-05 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.120731+0000", 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00056223799999999995 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58809 3.17 3:ecc2f56c:::rbd_data.1118bf17036a.0000000000000000:12 [sparse-read 1966080~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101668+0000", 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.126427101999999, 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019806102999999999, 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58809 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101668+0000", 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101668+0000", 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101669+0000", 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.37e-07 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101672+0000", 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4869999999999998e-06 2024-09-12T05:21:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101681+0000", 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2280000000000004e-06 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101689+0000", 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.120786+0000", 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019096741 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.120850+0000", 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4321999999999998e-05 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121474+0000", 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00062402499999999995 2024-09-12T05:21:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58812 3.1f 3:fc2a3c06:::rbd_data.1118bf17036a.0000000000000002:12 [sparse-read 1966080~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101699+0000", 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.126395799000001, 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019306422, 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58812 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101699+0000", 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101699+0000", 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101700+0000", 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7999999999999995e-07 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101704+0000", 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0790000000000002e-06 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101714+0000", 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0550999999999999e-05 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101722+0000", 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8029999999999997e-06 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.120770+0000", 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019047798000000001 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.120866+0000", 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6222000000000001e-05 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121006+0000", 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013938899999999999 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58828 3.1f 3:fb671d63:::rbd_data.1118bf17036a.000000000000000a:12 [sparse-read 524288~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101732+0000", 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.126362519000001, 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020023709000000001, 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58828 2024-09-12T05:21:09.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101732+0000", 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101732+0000", 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101733+0000", 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-07 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101736+0000", 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0769999999999999e-06 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101746+0000", 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6379999999999999e-06 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101753+0000", 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2949999999999996e-06 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121036+0000", 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019282778 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121136+0000", 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100436 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121756+0000", 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00061984799999999999 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58829 3.1f 3:fb671d63:::rbd_data.1118bf17036a.000000000000000a:12 [sparse-read 1179648~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101766+0000", 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.126328911, 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023230885999999999, 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.297 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58829 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101766+0000", 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101766+0000", 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101767+0000", 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3399999999999999e-07 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101769+0000", 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.864e-06 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101780+0000", 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0730999999999999e-05 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101788+0000", 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9330000000000001e-06 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121799+0000", 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020010516999999998 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121888+0000", 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9316999999999999e-05 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.124997+0000", 2024-09-12T05:21:09.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031089899999999998 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58830 3.1f 3:fb671d63:::rbd_data.1118bf17036a.000000000000000a:12 [sparse-read 1835008~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101801+0000", 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.126293893, 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024119326, 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58830 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101801+0000", 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101801+0000", 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101802+0000", 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3900000000000004e-07 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101805+0000", 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1580000000000001e-06 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101814+0000", 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101821+0000", 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5209999999999997e-06 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.125057+0000", 2024-09-12T05:21:09.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023235354 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.125254+0000", 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019701000000000001 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.125920+0000", 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00066667400000000002 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59649 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:59.701686+0000", 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5264086720000005, 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049649879000000001, 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59649 2024-09-12T05:21:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701686+0000", 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701686+0000", 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701689+0000", 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0369999999999999e-06 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701702+0000", 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3029e-05 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701733+0000", 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1049e-05 2024-09-12T05:21:09.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701749+0000", 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5832e-05 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701875+0000", 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125735 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.702045+0000", 2024-09-12T05:21:09.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016996599999999999 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.709589+0000", 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075444819999999999 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.751028+0000", 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041438399000000001 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.751142+0000", 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114471 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.751258+0000", 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000115559 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.751336+0000", 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8319999999999996e-05 2024-09-12T05:21:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59679 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:59.853713+0000", 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3743819580000007, 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048784748000000003, 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.313 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59679 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853713+0000", 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853713+0000", 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853716+0000", 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4960000000000001e-06 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853733+0000", 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6163000000000001e-05 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853765+0000", 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1905e-05 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853780+0000", 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.562e-05 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853915+0000", 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013464400000000001 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.854062+0000", 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147534 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.861534+0000", 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074713749999999997 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.902196+0000", 2024-09-12T05:21:09.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040661804000000003 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.902319+0000", 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012298699999999999 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.902418+0000", 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9772999999999995e-05 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.902498+0000", 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9447e-05 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.1084268539999993, 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.319 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:21:09.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop_reply(client.4376.0:59762 3.1 e58/23 ondisk, result = 0)", 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.157572+0000", 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.0705224849999997, 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018431333000000001, 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.157572+0000", 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.157572+0000", 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.157575+0000", 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129999999999999e-06 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.157586+0000", 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.098e-05 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.157619+0000", 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3850999999999998e-05 2024-09-12T05:21:09.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.157639+0000", 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9126e-05 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175823+0000", 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018184084999999999 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175834+0000", 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1745e-05 2024-09-12T05:21:09.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.176004+0000", 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000169433 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.329 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:09.330 INFO:teuthology.orchestra.run.smithi059.stdout:2904 read 0xa0d2111 thru 0xa0de20d (0xc0fd bytes) 2024-09-12T05:21:09.330 INFO:teuthology.orchestra.run.smithi059.stdout:2905 writesame 0x138372d thru 0x138c75d data_size 0x1(0x9031 bytes) 2024-09-12T05:21:09.331 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:09.332 INFO:teuthology.orchestra.run.smithi059.stdout:2906 writesame 0x3f43ff thru 0x402605 data_size 0x1(0xe207 bytes) 2024-09-12T05:21:09.332 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:09.328+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:09.367 INFO:teuthology.orchestra.run.smithi059.stdout:2909 clone 22 order 24 su 524288 sc 4 2024-09-12T05:21:09.432 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:09.428+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:09.483 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:09.483 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:09.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:09.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:09.528+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:09.622 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:09.622 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:09.622 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:09.622 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:09.623 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:09.633 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:09.632+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:09.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:09.733 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:09.732+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:09.773 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:09.773 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:09.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:09.773 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:09.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.773 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:42487 3.0 3:0442e7a6:::rbd_data.11182d2a28db.00000000000000a1:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T05:21:09.773 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:50.937129+0000", 2024-09-12T05:21:09.773 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.833653905999999, 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032463853000000001, 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 42487 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.937129+0000", 2024-09-12T05:21:09.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.937129+0000", 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.937131+0000", 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.81e-06 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.937140+0000", 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2369999999999998e-06 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.937165+0000", 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5145000000000001e-05 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.937185+0000", 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9782000000000001e-05 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.937285+0000", 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010058199999999999 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.937503+0000", 2024-09-12T05:21:09.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021768100000000001 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.942513+0000", 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050097240000000001 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.969404+0000", 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026891091999999998 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.969435+0000", 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1131999999999999e-05 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.969523+0000", 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8355000000000004e-05 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.969593+0000", 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9313000000000005e-05 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.779 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59790 3.4 3:232e45a6:::rbd_data.1118c64990c9.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.224185+0000", 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5465978259999993, 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054893154, 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59790 2024-09-12T05:21:09.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.224185+0000", 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.224185+0000", 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.224187+0000", 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2199999999999999e-06 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.224198+0000", 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0976e-05 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.224228+0000", 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9739000000000001e-05 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.224242+0000", 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4113e-05 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.224322+0000", 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0462000000000003e-05 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.224411+0000", 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8521000000000002e-05 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.231571+0000", 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071599660000000002 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.278774+0000", 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047203447000000003 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.278864+0000", 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9208000000000004e-05 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.278957+0000", 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3380000000000004e-05 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.279078+0000", 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000121122 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64857 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10125312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.251883+0000", 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.518899416, 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030699174999999999, 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64857 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251883+0000", 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251883+0000", 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251884+0000", 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251886+0000", 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4140000000000001e-06 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251894+0000", 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6420000000000007e-06 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251906+0000", 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2228999999999999e-05 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.282327+0000", 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030420396999999998 2024-09-12T05:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.282453+0000", 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012613300000000001 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.282582+0000", 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012972600000000001 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64859 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10461184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.251915+0000", 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.518867356, 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031010599999999999, 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64859 2024-09-12T05:21:09.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251915+0000", 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251915+0000", 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251916+0000", 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0699999999999998e-07 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251918+0000", 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3910000000000001e-06 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251925+0000", 2024-09-12T05:21:09.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251931+0000", 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4689999999999996e-06 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.282667+0000", 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030736761000000001 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.282793+0000", 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012579799999999999 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.282926+0000", 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013288300000000001 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.795 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64861 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9797632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.251938+0000", 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51884488699999998, 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031353794999999997, 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64861 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.796 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251938+0000", 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251938+0000", 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251938+0000", 2024-09-12T05:21:09.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3300000000000003e-07 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251940+0000", 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.906e-06 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251949+0000", 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4649999999999994e-06 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251954+0000", 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9810000000000003e-06 2024-09-12T05:21:09.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283010+0000", 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031056216000000001 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283136+0000", 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000126253 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283292+0000", 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015554100000000001 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.799 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64863 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10133504~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.251999+0000", 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51878336300000005, 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031640995999999998, 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.800 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64863 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251999+0000", 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.251999+0000", 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252000+0000", 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6399999999999998e-07 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252007+0000", 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.593e-06 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252014+0000", 2024-09-12T05:21:09.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252017+0000", 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.529e-06 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283383+0000", 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031365958999999999 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283510+0000", 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127346 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283640+0000", 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012988600000000001 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.804 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64866 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252023+0000", 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51876006100000005, 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031965991999999999, 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64866 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252023+0000", 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252023+0000", 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252023+0000", 2024-09-12T05:21:09.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6899999999999999e-07 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252024+0000", 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4529999999999999e-06 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252028+0000", 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.591e-06 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252032+0000", 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1389999999999997e-06 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283725+0000", 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031693158999999999 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283853+0000", 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012798900000000001 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.283989+0000", 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013539199999999999 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.809 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64867 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9805824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252036+0000", 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51874663399999998, 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032295576999999999, 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64867 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252036+0000", 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252036+0000", 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252036+0000", 2024-09-12T05:21:09.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3999999999999998e-07 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252037+0000", 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0720000000000001e-06 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252042+0000", 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.391e-06 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252046+0000", 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3359999999999997e-06 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.284074+0000", 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032027680000000003 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.284200+0000", 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012595600000000001 2024-09-12T05:21:09.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.284332+0000", 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013190200000000001 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64870 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9478144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252053+0000", 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51872950100000004, 2024-09-12T05:21:09.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032618705999999997, 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64870 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252053+0000", 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252053+0000", 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252053+0000", 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7700000000000001e-07 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252055+0000", 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2300000000000001e-06 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252059+0000", 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8419999999999998e-06 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252063+0000", 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4179999999999999e-06 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.284414+0000", 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032350944 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.284539+0000", 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012553299999999999 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.284672+0000", 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013246199999999999 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64873 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10240000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252070+0000", 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.518713164, 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032943753999999999, 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64873 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252070+0000", 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252070+0000", 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252070+0000", 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2e-07 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252072+0000", 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0310000000000001e-06 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252078+0000", 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0419999999999999e-06 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252083+0000", 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6460000000000001e-06 2024-09-12T05:21:09.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.284756+0000", 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032673112999999997 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.284883+0000", 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012709599999999999 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285013+0000", 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013030600000000001 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64876 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10321920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252089+0000", 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51869343700000003, 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033263552000000002, 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64876 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252089+0000", 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252089+0000", 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252090+0000", 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5699999999999998e-07 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252091+0000", 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8530000000000001e-06 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252097+0000", 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8629999999999996e-06 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252102+0000", 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4279999999999998e-06 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285095+0000", 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032993247000000003 2024-09-12T05:21:09.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285220+0000", 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125129 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285353+0000", 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013267500000000001 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.828 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64878 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9912320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252109+0000", 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51867397400000004, 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033593893999999999, 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.829 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64878 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252109+0000", 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252109+0000", 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252109+0000", 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7500000000000001e-07 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252111+0000", 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0619999999999999e-06 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252117+0000", 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9580000000000004e-06 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252122+0000", 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9309999999999999e-06 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285440+0000", 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033317462999999999 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285568+0000", 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012862999999999999 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285703+0000", 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000134475 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64879 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10248192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252129+0000", 2024-09-12T05:21:09.833 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51865362699999995, 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033940918, 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64879 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252129+0000", 2024-09-12T05:21:09.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252129+0000", 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252130+0000", 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2800000000000002e-07 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252137+0000", 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.43e-06 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252144+0000", 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6800000000000004e-06 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252149+0000", 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5629999999999999e-06 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285787+0000", 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033637357 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.285935+0000", 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000148548 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.286070+0000", 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000134912 2024-09-12T05:21:09.837 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64882 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9584640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252158+0000", 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51862498700000004, 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034259206, 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.838 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64882 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252158+0000", 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252158+0000", 2024-09-12T05:21:09.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252158+0000", 2024-09-12T05:21:09.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:21:09.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252160+0000", 2024-09-12T05:21:09.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.131e-06 2024-09-12T05:21:09.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252167+0000", 2024-09-12T05:21:09.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6109999999999999e-06 2024-09-12T05:21:09.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252172+0000", 2024-09-12T05:21:09.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0499999999999999e-06 2024-09-12T05:21:09.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.286154+0000", 2024-09-12T05:21:09.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033982463999999997 2024-09-12T05:21:09.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.286283+0000", 2024-09-12T05:21:09.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012811300000000001 2024-09-12T05:21:09.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.286417+0000", 2024-09-12T05:21:09.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013443799999999999 2024-09-12T05:21:09.845 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.846 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.847 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64884 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10338304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.847 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252179+0000", 2024-09-12T05:21:09.847 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51860388300000004, 2024-09-12T05:21:09.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034611166999999998, 2024-09-12T05:21:09.847 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.847 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.848 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.848 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.848 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.848 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.848 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64884 2024-09-12T05:21:09.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.849 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252179+0000", 2024-09-12T05:21:09.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252179+0000", 2024-09-12T05:21:09.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252179+0000", 2024-09-12T05:21:09.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6899999999999998e-07 2024-09-12T05:21:09.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252181+0000", 2024-09-12T05:21:09.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7940000000000001e-06 2024-09-12T05:21:09.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252188+0000", 2024-09-12T05:21:09.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4540000000000004e-06 2024-09-12T05:21:09.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252195+0000", 2024-09-12T05:21:09.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2130000000000002e-06 2024-09-12T05:21:09.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.286519+0000", 2024-09-12T05:21:09.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034324462 2024-09-12T05:21:09.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.286659+0000", 2024-09-12T05:21:09.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000139665 2024-09-12T05:21:09.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.286790+0000", 2024-09-12T05:21:09.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013111000000000001 2024-09-12T05:21:09.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.856 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.857 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.857 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64886 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9920512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.857 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252202+0000", 2024-09-12T05:21:09.857 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51858038500000003, 2024-09-12T05:21:09.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034932733000000001, 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64886 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252202+0000", 2024-09-12T05:21:09.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252202+0000", 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252203+0000", 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8200000000000001e-07 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252205+0000", 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1229999999999998e-06 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252213+0000", 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4319999999999999e-06 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252218+0000", 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.028e-06 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.286874+0000", 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034655774 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287002+0000", 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012810600000000001 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287135+0000", 2024-09-12T05:21:09.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013288800000000001 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64887 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9592832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252225+0000", 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.518557296, 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035312875000000001, 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.862 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64887 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252225+0000", 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252225+0000", 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252226+0000", 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9099999999999999e-07 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252235+0000", 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8289999999999997e-06 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252242+0000", 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252248+0000", 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5809999999999996e-06 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287256+0000", 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035008018000000002 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287403+0000", 2024-09-12T05:21:09.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014744500000000001 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287538+0000", 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000135313 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64890 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10010624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252256+0000", 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51852626000000002, 2024-09-12T05:21:09.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035628923, 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64890 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252256+0000", 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252256+0000", 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252257+0000", 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0699999999999998e-07 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252259+0000", 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3329999999999999e-06 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252266+0000", 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252279+0000", 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.314e-05 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287624+0000", 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035344834999999998 2024-09-12T05:21:09.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287753+0000", 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000128486 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287885+0000", 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013284500000000001 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64892 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 10346496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.870 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.252289+0000", 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51849368200000001, 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035963013000000002, 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64892 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252289+0000", 2024-09-12T05:21:09.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252289+0000", 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252289+0000", 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5600000000000001e-07 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252292+0000", 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.768e-06 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252297+0000", 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9819999999999999e-06 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.252300+0000", 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2219999999999998e-06 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.287983+0000", 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035682388000000002 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.288120+0000", 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000137355 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.288252+0000", 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013184199999999999 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:64893 3.0 3:008c2a9e:::rbd_object_map.1118b49023bd:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.256538+0000", 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.51424492200000005, 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036390678000000003, 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 64893 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.256538+0000", 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.256538+0000", 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.256539+0000", 2024-09-12T05:21:09.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.347e-06 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.256545+0000", 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.229e-06 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.256560+0000", 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4397e-05 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:09.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.256569+0000", 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7560000000000005e-06 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.288345+0000", 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031776784000000002 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.288489+0000", 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000143919 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:21:09.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.289132+0000", 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00064324499999999997 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.292849+0000", 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037167400000000001 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.292866+0000", 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7237000000000001e-05 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:09.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.292900+0000", 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3732999999999997e-05 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.292928+0000", 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8291000000000001e-05 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:09.880 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:09.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:09.882 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:09.880+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:09.983 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:09.984+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:10.057 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:10.057 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:10.057 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:10.057 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:10.071 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:10.117 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:10.116+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:10.185 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:21:10.186 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:10.184+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:10.204 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:10.205 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:10.205 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:10.205 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:10.205 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:10.220 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:10.286 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:10.284+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:10.339 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone21 from 0xccbf550 (overlap 0xccbf550) to 0x665faa8 2024-09-12T05:21:10.387 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:10.384+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:10.414 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:10.414 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:10.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.435548351000001, 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.415 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:21:10.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:21:10.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.523916034000003, 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.420 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:21:10.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.141215549999998, 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10139 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'147, mlcod=37'142)", 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.973107644000002, 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051775290000000002, 2024-09-12T05:21:10.429 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441702+0000", 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441706+0000", 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.985e-06 2024-09-12T05:21:10.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441716+0000", 2024-09-12T05:21:10.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3810000000000005e-06 2024-09-12T05:21:10.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441722+0000", 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441772+0000", 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9465999999999997e-05 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.441792+0000", 2024-09-12T05:21:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0560999999999998e-05 2024-09-12T05:21:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446825+0000", 2024-09-12T05:21:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050325259999999998 2024-09-12T05:21:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.446879+0000", 2024-09-12T05:21:10.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999999e-05 2024-09-12T05:21:10.435 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.435 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.435 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.436 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:21:10.436 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:10.436 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.907171902999998, 2024-09-12T05:21:10.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:21:10.436 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.436 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.436 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.437 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:10.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:21:10.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:21:10.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:21:10.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:21:10.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:21:10.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:21:10.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:21:10.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:21:10.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:21:10.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.877047572000002, 2024-09-12T05:21:10.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:21:10.444 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.444 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.444 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.444 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:10.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:21:10.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.314959791, 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.449 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:21:10.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:21:10.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.313005572999998, 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:10.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:21:10.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:10.458 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.371696839000002, 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:21:10.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.355100245999999, 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:10.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.184760806, 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.467 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:21:10.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:21:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:21:10.471 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.306306553999999, 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:21:10.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:21:10.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:21:10.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:21:10.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:21:10.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:10.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:21:10.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:21:10.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.478 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:21:10.478 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:10.478 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.306261460000002, 2024-09-12T05:21:10.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:21:10.478 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:10.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:10.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:10.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:21:10.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:21:10.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:21:10.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:21:10.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:21:10.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:21:10.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:21:10.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:21:10.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:21:10.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:21:10.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.485 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.485 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:21:10.485 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:10.485 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.297699899000001, 2024-09-12T05:21:10.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:21:10.486 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.486 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.486 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.486 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:10.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:10.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:21:10.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.495661739999999, 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:21:10.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:21:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.495 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:42174 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'386, mlcod=51'383)", 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.047167742999999, 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052593079999999999, 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367642+0000", 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367649+0000", 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2400000000000001e-06 2024-09-12T05:21:10.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367663+0000", 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3728e-05 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367672+0000", 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7919999999999998e-06 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367768+0000", 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5934999999999995e-05 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367792+0000", 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3581999999999999e-05 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.372851+0000", 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050593410000000002 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.372901+0000", 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9919000000000001e-05 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.981538302000001, 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:10.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:21:10.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:21:10.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:21:10.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.97345221, 2024-09-12T05:21:10.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:21:10.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:21:10.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0712659630000001, 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:21:10.509 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:10.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:21:10.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:21:10.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:21:10.514 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65367 3.9 3:9649deb5:::rbd_data.1118b49023bd.000000000000010b:head [stat,delete] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:10.402900+0000", 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.011908916, 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051971860000000003, 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:10.515 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65367 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.402900+0000", 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.402900+0000", 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.402902+0000", 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.221e-06 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:10.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.402906+0000", 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0709999999999996e-06 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.402924+0000", 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8235000000000001e-05 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.402930+0000", 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6629999999999998e-06 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.402972+0000", 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2386999999999999e-05 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.403061+0000", 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9061999999999995e-05 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:10.408097+0000", 2024-09-12T05:21:10.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050365469999999997 2024-09-12T05:21:10.520 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.520 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.520 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.520 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:10.520 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:10.520 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:10.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:10.522 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:10.519+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:10.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:10.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:10.620+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:10.693 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:10.693 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:10.693 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:10.693 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:10.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:10.715 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:10.715 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:10.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:10.720+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:10.724 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-12T05:21:10.734 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:10.734 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:10.754 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:10.754 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:10.789 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:10.820 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:10.820 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:10.823 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:10.820+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:10.857 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:10.881 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:10.881 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:10.891 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:10.892 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:10.896 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:10.896 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:10.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:10.949 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:10.947+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:11.025 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:11.024+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:11.110 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:11.111 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:11.125 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:11.127 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:11.123+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:11.194 INFO:teuthology.orchestra.run.smithi059.stdout:2911 read 0xa6c912e thru 0xa6cb4dd (0x23b0 bytes) 2024-09-12T05:21:11.195 INFO:teuthology.orchestra.run.smithi059.stdout:2912 read 0xb64dd37 thru 0xb65181e (0x3ae8 bytes) 2024-09-12T05:21:11.195 INFO:teuthology.orchestra.run.smithi059.stdout:2913 write 0xcc88776 thru 0xcc93237 (0xaac2 bytes) 2024-09-12T05:21:11.217 INFO:teuthology.orchestra.run.smithi059.stdout:2914 writesame 0xe2645f7 thru 0xe273ab6 data_size 0xb0(0xf4c0 bytes) 2024-09-12T05:21:11.226 INFO:teuthology.orchestra.run.smithi059.stdout:2915 read 0x68606fa thru 0x6863641 (0x2f48 bytes) 2024-09-12T05:21:11.226 INFO:teuthology.orchestra.run.smithi059.stdout:2917 read 0x56c9d3f thru 0x56cd754 (0x3a16 bytes) 2024-09-12T05:21:11.226 INFO:teuthology.orchestra.run.smithi059.stdout:2918 punch from 0xaba68b9 to 0xabac6d0, (0x5e17 bytes) 2024-09-12T05:21:11.226 INFO:teuthology.orchestra.run.smithi059.stdout:2919 writesame 0xd27c7ff thru 0xd281305 data_size 0x1(0x4b07 bytes) 2024-09-12T05:21:11.228 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:11.224+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:11.244 INFO:teuthology.orchestra.run.smithi059.stdout:2922 punch from 0x4c97247 to 0x4c9f3d1, (0x818a bytes) 2024-09-12T05:21:11.244 INFO:teuthology.orchestra.run.smithi059.stdout:2923 write 0x747b3e0 thru 0x74834ab (0x80cc bytes) 2024-09-12T05:21:11.269 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:11.269 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:11.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:11.328 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:11.327+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:11.430 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:11.428+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:11.437 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:11.437 INFO:teuthology.orchestra.run.smithi059.stdout:2925 read 0xdbbf8b0 thru 0xdbc7ac8 (0x8219 bytes) 2024-09-12T05:21:11.437 INFO:teuthology.orchestra.run.smithi059.stdout:2926 read 0x54cf0ef thru 0x54d8f51 (0x9e63 bytes) 2024-09-12T05:21:11.438 INFO:teuthology.orchestra.run.smithi059.stdout:2929 read 0x6e6a4b4 thru 0x6e6c860 (0x23ad bytes) 2024-09-12T05:21:11.438 INFO:teuthology.orchestra.run.smithi059.stdout:2931 write 0x71da9a2 thru 0x71dd96f (0x2fce bytes) 2024-09-12T05:21:11.458 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:11.458 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:11.473 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:11.530 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:11.527+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:11.596 INFO:teuthology.orchestra.run.smithi059.stdout:2934 writesame 0x7aeea24 thru 0x7af69fa data_size 0x1(0x7fd7 bytes) 2024-09-12T05:21:11.629 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:11.629 INFO:teuthology.orchestra.run.smithi059.stdout:2937 read 0xde237b0 thru 0xde30a2a (0xd27b bytes) 2024-09-12T05:21:11.630 INFO:teuthology.orchestra.run.smithi059.stdout:2938 punch from 0x8b7f2f0 to 0x8b821cd, (0x2edd bytes) 2024-09-12T05:21:11.630 INFO:teuthology.orchestra.run.smithi059.stdout:2939 write 0x3fbf050 thru 0x3fc09b3 (0x1964 bytes) 2024-09-12T05:21:11.631 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:11.627+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:11.644 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:11.644 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:11.660 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:11.732 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:11.728+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:11.788 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:11.789 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:11.814 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:11.826 INFO:teuthology.orchestra.run.smithi059.stdout:2941 trunc from 0xe273ab7 to 0xce480d0 2024-09-12T05:21:11.855 INFO:teuthology.orchestra.run.smithi059.stdout:2942 trunc from 0xce480d0 to 0xb874ed0 2024-09-12T05:21:11.857 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:11.856+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:11.934 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:11.932+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:11.989 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:11.989 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:12.002 INFO:teuthology.orchestra.run.smithi059.stdout:2943 write 0x1c54a5a thru 0x1c5a65b (0x5c02 bytes) 2024-09-12T05:21:12.003 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:12.035 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:12.031+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:12.137 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:12.136+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:12.181 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:12.181 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:12.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:12.210 INFO:teuthology.orchestra.run.smithi059.stdout:2944 writesame 0xc11a1bd thru 0xc122d02 data_size 0x1(0x8b46 bytes) 2024-09-12T05:21:12.210 INFO:teuthology.orchestra.run.smithi059.stdout:2945 clone 23 order 25 su 4194304 sc 11 2024-09-12T05:21:12.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:21:12.257 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:12.255+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:12.339 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:12.336+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:12.371 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:12.371 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:12.386 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:12.399 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone22 from 0xc122d03 (overlap 0xb874ed0) to 0x3756471 2024-09-12T05:21:12.440 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:12.435+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:12.541 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:12.539+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:12.549 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:12.549 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:12.563 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:12.642 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:12.640+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:12.689 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:12.690 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:12.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:12.749 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:12.747+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:12.822 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:12.822 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:12.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:12.881 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:12.879+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:12.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:12.970 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:12.967+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:13.048 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:13.049 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:13.049 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:13.043+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:13.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:13.100 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:13.101 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:13.127 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:13.127 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:13.144 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:13.150 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:13.148+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:13.163 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:13.201 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:13.224 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:13.225 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:13.244 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:13.244 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:13426 3.1 3:861ced81:::rbd_data.11184248d50f.000000000000003c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:31.803856+0000", 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.440594318000002, 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026593286000000001, 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 13426 2024-09-12T05:21:13.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803856+0000", 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803856+0000", 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803858+0000", 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.086e-06 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803868+0000", 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0355e-05 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803896+0000", 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7733e-05 2024-09-12T05:21:13.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.803909+0000", 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3572e-05 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.804027+0000", 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011738799999999999 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.804254+0000", 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022718 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.808390+0000", 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041364469999999997 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.830128+0000", 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021737759999999998 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.830238+0000", 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010963600000000001 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.830331+0000", 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3311000000000002e-05 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:31.830449+0000", 2024-09-12T05:21:13.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000117818 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:42157 3.6 3:673f2d0c:::rbd_data.11182d2a28db.0000000000000205:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:50.306121+0000", 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.938328988999999, 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032117895, 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.251 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 42157 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306121+0000", 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306121+0000", 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306122+0000", 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4559999999999999e-06 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306129+0000", 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306148+0000", 2024-09-12T05:21:13.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8850000000000001e-05 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306159+0000", 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0179e-05 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306242+0000", 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3552000000000002e-05 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.306437+0000", 2024-09-12T05:21:13.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019511499999999999 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 1", 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.312096+0000", 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056583670000000001 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.338033+0000", 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025937469000000001 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:13.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.338103+0000", 2024-09-12T05:21:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0166000000000005e-05 2024-09-12T05:21:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.338176+0000", 2024-09-12T05:21:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3029999999999997e-05 2024-09-12T05:21:13.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.338239+0000", 2024-09-12T05:21:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2569000000000004e-05 2024-09-12T05:21:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58829 3.1f 3:fb671d63:::rbd_data.1118bf17036a.000000000000000a:12 [sparse-read 1179648~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101766+0000", 2024-09-12T05:21:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.142683861999998, 2024-09-12T05:21:13.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023230885999999999, 2024-09-12T05:21:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58829 2024-09-12T05:21:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101766+0000", 2024-09-12T05:21:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101766+0000", 2024-09-12T05:21:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101767+0000", 2024-09-12T05:21:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3399999999999999e-07 2024-09-12T05:21:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101769+0000", 2024-09-12T05:21:13.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.864e-06 2024-09-12T05:21:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101780+0000", 2024-09-12T05:21:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0730999999999999e-05 2024-09-12T05:21:13.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101788+0000", 2024-09-12T05:21:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9330000000000001e-06 2024-09-12T05:21:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121799+0000", 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020010516999999998 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.121888+0000", 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9316999999999999e-05 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.124997+0000", 2024-09-12T05:21:13.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031089899999999998 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:58830 3.1f 3:fb671d63:::rbd_data.1118bf17036a.000000000000000a:12 [sparse-read 1835008~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:56.101801+0000", 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.142648844, 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024119326, 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.266 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58830 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101801+0000", 2024-09-12T05:21:13.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101801+0000", 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101802+0000", 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3900000000000004e-07 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101805+0000", 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1580000000000001e-06 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101814+0000", 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.101821+0000", 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5209999999999997e-06 2024-09-12T05:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.125057+0000", 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023235354 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.125254+0000", 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019701000000000001 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:56.125920+0000", 2024-09-12T05:21:13.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00066667400000000002 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59649 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:59.701686+0000", 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.542763623000001, 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049649879000000001, 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.271 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59649 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701686+0000", 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701686+0000", 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701689+0000", 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0369999999999999e-06 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701702+0000", 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3029e-05 2024-09-12T05:21:13.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701733+0000", 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1049e-05 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701749+0000", 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5832e-05 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.701875+0000", 2024-09-12T05:21:13.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125735 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.702045+0000", 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016996599999999999 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.709589+0000", 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075444819999999999 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:13.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.751028+0000", 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041438399000000001 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.751142+0000", 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114471 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.751258+0000", 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000115559 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.751336+0000", 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8319999999999996e-05 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59679 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:59.853713+0000", 2024-09-12T05:21:13.277 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.390736908999999, 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048784748000000003, 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59679 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853713+0000", 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853713+0000", 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853716+0000", 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4960000000000001e-06 2024-09-12T05:21:13.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853733+0000", 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6163000000000001e-05 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853765+0000", 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1905e-05 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853780+0000", 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.562e-05 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.853915+0000", 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013464400000000001 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.854062+0000", 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147534 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.861534+0000", 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074713749999999997 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.902196+0000", 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040661804000000003 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.902319+0000", 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012298699999999999 2024-09-12T05:21:13.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.902418+0000", 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9772999999999995e-05 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:59.902498+0000", 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9447e-05 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.283 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.124781805, 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:21:13.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:21:13.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:21:13.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:21:13.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:21:13.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:21:13.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:21:13.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:21:13.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65099 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2072576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318138+0000", 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9263114149999998, 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022885499, 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.291 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65099 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318138+0000", 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318138+0000", 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318139+0000", 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8400000000000004e-07 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318143+0000", 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6119999999999999e-06 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318157+0000", 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3755e-05 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318170+0000", 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3040000000000001e-05 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.340794+0000", 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022624885000000001 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.340898+0000", 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103154 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341024+0000", 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012636900000000001 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.295 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65102 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 1744896~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318215+0000", 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9262352599999999, 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023042763000000001, 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65102 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318215+0000", 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318215+0000", 2024-09-12T05:21:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318216+0000", 2024-09-12T05:21:13.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.032e-06 2024-09-12T05:21:13.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318221+0000", 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0980000000000001e-06 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318235+0000", 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4337e-05 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318246+0000", 2024-09-12T05:21:13.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.092e-05 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341065+0000", 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022818847 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341166+0000", 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100985 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341257+0000", 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1544000000000003e-05 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65104 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 1409024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318262+0000", 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9261879610000001, 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023187045999999999, 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65104 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318262+0000", 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318262+0000", 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318263+0000", 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4000000000000001e-07 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318267+0000", 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.121e-06 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318280+0000", 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2886e-05 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318289+0000", 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6439999999999995e-06 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341289+0000", 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0229999 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341351+0000", 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2113000000000007e-05 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341449+0000", 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7641999999999998e-05 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.305 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65106 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 1417216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318304+0000", 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9261458510000002, 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023362883000000001, 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65106 2024-09-12T05:21:13.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318304+0000", 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318304+0000", 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318305+0000", 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4600000000000003e-07 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318309+0000", 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8999999999999999e-06 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318323+0000", 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3906999999999999e-05 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318336+0000", 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3013999999999999e-05 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341488+0000", 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023151998 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341569+0000", 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1093000000000004e-05 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341667+0000", 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8125e-05 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.310 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65108 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2179072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318349+0000", 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9261010060000001, 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023485958000000001, 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.311 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65108 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318349+0000", 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318349+0000", 2024-09-12T05:21:13.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318350+0000", 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1399999999999996e-07 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318353+0000", 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.641e-06 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318383+0000", 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9278999999999999e-05 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318395+0000", 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2252999999999999e-05 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341705+0000", 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023309759999999999 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341766+0000", 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1699000000000007e-05 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341835+0000", 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8511999999999997e-05 2024-09-12T05:21:13.315 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65111 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 1851392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318415+0000", 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9260345810000001, 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023616537999999999, 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.316 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65111 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318415+0000", 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318415+0000", 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318416+0000", 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0139999999999999e-06 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318422+0000", 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4569999999999996e-06 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318434+0000", 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2112e-05 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318442+0000", 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6569999999999997e-06 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341872+0000", 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023430858999999998 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.341935+0000", 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2403000000000005e-05 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342032+0000", 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7035999999999997e-05 2024-09-12T05:21:13.320 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65113 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2187264~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318456+0000", 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9259941710000001, 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023824761999999999, 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65113 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318456+0000", 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318456+0000", 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318456+0000", 2024-09-12T05:21:13.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2399999999999997e-07 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318471+0000", 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4148000000000001e-05 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318483+0000", 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2274e-05 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318491+0000", 2024-09-12T05:21:13.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6499999999999996e-06 2024-09-12T05:21:13.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342070+0000", 2024-09-12T05:21:13.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023579211999999999 2024-09-12T05:21:13.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342160+0000", 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9863000000000003e-05 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342280+0000", 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012089100000000001 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65114 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2613248~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318502+0000", 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9259479600000002, 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024033913, 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65114 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318502+0000", 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318502+0000", 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318503+0000", 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7299999999999995e-07 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318505+0000", 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.864e-06 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318517+0000", 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1153e-05 2024-09-12T05:21:13.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318524+0000", 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1949999999999997e-06 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342323+0000", 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023799115999999999 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342419+0000", 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5598000000000002e-05 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342536+0000", 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000117314 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.330 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65117 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2392064~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318534+0000", 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9259161040000001, 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024172017000000001, 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.331 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65117 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318534+0000", 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318534+0000", 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318534+0000", 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8699999999999995e-07 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318537+0000", 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0860000000000002e-06 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318548+0000", 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0684e-05 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318555+0000", 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1230000000000002e-06 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342574+0000", 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024019196999999999 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342636+0000", 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1465999999999997e-05 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342706+0000", 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9874000000000002e-05 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.335 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65119 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2400256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318567+0000", 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9258827849999998, 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024340407000000001, 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65119 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318567+0000", 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318567+0000", 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318568+0000", 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7299999999999996e-07 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318570+0000", 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.678e-06 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318579+0000", 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9930000000000001e-06 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318588+0000", 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0040000000000005e-06 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342750+0000", 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024161914 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342832+0000", 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1920000000000002e-05 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342908+0000", 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5325000000000001e-05 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.340 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65122 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2506752~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.340 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318600+0000", 2024-09-12T05:21:13.340 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.925850337, 2024-09-12T05:21:13.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024498725999999998, 2024-09-12T05:21:13.340 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65122 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318600+0000", 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318600+0000", 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318600+0000", 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9999999999999997e-07 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318603+0000", 2024-09-12T05:21:13.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8540000000000001e-06 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318625+0000", 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1662e-05 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318633+0000", 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9570000000000002e-06 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.342947+0000", 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024314326000000001 2024-09-12T05:21:13.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343013+0000", 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6445000000000005e-05 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343098+0000", 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4882000000000005e-05 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65124 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2514944~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318644+0000", 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.9258058560000002, 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024693716000000001, 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65124 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.345 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318644+0000", 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318644+0000", 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318645+0000", 2024-09-12T05:21:13.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8599999999999998e-07 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318648+0000", 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2569999999999999e-06 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318657+0000", 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4919999999999999e-06 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318665+0000", 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1960000000000002e-06 2024-09-12T05:21:13.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343140+0000", 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024475279999999999 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343225+0000", 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4722000000000006e-05 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343338+0000", 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000113183 2024-09-12T05:21:13.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65126 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 2605056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.318675+0000", 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.925775024, 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024827799000000001, 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65126 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318675+0000", 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318675+0000", 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318675+0000", 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4799999999999998e-07 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318678+0000", 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.762e-06 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318687+0000", 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7290000000000006e-06 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.318702+0000", 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5058000000000001e-05 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343372+0000", 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024670225 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343430+0000", 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7932e-05 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343503+0000", 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2545000000000004e-05 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.353 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:13.354 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-12T05:21:13.354 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:13.355 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:13.355 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:13.355 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:13.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:13.357 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:21:13.357 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:13.351+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:13.367 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:21:13.367 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:13.367 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T05:21:13.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:21:13.457 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:13.455+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:13.558 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:13.555+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:13.605 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:13.605 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:13.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78384 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.582062+0000", 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.011930932, 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011954598, 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78384 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582062+0000", 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582062+0000", 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582062+0000", 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5300000000000004e-07 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582065+0000", 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2910000000000002e-06 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582071+0000", 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5880000000000003e-06 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582077+0000", 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.31e-06 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78445 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583336+0000", 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010656956, 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010741527000000001, 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78445 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.610 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583336+0000", 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583336+0000", 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583336+0000", 2024-09-12T05:21:13.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8500000000000001e-07 2024-09-12T05:21:13.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583338+0000", 2024-09-12T05:21:13.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.069e-06 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583345+0000", 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9600000000000003e-06 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583352+0000", 2024-09-12T05:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3080000000000004e-06 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78513 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584458+0000", 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0095345629999999994, 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0096723880000000005, 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78513 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584458+0000", 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584458+0000", 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584459+0000", 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6400000000000002e-07 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584461+0000", 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.181e-06 2024-09-12T05:21:13.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584468+0000", 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2049999999999996e-06 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584473+0000", 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78571 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585483+0000", 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0085101080000000006, 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086984349999999992, 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78571 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.619 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585483+0000", 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585483+0000", 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585483+0000", 2024-09-12T05:21:13.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3700000000000001e-07 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585485+0000", 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.922e-06 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585491+0000", 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3269999999999997e-06 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585496+0000", 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.814e-06 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78632 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586158+0000", 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0078343400000000004, 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080726519999999996, 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.622 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78632 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586158+0000", 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586158+0000", 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586159+0000", 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586161+0000", 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3120000000000001e-06 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586168+0000", 2024-09-12T05:21:13.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.776e-06 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586173+0000", 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.31e-06 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78702 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586799+0000", 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0071940830000000004, 2024-09-12T05:21:13.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074836620000000003, 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78702 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586799+0000", 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586799+0000", 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586799+0000", 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4999999999999998e-07 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586801+0000", 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.852e-06 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586809+0000", 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9980000000000003e-06 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586813+0000", 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4399999999999998e-06 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78841 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.628 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587836+0000", 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.006156623, 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064962500000000003, 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78841 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587836+0000", 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587836+0000", 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587837+0000", 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1399999999999997e-07 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587839+0000", 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1050000000000002e-06 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587846+0000", 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0809999999999996e-06 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587851+0000", 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5500000000000002e-06 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78388 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.582087+0000", 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.011905658, 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012295554, 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78388 2024-09-12T05:21:13.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582087+0000", 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582087+0000", 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582088+0000", 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5599999999999995e-07 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582090+0000", 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7920000000000001e-06 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582099+0000", 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582105+0000", 2024-09-12T05:21:13.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8830000000000003e-06 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78448 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583372+0000", 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010620685, 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011060171000000001, 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.635 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78448 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583372+0000", 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583372+0000", 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583373+0000", 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9500000000000002e-07 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583375+0000", 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5730000000000002e-06 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583383+0000", 2024-09-12T05:21:13.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5830000000000001e-06 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583388+0000", 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.575e-06 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78515 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584493+0000", 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0094994060000000002, 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0099916150000000006, 2024-09-12T05:21:13.638 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78515 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584493+0000", 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584493+0000", 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584494+0000", 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584496+0000", 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5110000000000002e-06 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584504+0000", 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584510+0000", 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6239999999999999e-06 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.641 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78572 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585504+0000", 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0084885480000000003, 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090360509999999998, 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78572 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585504+0000", 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585504+0000", 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585505+0000", 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.08e-07 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585507+0000", 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.278e-06 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585513+0000", 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5529999999999998e-06 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585518+0000", 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7190000000000001e-06 2024-09-12T05:21:13.644 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78633 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586181+0000", 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0078118830000000004, 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084092100000000003, 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.645 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78633 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586181+0000", 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586181+0000", 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586181+0000", 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6400000000000003e-07 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586183+0000", 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0710000000000002e-06 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586192+0000", 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6049999999999998e-06 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586197+0000", 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3739999999999997e-06 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78703 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586819+0000", 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0071732489999999996, 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078200460000000006, 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78703 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586819+0000", 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586819+0000", 2024-09-12T05:21:13.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586820+0000", 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8700000000000001e-07 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586822+0000", 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9740000000000001e-06 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586827+0000", 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000004e-06 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586832+0000", 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3989999999999997e-06 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.651 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78843 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587871+0000", 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0061218840000000002, 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068181709999999996, 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78843 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587871+0000", 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587871+0000", 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587871+0000", 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5400000000000001e-07 2024-09-12T05:21:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587874+0000", 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.649e-06 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587882+0000", 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1189999999999997e-06 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587888+0000", 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1519999999999997e-06 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78389 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.582114+0000", 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.011878382999999999, 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012624299, 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.655 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78389 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582114+0000", 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582114+0000", 2024-09-12T05:21:13.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582115+0000", 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582117+0000", 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3779999999999999e-06 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582125+0000", 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4669999999999998e-06 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582132+0000", 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4399999999999999e-06 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78449 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583396+0000", 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010596625, 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011391729999999999, 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78449 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583396+0000", 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583396+0000", 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583397+0000", 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1600000000000001e-07 2024-09-12T05:21:13.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583399+0000", 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9640000000000002e-06 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583405+0000", 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3110000000000002e-06 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583410+0000", 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9760000000000003e-06 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78517 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584526+0000", 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0094666390000000007, 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010311504000000001, 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78517 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584526+0000", 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584526+0000", 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584527+0000", 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8100000000000003e-07 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584529+0000", 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0760000000000001e-06 2024-09-12T05:21:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584535+0000", 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6340000000000003e-06 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584540+0000", 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0379999999999999e-06 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78575 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585525+0000", 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0084677499999999996, 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093664799999999999, 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78575 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.666 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585525+0000", 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585525+0000", 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585525+0000", 2024-09-12T05:21:13.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7800000000000002e-07 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585527+0000", 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.159e-06 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585534+0000", 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4880000000000004e-06 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585539+0000", 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0359999999999997e-06 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78636 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586205+0000", 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0077875610000000001, 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087353959999999994, 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.669 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78636 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586205+0000", 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586205+0000", 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586206+0000", 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6899999999999998e-07 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586208+0000", 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3199999999999998e-06 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586216+0000", 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3809999999999999e-06 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586221+0000", 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8709999999999996e-06 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78704 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586837+0000", 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0071551590000000003, 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081556219999999995, 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78704 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586837+0000", 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586837+0000", 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586838+0000", 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0100000000000001e-07 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586843+0000", 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2839999999999997e-06 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586853+0000", 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5869999999999999e-06 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586857+0000", 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8169999999999998e-06 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78847 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587897+0000", 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0060959589999999998, 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071436850000000003, 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78847 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587897+0000", 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587897+0000", 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587897+0000", 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9400000000000005e-07 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587899+0000", 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.035e-06 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587906+0000", 2024-09-12T05:21:13.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9260000000000003e-06 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587912+0000", 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3079999999999998e-06 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78390 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.582141+0000", 2024-09-12T05:21:13.679 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.01185132, 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012954096, 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78390 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582141+0000", 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582141+0000", 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582142+0000", 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5300000000000004e-07 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582144+0000", 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3980000000000002e-06 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582151+0000", 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0480000000000001e-06 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582157+0000", 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3079999999999998e-06 2024-09-12T05:21:13.682 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78450 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583428+0000", 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010564595, 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011715916999999999, 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.683 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78450 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583428+0000", 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583428+0000", 2024-09-12T05:21:13.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583429+0000", 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8400000000000005e-07 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583431+0000", 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2029999999999999e-06 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583437+0000", 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583443+0000", 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3290000000000001e-06 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78518 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584561+0000", 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0094313690000000002, 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010638587999999999, 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78518 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584561+0000", 2024-09-12T05:21:13.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584561+0000", 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584562+0000", 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1200000000000003e-07 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584569+0000", 2024-09-12T05:21:13.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8040000000000004e-06 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584576+0000", 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4030000000000001e-06 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584582+0000", 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5929999999999996e-06 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78576 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585546+0000", 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0084462640000000002, 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0097038820000000005, 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78576 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585546+0000", 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585546+0000", 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585547+0000", 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585549+0000", 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585556+0000", 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9160000000000004e-06 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585561+0000", 2024-09-12T05:21:13.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1019999999999996e-06 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78637 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586229+0000", 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0077641100000000003, 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090713559999999992, 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.693 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78637 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586229+0000", 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586229+0000", 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586229+0000", 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5600000000000001e-07 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586231+0000", 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.322e-06 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586238+0000", 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586242+0000", 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8300000000000003e-06 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78709 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586865+0000", 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0071281119999999998, 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084845509999999999, 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78709 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586865+0000", 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586865+0000", 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586865+0000", 2024-09-12T05:21:13.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0200000000000003e-07 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586867+0000", 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.176e-06 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586873+0000", 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.925e-06 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586878+0000", 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5539999999999999e-06 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78848 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587929+0000", 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0060633919999999999, 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074472239999999997, 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.700 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78848 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587929+0000", 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587929+0000", 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587930+0000", 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5599999999999995e-07 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587932+0000", 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3700000000000002e-06 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587939+0000", 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2420000000000003e-06 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587945+0000", 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.703 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78393 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 8478720~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.582180+0000", 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.011812947000000001, 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01323067, 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78393 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.704 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582180+0000", 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582180+0000", 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582180+0000", 2024-09-12T05:21:13.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2900000000000003e-07 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582183+0000", 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8339999999999999e-06 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582190+0000", 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1160000000000001e-06 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582195+0000", 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8409999999999999e-06 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595375+0000", 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013179422 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78453 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.707 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583462+0000", 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010530681, 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011979406999999999, 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78453 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583462+0000", 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583462+0000", 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583463+0000", 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:21:13.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583465+0000", 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583473+0000", 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4989999999999997e-06 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583478+0000", 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2024-09-12T05:21:13.710 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78519 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584590+0000", 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0094022470000000007, 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010875950000000001, 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.711 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78519 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584590+0000", 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584590+0000", 2024-09-12T05:21:13.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584591+0000", 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1399999999999997e-07 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584593+0000", 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1959999999999998e-06 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584599+0000", 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584604+0000", 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0390000000000004e-06 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78577 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585568+0000", 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0084242499999999994, 2024-09-12T05:21:13.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0099215180000000007, 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78577 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585568+0000", 2024-09-12T05:21:13.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585568+0000", 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585569+0000", 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585571+0000", 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585577+0000", 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9889999999999997e-06 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585582+0000", 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0300000000000001e-06 2024-09-12T05:21:13.717 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78640 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586250+0000", 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0077424, 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0092634180000000007, 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.718 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78640 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586250+0000", 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586250+0000", 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586251+0000", 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7399999999999998e-07 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586253+0000", 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2709999999999999e-06 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586262+0000", 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5830000000000007e-06 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586267+0000", 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3149999999999999e-06 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78710 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.721 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586904+0000", 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0070888189999999997, 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086462069999999995, 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78710 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586904+0000", 2024-09-12T05:21:13.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586904+0000", 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586904+0000", 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4499999999999997e-07 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586907+0000", 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3599999999999999e-06 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586914+0000", 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0180000000000004e-06 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586919+0000", 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0629999999999996e-06 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.724 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78852 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587953+0000", 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0060399099999999999, 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076578920000000003, 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.725 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78852 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587953+0000", 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587953+0000", 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587953+0000", 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6400000000000003e-07 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587955+0000", 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2409999999999998e-06 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587962+0000", 2024-09-12T05:21:13.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2090000000000002e-06 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587967+0000", 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0490000000000003e-06 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.728 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78394 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 14057472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.582203+0000", 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.011789582, 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013466387999999999, 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78394 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582203+0000", 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582203+0000", 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582203+0000", 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1899999999999998e-07 2024-09-12T05:21:13.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582205+0000", 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9649999999999998e-06 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582211+0000", 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9970000000000004e-06 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582216+0000", 2024-09-12T05:21:13.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5249999999999999e-06 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595552+0000", 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013336089000000001 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595624+0000", 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1501000000000005e-05 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78454 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583493+0000", 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010499491999999999, 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012224619000000001, 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78454 2024-09-12T05:21:13.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583493+0000", 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583493+0000", 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583494+0000", 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.58e-07 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583496+0000", 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0940000000000002e-06 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583503+0000", 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4680000000000003e-06 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583508+0000", 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0119999999999996e-06 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78521 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584633+0000", 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0093596240000000004, 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011131879000000001, 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.736 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78521 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584633+0000", 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584633+0000", 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584634+0000", 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1399999999999997e-07 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584636+0000", 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6189999999999998e-06 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584644+0000", 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0709999999999995e-06 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584650+0000", 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8100000000000003e-06 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78582 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585589+0000", 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.008403743, 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010207012999999999, 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78582 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585589+0000", 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585589+0000", 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585589+0000", 2024-09-12T05:21:13.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585591+0000", 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0899999999999999e-06 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585598+0000", 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9399999999999996e-06 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585603+0000", 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1080000000000001e-06 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78641 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586274+0000", 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0077185750000000001, 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095457670000000001, 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.743 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78641 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586274+0000", 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586274+0000", 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586275+0000", 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4099999999999999e-07 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586277+0000", 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2199999999999999e-06 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586285+0000", 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2700000000000004e-06 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586290+0000", 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2619999999999998e-06 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.746 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78713 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586941+0000", 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0070519229999999999, 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089036919999999995, 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78713 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586941+0000", 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586941+0000", 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586941+0000", 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5899999999999996e-07 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586944+0000", 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2790000000000001e-06 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586951+0000", 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2089999999999999e-06 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586956+0000", 2024-09-12T05:21:13.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78854 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587974+0000", 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0060188180000000004, 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078944600000000007, 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78854 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587974+0000", 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587974+0000", 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587974+0000", 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5999999999999999e-07 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587977+0000", 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2139999999999999e-06 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587983+0000", 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7460000000000003e-06 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587988+0000", 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0220000000000004e-06 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78397 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 8896512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.753 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.582224+0000", 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.011768201000000001, 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013678132000000001, 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78397 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582224+0000", 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582224+0000", 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582225+0000", 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3600000000000003e-07 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582227+0000", 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582234+0000", 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4710000000000004e-06 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.582239+0000", 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9699999999999998e-06 2024-09-12T05:21:13.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595759+0000", 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013520508000000001 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595840+0000", 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0891999999999997e-05 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78455 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583528+0000", 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010464461, 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012439326000000001, 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78455 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583528+0000", 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583528+0000", 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583529+0000", 2024-09-12T05:21:13.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5000000000000003e-07 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583531+0000", 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4119999999999999e-06 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583538+0000", 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.233e-06 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583544+0000", 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4709999999999998e-06 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78524 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584669+0000", 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0093234909999999997, 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011349908000000001, 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.761 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78524 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584669+0000", 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584669+0000", 2024-09-12T05:21:13.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584670+0000", 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4700000000000001e-07 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584672+0000", 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5689999999999999e-06 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584687+0000", 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5091e-05 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584693+0000", 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4999999999999999e-06 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78583 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585610+0000", 2024-09-12T05:21:13.764 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0083822270000000008, 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010458729999999999, 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78583 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585610+0000", 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585610+0000", 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585611+0000", 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9099999999999999e-07 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585617+0000", 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7629999999999997e-06 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585623+0000", 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7769999999999997e-06 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585629+0000", 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3920000000000002e-06 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78644 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586300+0000", 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0076926130000000001, 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0098178080000000008, 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.768 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78644 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586300+0000", 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586300+0000", 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586300+0000", 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3700000000000001e-07 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586303+0000", 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2019999999999998e-06 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586314+0000", 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0886999999999999e-05 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586319+0000", 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3340000000000001e-06 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78714 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586975+0000", 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0070178150000000002, 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0091924580000000006, 2024-09-12T05:21:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78714 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586975+0000", 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586975+0000", 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586976+0000", 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586978+0000", 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.368e-06 2024-09-12T05:21:13.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586985+0000", 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.503e-06 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586990+0000", 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.006e-06 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78857 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587995+0000", 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0059972920000000004, 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082213519999999995, 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78857 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587995+0000", 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587995+0000", 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587996+0000", 2024-09-12T05:21:13.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5400000000000002e-07 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588001+0000", 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7250000000000002e-06 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588008+0000", 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2389999999999999e-06 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588012+0000", 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.792e-06 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78458 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583575+0000", 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010417167, 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012696377999999999, 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.778 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78458 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583575+0000", 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583575+0000", 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583576+0000", 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583578+0000", 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0980000000000001e-06 2024-09-12T05:21:13.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583586+0000", 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5870000000000004e-06 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583591+0000", 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7139999999999998e-06 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78525 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584713+0000", 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0092798540000000006, 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01160914, 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78525 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584713+0000", 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584713+0000", 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584713+0000", 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999995e-07 2024-09-12T05:21:13.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584716+0000", 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3939999999999999e-06 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584723+0000", 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2189999999999998e-06 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584728+0000", 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0660000000000003e-06 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78586 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585636+0000", 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0083563730000000003, 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010735178999999999, 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.785 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78586 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585636+0000", 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585636+0000", 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585637+0000", 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585639+0000", 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0439999999999998e-06 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585645+0000", 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.173e-06 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585650+0000", 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7269999999999998e-06 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.788 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78647 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586327+0000", 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0076654089999999998, 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010093176000000001, 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78647 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586327+0000", 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586327+0000", 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586328+0000", 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5699999999999998e-07 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586330+0000", 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586337+0000", 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.793e-06 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586342+0000", 2024-09-12T05:21:13.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6670000000000004e-06 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78717 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587007+0000", 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0069856950000000001, 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094614369999999996, 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.792 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78717 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587007+0000", 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587007+0000", 2024-09-12T05:21:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587008+0000", 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2200000000000004e-07 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587010+0000", 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.345e-06 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587017+0000", 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0060000000000003e-06 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587022+0000", 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.186e-06 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78858 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588019+0000", 2024-09-12T05:21:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0059738960000000002, 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084988440000000002, 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78858 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588019+0000", 2024-09-12T05:21:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588019+0000", 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588019+0000", 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3799999999999998e-07 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588021+0000", 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.815e-06 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588027+0000", 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.925e-06 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588032+0000", 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6829999999999999e-06 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78459 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583609+0000", 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.01038392, 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012968950999999999, 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78459 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583609+0000", 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583609+0000", 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583609+0000", 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.37e-07 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583612+0000", 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5809999999999999e-06 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583619+0000", 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.221e-06 2024-09-12T05:21:13.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583625+0000", 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5199999999999997e-06 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78526 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584750+0000", 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0092431149999999997, 2024-09-12T05:21:13.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011878357000000001, 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78526 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584750+0000", 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584750+0000", 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584750+0000", 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7800000000000001e-07 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584752+0000", 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2730000000000001e-06 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584760+0000", 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.328e-06 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584766+0000", 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9440000000000002e-06 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.805 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78587 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585656+0000", 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0083371150000000008, 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011020502999999999, 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.806 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78587 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585656+0000", 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585656+0000", 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585656+0000", 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4999999999999998e-07 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585658+0000", 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0020000000000001e-06 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585664+0000", 2024-09-12T05:21:13.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8490000000000002e-06 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585668+0000", 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4870000000000004e-06 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78648 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586348+0000", 2024-09-12T05:21:13.809 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.007644634, 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010372678, 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78648 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586348+0000", 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586348+0000", 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586348+0000", 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3500000000000002e-07 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586350+0000", 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9659999999999999e-06 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586356+0000", 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9889999999999997e-06 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586361+0000", 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6090000000000003e-06 2024-09-12T05:21:13.812 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78718 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587039+0000", 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0069538270000000001, 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0097196550000000007, 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.813 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78718 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587039+0000", 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587039+0000", 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587039+0000", 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9400000000000005e-07 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587042+0000", 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.243e-06 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587049+0000", 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2019999999999998e-06 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587054+0000", 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0209999999999999e-06 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78861 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588037+0000", 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0059553899999999996, 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087581959999999993, 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78861 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588037+0000", 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588037+0000", 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588038+0000", 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5100000000000001e-07 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588039+0000", 2024-09-12T05:21:13.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7549999999999999e-06 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588045+0000", 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8579999999999996e-06 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588050+0000", 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.532e-06 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78460 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583641+0000", 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010351534000000001, 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013192812999999999, 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78460 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.820 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583641+0000", 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583641+0000", 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583642+0000", 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1200000000000003e-07 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583644+0000", 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3420000000000002e-06 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583651+0000", 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1690000000000003e-06 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583657+0000", 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5609999999999998e-06 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78528 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584786+0000", 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0092065800000000007, 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012095903, 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78528 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584786+0000", 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584786+0000", 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584787+0000", 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8800000000000002e-07 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584789+0000", 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5359999999999999e-06 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584797+0000", 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5499999999999997e-06 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584802+0000", 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3469999999999998e-06 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78592 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585674+0000", 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0083187379999999991, 2024-09-12T05:21:13.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011245421, 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78592 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585674+0000", 2024-09-12T05:21:13.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585674+0000", 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585674+0000", 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4400000000000001e-07 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585676+0000", 2024-09-12T05:21:13.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6649999999999999e-06 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585682+0000", 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7620000000000001e-06 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585686+0000", 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.651e-06 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78651 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586367+0000", 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.007625593, 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010576933, 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78651 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.830 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586367+0000", 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586367+0000", 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586368+0000", 2024-09-12T05:21:13.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7e-07 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586369+0000", 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8899999999999999e-06 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586375+0000", 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9989999999999997e-06 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586380+0000", 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5050000000000001e-06 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78721 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587070+0000", 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0069221860000000003, 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.009909724, 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.833 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78721 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587070+0000", 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587070+0000", 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587071+0000", 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8999999999999996e-07 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587073+0000", 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.266e-06 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587081+0000", 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3189999999999997e-06 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587086+0000", 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0640000000000001e-06 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78862 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588056+0000", 2024-09-12T05:21:13.836 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0059366189999999998, 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089527860000000008, 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78862 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588056+0000", 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588056+0000", 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588056+0000", 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.65e-07 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588058+0000", 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.035e-06 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588065+0000", 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1800000000000001e-06 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588069+0000", 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.882e-06 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78463 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583674+0000", 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010318427, 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013381709, 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78463 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583674+0000", 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583674+0000", 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583675+0000", 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5499999999999998e-07 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583677+0000", 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3530000000000002e-06 2024-09-12T05:21:13.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583684+0000", 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1380000000000001e-06 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583690+0000", 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8030000000000002e-06 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78529 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584818+0000", 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0091743099999999998, 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01231137, 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78529 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.847 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584818+0000", 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584818+0000", 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584819+0000", 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8999999999999996e-07 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584821+0000", 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1720000000000001e-06 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584828+0000", 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0910000000000004e-06 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584834+0000", 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3170000000000001e-06 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78593 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585692+0000", 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0083006980000000005, 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011487961, 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.850 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78593 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585692+0000", 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585692+0000", 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585692+0000", 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5999999999999999e-07 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585694+0000", 2024-09-12T05:21:13.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6649999999999999e-06 2024-09-12T05:21:13.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585700+0000", 2024-09-12T05:21:13.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5269999999999998e-06 2024-09-12T05:21:13.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585704+0000", 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.758e-06 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78652 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586386+0000", 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0076063850000000002, 2024-09-12T05:21:13.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010845594, 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78652 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586386+0000", 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586386+0000", 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586387+0000", 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4900000000000001e-07 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586392+0000", 2024-09-12T05:21:13.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.665e-06 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586398+0000", 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2140000000000001e-06 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586403+0000", 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7079999999999996e-06 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78722 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587103+0000", 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0068898279999999998, 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010181257000000001, 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78722 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.861 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587103+0000", 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587103+0000", 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587103+0000", 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3099999999999997e-07 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587106+0000", 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1919999999999999e-06 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587113+0000", 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3270000000000003e-06 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587118+0000", 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1229999999999999e-06 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78865 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588077+0000", 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0059159490000000002, 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.009258156, 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.864 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78865 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588077+0000", 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588077+0000", 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588077+0000", 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.08e-07 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588079+0000", 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2520000000000002e-06 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588086+0000", 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2430000000000002e-06 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588090+0000", 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7949999999999998e-06 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78464 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.867 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583708+0000", 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010284888000000001, 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013682645, 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78464 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583708+0000", 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583708+0000", 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583708+0000", 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8500000000000001e-07 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583715+0000", 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4060000000000002e-06 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583723+0000", 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9340000000000006e-06 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583728+0000", 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:21:13.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78532 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584851+0000", 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0091416339999999992, 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012589626, 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78532 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584851+0000", 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584851+0000", 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584852+0000", 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-07 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584854+0000", 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2649999999999999e-06 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584862+0000", 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7510000000000008e-06 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584867+0000", 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3680000000000001e-06 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78596 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585711+0000", 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0082816799999999996, 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011779773, 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78596 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585711+0000", 2024-09-12T05:21:13.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585711+0000", 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585711+0000", 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5999999999999999e-07 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585714+0000", 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3250000000000002e-06 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585720+0000", 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5069999999999997e-06 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585725+0000", 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.011e-06 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.877 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78657 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586410+0000", 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0075831459999999998, 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011116549, 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78657 2024-09-12T05:21:13.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586410+0000", 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586410+0000", 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586410+0000", 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3200000000000001e-07 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586412+0000", 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.894e-06 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586417+0000", 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6899999999999997e-06 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586422+0000", 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7639999999999996e-06 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78723 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587135+0000", 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.006857597, 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010435236000000001, 2024-09-12T05:21:13.881 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78723 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587135+0000", 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587135+0000", 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587136+0000", 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3e-07 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587138+0000", 2024-09-12T05:21:13.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2390000000000001e-06 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587145+0000", 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9500000000000004e-06 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587151+0000", 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5490000000000003e-06 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78866 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588097+0000", 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0058952910000000004, 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094981509999999998, 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78866 2024-09-12T05:21:13.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588097+0000", 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588097+0000", 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588098+0000", 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588100+0000", 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0379999999999998e-06 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588106+0000", 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.579e-06 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588111+0000", 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0300000000000001e-06 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78467 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583737+0000", 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010255723, 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013889178, 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.888 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78467 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583737+0000", 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583737+0000", 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583738+0000", 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2600000000000002e-07 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583740+0000", 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1610000000000001e-06 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583746+0000", 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5050000000000004e-06 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583752+0000", 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.293e-06 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.891 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78533 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584885+0000", 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0091077150000000006, 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012782946, 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78533 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584885+0000", 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584885+0000", 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584886+0000", 2024-09-12T05:21:13.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.75e-07 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584888+0000", 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2560000000000001e-06 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584895+0000", 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3030000000000002e-06 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584900+0000", 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78597 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585732+0000", 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0082606079999999991, 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011978417, 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.895 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78597 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585732+0000", 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585732+0000", 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585732+0000", 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4799999999999999e-07 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585734+0000", 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9719999999999999e-06 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585741+0000", 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.229e-06 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585745+0000", 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8740000000000003e-06 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.898 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78659 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586428+0000", 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0075644759999999997, 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011331770999999999, 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78659 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586428+0000", 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586428+0000", 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586429+0000", 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4799999999999999e-07 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586430+0000", 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.823e-06 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586436+0000", 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7200000000000003e-06 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586440+0000", 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2479999999999998e-06 2024-09-12T05:21:13.901 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78724 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587168+0000", 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0068243720000000004, 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010644048, 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.902 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78724 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587168+0000", 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587168+0000", 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587169+0000", 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7899999999999998e-07 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587171+0000", 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587188+0000", 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7091999999999998e-05 2024-09-12T05:21:13.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587194+0000", 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78869 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588118+0000", 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0058746700000000002, 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0097439380000000006, 2024-09-12T05:21:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78869 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588118+0000", 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588118+0000", 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588118+0000", 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5400000000000002e-07 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588120+0000", 2024-09-12T05:21:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588126+0000", 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8590000000000001e-06 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588131+0000", 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5889999999999996e-06 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78468 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583777+0000", 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010215541, 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01414023, 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78468 2024-09-12T05:21:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583777+0000", 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583777+0000", 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583778+0000", 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3600000000000003e-07 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583781+0000", 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7930000000000002e-06 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583789+0000", 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1300000000000001e-06 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583795+0000", 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.964e-06 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78534 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584921+0000", 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0090719909999999997, 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013047527999999999, 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78534 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584921+0000", 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584921+0000", 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584921+0000", 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6499999999999999e-07 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584923+0000", 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1339999999999998e-06 2024-09-12T05:21:13.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584930+0000", 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0509999999999999e-06 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584936+0000", 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3499999999999996e-06 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78600 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585753+0000", 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0082400609999999999, 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012266127999999999, 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78600 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585753+0000", 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585753+0000", 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585753+0000", 2024-09-12T05:21:13.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9299999999999999e-07 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585755+0000", 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0930000000000001e-06 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585761+0000", 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.348e-06 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585766+0000", 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6779999999999999e-06 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78660 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586446+0000", 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0075464, 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011622574, 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.919 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78660 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586446+0000", 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586446+0000", 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586447+0000", 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0900000000000002e-07 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586449+0000", 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.905e-06 2024-09-12T05:21:13.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586454+0000", 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6999999999999996e-06 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586459+0000", 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3760000000000001e-06 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78726 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587211+0000", 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0067817229999999999, 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010909268999999999, 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78726 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587211+0000", 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587211+0000", 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587212+0000", 2024-09-12T05:21:13.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1500000000000004e-07 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587214+0000", 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.543e-06 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587221+0000", 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3470000000000001e-06 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587227+0000", 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1789999999999999e-06 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78870 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588136+0000", 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0058563390000000003, 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010033632000000001, 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.926 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78870 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588136+0000", 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588136+0000", 2024-09-12T05:21:13.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588137+0000", 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4799999999999999e-07 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588138+0000", 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7740000000000001e-06 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588144+0000", 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9290000000000003e-06 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588149+0000", 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7779999999999998e-06 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78472 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.929 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583818+0000", 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010175081000000001, 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014408883000000001, 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78472 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583818+0000", 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583818+0000", 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583818+0000", 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7599999999999997e-07 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583820+0000", 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583828+0000", 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3069999999999997e-06 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583835+0000", 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0190000000000001e-06 2024-09-12T05:21:13.932 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78537 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584960+0000", 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0090327010000000006, 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013317018, 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.933 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78537 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584960+0000", 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584960+0000", 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584961+0000", 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5400000000000001e-07 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584963+0000", 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2960000000000001e-06 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584970+0000", 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6229999999999997e-06 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584976+0000", 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8690000000000001e-06 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78601 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585773+0000", 2024-09-12T05:21:13.936 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0082197350000000006, 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012554572, 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78601 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.937 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585773+0000", 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585773+0000", 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585773+0000", 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585775+0000", 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1160000000000002e-06 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585782+0000", 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8379999999999996e-06 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585787+0000", 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9350000000000002e-06 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78665 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586465+0000", 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0075278289999999998, 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011913702999999999, 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78665 2024-09-12T05:21:13.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586465+0000", 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586465+0000", 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586465+0000", 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-07 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586467+0000", 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9130000000000001e-06 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586473+0000", 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9100000000000002e-06 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586477+0000", 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3939999999999998e-06 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78727 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587246+0000", 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0067469019999999999, 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011162829000000001, 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.945 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78727 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587246+0000", 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587246+0000", 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587246+0000", 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4700000000000001e-07 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587253+0000", 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587261+0000", 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1799999999999996e-06 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587266+0000", 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520000000000004e-06 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78872 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588155+0000", 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0058378329999999997, 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010277689, 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.949 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78872 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588155+0000", 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588155+0000", 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588155+0000", 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.41e-07 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588157+0000", 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.73e-06 2024-09-12T05:21:13.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588163+0000", 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8340000000000004e-06 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588167+0000", 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.69e-06 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78473 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583852+0000", 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010140565000000001, 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014611470999999999, 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78473 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583852+0000", 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583852+0000", 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583853+0000", 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583855+0000", 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2680000000000001e-06 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583863+0000", 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.79e-06 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583869+0000", 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8889999999999999e-06 2024-09-12T05:21:13.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78538 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584985+0000", 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0090078940000000007, 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013518864, 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.957 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78538 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584985+0000", 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584985+0000", 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584985+0000", 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1600000000000001e-07 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584991+0000", 2024-09-12T05:21:13.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0630000000000002e-06 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584998+0000", 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0149999999999998e-06 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585004+0000", 2024-09-12T05:21:13.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.31e-06 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78604 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585794+0000", 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0081983460000000005, 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012734529, 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.961 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78604 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585794+0000", 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585794+0000", 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585795+0000", 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3300000000000002e-07 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585797+0000", 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2000000000000001e-06 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585804+0000", 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585809+0000", 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4349999999999996e-06 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.965 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78666 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586483+0000", 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.007509422, 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012069401, 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78666 2024-09-12T05:21:13.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586483+0000", 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586483+0000", 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586484+0000", 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4900000000000001e-07 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586486+0000", 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.024e-06 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586492+0000", 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9669999999999998e-06 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586496+0000", 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6639999999999997e-06 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.969 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78730 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587275+0000", 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0067174030000000003, 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011309720000000001, 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.970 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78730 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587275+0000", 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587275+0000", 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587276+0000", 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1200000000000003e-07 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587278+0000", 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1950000000000002e-06 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587286+0000", 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1259999999999998e-06 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587291+0000", 2024-09-12T05:21:13.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1970000000000004e-06 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78873 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588173+0000", 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0058194240000000001, 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010460389, 2024-09-12T05:21:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78873 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588173+0000", 2024-09-12T05:21:13.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588173+0000", 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588174+0000", 2024-09-12T05:21:13.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7300000000000001e-07 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588176+0000", 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9300000000000002e-06 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588181+0000", 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8710000000000002e-06 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588187+0000", 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1000000000000003e-06 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78478 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583887+0000", 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010105469000000001, 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014800759, 2024-09-12T05:21:13.978 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78478 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583887+0000", 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583887+0000", 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583888+0000", 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3200000000000005e-07 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583890+0000", 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0320000000000002e-06 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583897+0000", 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0779999999999998e-06 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583902+0000", 2024-09-12T05:21:13.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.091e-06 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78541 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585021+0000", 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0089719280000000005, 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013716447, 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78541 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585021+0000", 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585021+0000", 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585021+0000", 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5600000000000005e-07 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1579999999999999e-06 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585031+0000", 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8869999999999992e-06 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585037+0000", 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3720000000000004e-06 2024-09-12T05:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78605 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585817+0000", 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0081756780000000005, 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012969843999999999, 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78605 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585817+0000", 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585817+0000", 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585817+0000", 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1500000000000005e-07 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585820+0000", 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2089999999999999e-06 2024-09-12T05:21:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585826+0000", 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2960000000000004e-06 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585831+0000", 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7809999999999996e-06 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78669 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586503+0000", 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0074899739999999999, 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012332963000000001, 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78669 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586503+0000", 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586503+0000", 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586503+0000", 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8200000000000001e-07 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586505+0000", 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9800000000000001e-06 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586511+0000", 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1920000000000002e-06 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586515+0000", 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9469999999999996e-06 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78731 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587315+0000", 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0066779680000000003, 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011570636, 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78731 2024-09-12T05:21:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587315+0000", 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587315+0000", 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587315+0000", 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.13e-07 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587318+0000", 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4540000000000001e-06 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587326+0000", 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3760000000000008e-06 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587332+0000", 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0800000000000002e-06 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:13.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78875 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588194+0000", 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.005799093, 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010741235999999999, 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:13.998 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78875 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588194+0000", 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588194+0000", 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:13.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588194+0000", 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8400000000000005e-07 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588196+0000", 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.018e-06 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588203+0000", 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5860000000000001e-06 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588208+0000", 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0159999999999999e-06 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78479 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583920+0000", 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010072316, 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015068972, 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.002 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78479 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583920+0000", 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583920+0000", 2024-09-12T05:21:14.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583921+0000", 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7400000000000003e-07 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583923+0000", 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.199e-06 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583930+0000", 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583936+0000", 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4689999999999996e-06 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78542 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0089394580000000008, 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013985757999999999, 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.006 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78542 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585054+0000", 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7000000000000005e-07 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585056+0000", 2024-09-12T05:21:14.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.204e-06 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585064+0000", 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1349999999999992e-06 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585070+0000", 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6949999999999997e-06 2024-09-12T05:21:14.009 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78606 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585838+0000", 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0081545330000000003, 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013251044999999999, 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.010 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78606 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585838+0000", 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585838+0000", 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585839+0000", 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7999999999999996e-07 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585841+0000", 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1730000000000002e-06 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585847+0000", 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4160000000000001e-06 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585852+0000", 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0610000000000003e-06 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78673 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586524+0000", 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0074689589999999998, 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012614254, 2024-09-12T05:21:14.014 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78673 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586524+0000", 2024-09-12T05:21:14.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586524+0000", 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586524+0000", 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.01e-07 2024-09-12T05:21:14.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586526+0000", 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586532+0000", 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1310000000000003e-06 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586537+0000", 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3150000000000002e-06 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78734 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587350+0000", 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0066428290000000003, 2024-09-12T05:21:14.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011842663999999999, 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78734 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587350+0000", 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587350+0000", 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587350+0000", 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4600000000000004e-07 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587353+0000", 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.706e-06 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587361+0000", 2024-09-12T05:21:14.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7340000000000008e-06 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587367+0000", 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9839999999999998e-06 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.022 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78876 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588215+0000", 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.005777229, 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011028486000000001, 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78876 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588215+0000", 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588215+0000", 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588216+0000", 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1600000000000002e-07 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588218+0000", 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3140000000000002e-06 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588225+0000", 2024-09-12T05:21:14.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588230+0000", 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9409999999999998e-06 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.026 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78480 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583952+0000", 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010040751000000001, 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01534834, 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78480 2024-09-12T05:21:14.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583952+0000", 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583952+0000", 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583952+0000", 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9500000000000002e-07 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583955+0000", 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3149999999999999e-06 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583963+0000", 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9030000000000004e-06 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583969+0000", 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9610000000000002e-06 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78545 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0089137959999999999, 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014270433000000001, 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.031 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78545 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:21:14.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1430000000000001e-06 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585096+0000", 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0759999999999997e-06 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78609 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585860+0000", 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0081325619999999994, 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013539763999999999, 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78609 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585860+0000", 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585860+0000", 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585861+0000", 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.37e-07 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585866+0000", 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7459999999999997e-06 2024-09-12T05:21:14.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585873+0000", 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9140000000000002e-06 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585878+0000", 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8300000000000003e-06 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78674 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586542+0000", 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0074504790000000003, 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012908777, 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.039 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78674 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586542+0000", 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586542+0000", 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586543+0000", 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7399999999999999e-07 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586544+0000", 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8870000000000001e-06 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586550+0000", 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5040000000000002e-06 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586554+0000", 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3590000000000001e-06 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78735 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587377+0000", 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0066157339999999999, 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012123393999999999, 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78735 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.043 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587377+0000", 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587377+0000", 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587378+0000", 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8699999999999995e-07 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587380+0000", 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2010000000000002e-06 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587386+0000", 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3500000000000002e-06 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587391+0000", 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.69e-06 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.046 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78878 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588237+0000", 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0057561160000000004, 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011313686999999999, 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78878 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588237+0000", 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588237+0000", 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588237+0000", 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6399999999999998e-07 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588243+0000", 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0260000000000004e-06 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588250+0000", 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0149999999999998e-06 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588255+0000", 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9509999999999997e-06 2024-09-12T05:21:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78483 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.583978+0000", 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.010015022, 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015623655, 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.051 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78483 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583978+0000", 2024-09-12T05:21:14.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583978+0000", 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583978+0000", 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8899999999999999e-07 2024-09-12T05:21:14.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583981+0000", 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4219999999999999e-06 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583990+0000", 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.884e-06 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583995+0000", 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8860000000000001e-06 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78546 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585103+0000", 2024-09-12T05:21:14.055 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0088896359999999994, 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014547796999999999, 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78546 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585103+0000", 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585103+0000", 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585104+0000", 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4199999999999996e-07 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585106+0000", 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.978e-06 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0669999999999999e-06 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78610 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.059 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585886+0000", 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0081067050000000005, 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013814554999999999, 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78610 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.060 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585886+0000", 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585886+0000", 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585886+0000", 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0100000000000005e-07 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585889+0000", 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4530000000000001e-06 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585895+0000", 2024-09-12T05:21:14.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3720000000000001e-06 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585900+0000", 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9230000000000001e-06 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.063 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78677 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586560+0000", 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.007432831, 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013190336, 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78677 2024-09-12T05:21:14.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586560+0000", 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586560+0000", 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586560+0000", 2024-09-12T05:21:14.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1e-07 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586562+0000", 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.057e-06 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586568+0000", 2024-09-12T05:21:14.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3619999999999997e-06 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586571+0000", 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7409999999999998e-06 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78738 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.069 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587414+0000", 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0065787140000000003, 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012385436999999999, 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78738 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587414+0000", 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587414+0000", 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587415+0000", 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5700000000000002e-07 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587417+0000", 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7080000000000002e-06 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587425+0000", 2024-09-12T05:21:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7190000000000001e-06 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587431+0000", 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.733e-06 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78879 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588263+0000", 2024-09-12T05:21:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0057300750000000003, 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011586068999999999, 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78879 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588263+0000", 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588263+0000", 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588263+0000", 2024-09-12T05:21:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5400000000000002e-07 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588265+0000", 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3290000000000001e-06 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588272+0000", 2024-09-12T05:21:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2899999999999999e-06 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588277+0000", 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9459999999999997e-06 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78485 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584015+0000", 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0099780400000000005, 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015884583000000001, 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.078 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78485 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584015+0000", 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584015+0000", 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584015+0000", 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1500000000000004e-07 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584017+0000", 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.029e-06 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584025+0000", 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4240000000000004e-06 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584030+0000", 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6790000000000002e-06 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78547 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.081 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585146+0000", 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0088462439999999996, 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014802143, 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78547 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585146+0000", 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585146+0000", 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585147+0000", 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7199999999999999e-07 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585150+0000", 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7030000000000002e-06 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585159+0000", 2024-09-12T05:21:14.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4420000000000004e-06 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585167+0000", 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4440000000000002e-06 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78611 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585908+0000", 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0080848050000000005, 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014090116, 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78611 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.086 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585908+0000", 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585908+0000", 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585908+0000", 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6300000000000005e-07 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585911+0000", 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2790000000000001e-06 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585917+0000", 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6510000000000004e-06 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585922+0000", 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1479999999999997e-06 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78678 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586577+0000", 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0074158119999999999, 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013470767, 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78678 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586577+0000", 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586577+0000", 2024-09-12T05:21:14.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586577+0000", 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1e-07 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586579+0000", 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0320000000000002e-06 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586584+0000", 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1150000000000002e-06 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586588+0000", 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78741 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587448+0000", 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.006544907, 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012649792, 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.094 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78741 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587448+0000", 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587448+0000", 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587448+0000", 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3799999999999997e-07 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587451+0000", 2024-09-12T05:21:14.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.407e-06 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587458+0000", 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3409999999999997e-06 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587464+0000", 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8409999999999996e-06 2024-09-12T05:21:14.097 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78881 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588284+0000", 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0057090939999999996, 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011863370999999999, 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.098 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78881 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588284+0000", 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588284+0000", 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588284+0000", 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7300000000000002e-07 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588286+0000", 2024-09-12T05:21:14.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0899999999999999e-06 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588293+0000", 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5950000000000004e-06 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588298+0000", 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2340000000000002e-06 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.101 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78487 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584047+0000", 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.009945766, 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016149241000000002, 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.102 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78487 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584047+0000", 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584047+0000", 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584047+0000", 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0999999999999998e-07 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584049+0000", 2024-09-12T05:21:14.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9520000000000001e-06 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584058+0000", 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4770000000000003e-06 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584065+0000", 2024-09-12T05:21:14.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7270000000000001e-06 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78548 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585177+0000", 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0088155820000000006, 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015068274, 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.106 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78548 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585177+0000", 2024-09-12T05:21:14.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585177+0000", 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585178+0000", 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8999999999999996e-07 2024-09-12T05:21:14.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585180+0000", 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5069999999999999e-06 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585188+0000", 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8399999999999995e-06 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585193+0000", 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78614 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585929+0000", 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0080633430000000006, 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014366434000000001, 2024-09-12T05:21:14.110 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78614 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585929+0000", 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585929+0000", 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585930+0000", 2024-09-12T05:21:14.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7300000000000001e-07 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585932+0000", 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0099999999999998e-06 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585938+0000", 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3640000000000004e-06 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585943+0000", 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8799999999999999e-06 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78682 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586594+0000", 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.007398455, 2024-09-12T05:21:14.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013783739999999999, 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78682 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586594+0000", 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586594+0000", 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586595+0000", 2024-09-12T05:21:14.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4400000000000001e-07 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586596+0000", 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.779e-06 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586602+0000", 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8560000000000003e-06 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586606+0000", 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.693e-06 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78742 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587479+0000", 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0065133600000000002, 2024-09-12T05:21:14.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012948595, 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78742 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587479+0000", 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587479+0000", 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587480+0000", 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:21:14.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587482+0000", 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4030000000000001e-06 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587489+0000", 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0709999999999997e-06 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587495+0000", 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4410000000000001e-06 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78882 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588305+0000", 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0056879820000000003, 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012172453, 2024-09-12T05:21:14.122 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78882 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588305+0000", 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588305+0000", 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588305+0000", 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8599999999999999e-07 2024-09-12T05:21:14.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588307+0000", 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1490000000000001e-06 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588314+0000", 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2990000000000002e-06 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588318+0000", 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8849999999999998e-06 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78490 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584086+0000", 2024-09-12T05:21:14.126 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0099063680000000005, 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016440234000000001, 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78490 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584086+0000", 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584086+0000", 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584087+0000", 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000002e-07 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584089+0000", 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.446e-06 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584097+0000", 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1720000000000007e-06 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584103+0000", 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7729999999999996e-06 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.130 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78549 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585220+0000", 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0087725089999999995, 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015355989, 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78549 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.131 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585220+0000", 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585220+0000", 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585221+0000", 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7900000000000007e-07 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585224+0000", 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.881e-06 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585233+0000", 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8140000000000007e-06 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585239+0000", 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8860000000000001e-06 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78615 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585950+0000", 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0080423969999999997, 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014674990000000001, 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78615 2024-09-12T05:21:14.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585950+0000", 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585950+0000", 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585951+0000", 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.82e-07 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585953+0000", 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.069e-06 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585959+0000", 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3450000000000002e-06 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585964+0000", 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8029999999999996e-06 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.138 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78683 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586612+0000", 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0073809840000000002, 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014063572, 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78683 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.139 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586612+0000", 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586612+0000", 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586612+0000", 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6699999999999999e-07 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586618+0000", 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5160000000000002e-06 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586624+0000", 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0129999999999999e-06 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586628+0000", 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4719999999999997e-06 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78745 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587513+0000", 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0064799089999999998, 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013212316, 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78745 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587513+0000", 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587513+0000", 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587513+0000", 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2500000000000005e-07 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587516+0000", 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6929999999999999e-06 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587524+0000", 2024-09-12T05:21:14.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0569999999999993e-06 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587530+0000", 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7610000000000004e-06 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78886 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588326+0000", 2024-09-12T05:21:14.146 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0056667469999999998, 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012448673, 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78886 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588326+0000", 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588326+0000", 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588326+0000", 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588329+0000", 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2560000000000001e-06 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588335+0000", 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5930000000000002e-06 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588340+0000", 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.685e-06 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78492 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584112+0000", 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0098803520000000002, 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016710866000000001, 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.150 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78492 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584112+0000", 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584112+0000", 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584113+0000", 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5199999999999997e-07 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584138+0000", 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5199e-05 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584146+0000", 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8329999999999994e-06 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584152+0000", 2024-09-12T05:21:14.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8619999999999999e-06 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78551 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585248+0000", 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0087447549999999999, 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015624537000000001, 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78551 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585248+0000", 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585248+0000", 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585248+0000", 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2300000000000001e-07 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585251+0000", 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585258+0000", 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9720000000000003e-06 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585263+0000", 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78616 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585971+0000", 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0080216260000000005, 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014952076999999999, 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.158 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78616 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585971+0000", 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585971+0000", 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585971+0000", 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7e-07 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585974+0000", 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0789999999999999e-06 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585980+0000", 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6730000000000003e-06 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585985+0000", 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0420000000000002e-06 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78686 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586634+0000", 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0073582659999999996, 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014338467000000001, 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.162 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78686 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586634+0000", 2024-09-12T05:21:14.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586634+0000", 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586635+0000", 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4200000000000002e-07 2024-09-12T05:21:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586637+0000", 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.809e-06 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586646+0000", 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8670000000000006e-06 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586651+0000", 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.561e-06 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78746 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587546+0000", 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0064463180000000004, 2024-09-12T05:21:14.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013475638, 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78746 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587546+0000", 2024-09-12T05:21:14.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587546+0000", 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587547+0000", 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6000000000000003e-07 2024-09-12T05:21:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587550+0000", 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5679999999999998e-06 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587557+0000", 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587563+0000", 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6799999999999998e-06 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78887 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588347+0000", 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0056459570000000001, 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012723183000000001, 2024-09-12T05:21:14.170 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78887 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588347+0000", 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588347+0000", 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588347+0000", 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588349+0000", 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3700000000000002e-06 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588356+0000", 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7179999999999999e-06 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588361+0000", 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0119999999999996e-06 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78495 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584184+0000", 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0098083340000000001, 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016934681, 2024-09-12T05:21:14.174 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78495 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584184+0000", 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584184+0000", 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584185+0000", 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5199999999999997e-07 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584188+0000", 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9660000000000001e-06 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584197+0000", 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7450000000000001e-06 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584203+0000", 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.173e-06 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.178 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78554 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585272+0000", 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0087207729999999994, 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015896589999999999, 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78554 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585272+0000", 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585272+0000", 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585272+0000", 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0800000000000004e-07 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585275+0000", 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.616e-06 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585283+0000", 2024-09-12T05:21:14.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4030000000000001e-06 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585288+0000", 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2009999999999998e-06 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78619 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585993+0000", 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0080000720000000004, 2024-09-12T05:21:14.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015224423000000001, 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78619 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585993+0000", 2024-09-12T05:21:14.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585993+0000", 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585993+0000", 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7700000000000005e-07 2024-09-12T05:21:14.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585995+0000", 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1059999999999998e-06 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586001+0000", 2024-09-12T05:21:14.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1940000000000003e-06 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586006+0000", 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8160000000000001e-06 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.186 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78687 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586658+0000", 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0073351179999999998, 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014608311000000001, 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78687 2024-09-12T05:21:14.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586658+0000", 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586658+0000", 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586658+0000", 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6100000000000002e-07 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586660+0000", 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1830000000000001e-06 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586666+0000", 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6359999999999999e-06 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586670+0000", 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8290000000000001e-06 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78748 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587578+0000", 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0064148039999999996, 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013737081999999999, 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78748 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.191 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587578+0000", 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587578+0000", 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587578+0000", 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1200000000000003e-07 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587581+0000", 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2230000000000001e-06 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587588+0000", 2024-09-12T05:21:14.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4080000000000001e-06 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587594+0000", 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4999999999999999e-06 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.194 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78890 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588368+0000", 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0056243600000000001, 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012995937000000001, 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78890 2024-09-12T05:21:14.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588368+0000", 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588368+0000", 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588369+0000", 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0200000000000003e-07 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588371+0000", 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0339999999999999e-06 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588377+0000", 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0939999999999996e-06 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588381+0000", 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5310000000000003e-06 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.198 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78497 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584212+0000", 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0097803449999999993, 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017206517000000001, 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.199 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78497 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584212+0000", 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584212+0000", 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584213+0000", 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1399999999999997e-07 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584215+0000", 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0320000000000002e-06 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584223+0000", 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9999999999999996e-06 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584228+0000", 2024-09-12T05:21:14.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4060000000000004e-06 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78555 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585312+0000", 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0086801829999999993, 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016156826999999999, 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.203 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78555 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585312+0000", 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585312+0000", 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585313+0000", 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4600000000000003e-07 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585318+0000", 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4150000000000001e-06 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585328+0000", 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0457e-05 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585335+0000", 2024-09-12T05:21:14.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.153e-06 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78620 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586013+0000", 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0079792879999999993, 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015505443000000001, 2024-09-12T05:21:14.207 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78620 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586013+0000", 2024-09-12T05:21:14.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586013+0000", 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586014+0000", 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0999999999999998e-07 2024-09-12T05:21:14.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586016+0000", 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.984e-06 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586022+0000", 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2589999999999997e-06 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586027+0000", 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9219999999999996e-06 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78690 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586675+0000", 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0073176819999999998, 2024-09-12T05:21:14.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01489363, 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78690 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586675+0000", 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586675+0000", 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586675+0000", 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9700000000000003e-07 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586677+0000", 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8080000000000001e-06 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586682+0000", 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2510000000000002e-06 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586687+0000", 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2080000000000002e-06 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78828 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587610+0000", 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0063826430000000003, 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014007731000000001, 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.216 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78828 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587610+0000", 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587610+0000", 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587611+0000", 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5600000000000005e-07 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587613+0000", 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1799999999999999e-06 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587620+0000", 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5820000000000004e-06 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587626+0000", 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6319999999999996e-06 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.219 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78891 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588387+0000", 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0056054140000000004, 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013280370999999999, 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.220 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78891 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588387+0000", 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588387+0000", 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588388+0000", 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2899999999999999e-07 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588389+0000", 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8390000000000001e-06 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588395+0000", 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588400+0000", 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3819999999999997e-06 2024-09-12T05:21:14.223 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78500 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584247+0000", 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0097454540000000006, 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017469971000000001, 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.224 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78500 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584247+0000", 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584247+0000", 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584248+0000", 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5600000000000005e-07 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584250+0000", 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2589999999999999e-06 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584257+0000", 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1400000000000002e-06 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584262+0000", 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1599999999999997e-06 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.227 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78558 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585349+0000", 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0086434860000000006, 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016417233, 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.228 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78558 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585349+0000", 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585349+0000", 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585350+0000", 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9699999999999996e-07 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585352+0000", 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7690000000000001e-06 2024-09-12T05:21:14.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585360+0000", 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585365+0000", 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4260000000000002e-06 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78621 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586033+0000", 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0079596370000000003, 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015781898999999999, 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.232 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78621 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586033+0000", 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586033+0000", 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586034+0000", 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2200000000000004e-07 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586035+0000", 2024-09-12T05:21:14.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.832e-06 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586041+0000", 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7300000000000002e-06 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586046+0000", 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5680000000000001e-06 2024-09-12T05:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78691 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586692+0000", 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0073004760000000002, 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015171924999999999, 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.236 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78691 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586692+0000", 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586692+0000", 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586693+0000", 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4299999999999999e-07 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586694+0000", 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.877e-06 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586700+0000", 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5300000000000004e-06 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586704+0000", 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5820000000000002e-06 2024-09-12T05:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78829 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587643+0000", 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0063492059999999996, 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014270549, 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78829 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587643+0000", 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587643+0000", 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587644+0000", 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3900000000000004e-07 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587650+0000", 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2500000000000003e-06 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587659+0000", 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4999999999999999e-06 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587664+0000", 2024-09-12T05:21:14.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6330000000000001e-06 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78894 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.588405+0000", 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.005587496, 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013557948, 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78894 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588405+0000", 2024-09-12T05:21:14.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.588405+0000", 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595347+0000", 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0069417480000000002 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595353+0000", 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9839999999999998e-06 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595366+0000", 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3287e-05 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595374+0000", 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1990000000000006e-06 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78502 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584280+0000", 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0097128030000000008, 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017732024999999998, 2024-09-12T05:21:14.248 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78502 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584280+0000", 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584280+0000", 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584280+0000", 2024-09-12T05:21:14.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.89e-07 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584283+0000", 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1940000000000001e-06 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584290+0000", 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584295+0000", 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4450000000000004e-06 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78559 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585379+0000", 2024-09-12T05:21:14.252 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0086137760000000001, 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016681274999999999, 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78559 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585379+0000", 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585379+0000", 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585379+0000", 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7599999999999997e-07 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585382+0000", 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5050000000000002e-06 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585390+0000", 2024-09-12T05:21:14.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7170000000000008e-06 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585395+0000", 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7520000000000002e-06 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.256 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78622 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586051+0000", 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0079412409999999999, 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016058118, 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78622 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.257 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586051+0000", 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586051+0000", 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586052+0000", 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4499999999999997e-07 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586053+0000", 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.637e-06 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586059+0000", 2024-09-12T05:21:14.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7849999999999997e-06 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586064+0000", 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8450000000000002e-06 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78694 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.260 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586709+0000", 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0072839840000000003, 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015449986000000001, 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78694 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586709+0000", 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586709+0000", 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586709+0000", 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2399999999999999e-07 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586711+0000", 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.832e-06 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586716+0000", 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2179999999999998e-06 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586721+0000", 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5560000000000001e-06 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.264 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78830 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587673+0000", 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.006319163, 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014533452000000001, 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78830 2024-09-12T05:21:14.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587673+0000", 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587673+0000", 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587674+0000", 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2699999999999999e-07 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587677+0000", 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.401e-06 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587683+0000", 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6529999999999997e-06 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587689+0000", 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5439999999999998e-06 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78895 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.595393+0000", 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4294967295.9985995, 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006864668, 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.269 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78895 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595393+0000", 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595393+0000", 2024-09-12T05:21:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595394+0000", 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8100000000000002e-07 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595397+0000", 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1089999999999998e-06 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595406+0000", 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6330000000000002e-06 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595412+0000", 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2310000000000001e-06 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78505 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.274 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584317+0000", 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0096757130000000007, 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017990652999999999, 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78505 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.275 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584317+0000", 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584317+0000", 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584317+0000", 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5700000000000002e-07 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584320+0000", 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584327+0000", 2024-09-12T05:21:14.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7230000000000004e-06 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584333+0000", 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4e-06 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78562 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.278 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585404+0000", 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0085891089999999993, 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016952413999999999, 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78562 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585404+0000", 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585404+0000", 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585404+0000", 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585406+0000", 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2079999999999999e-06 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585413+0000", 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585418+0000", 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.135e-06 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78625 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586070+0000", 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0079227870000000006, 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016335133000000002, 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.283 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78625 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586070+0000", 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586070+0000", 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586070+0000", 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.58e-07 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586072+0000", 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.72e-06 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586077+0000", 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.502e-06 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586082+0000", 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4490000000000001e-06 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78695 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586727+0000", 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0072661269999999998, 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015728130999999999, 2024-09-12T05:21:14.287 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78695 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586727+0000", 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586727+0000", 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586727+0000", 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.89e-07 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586729+0000", 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.86e-06 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586734+0000", 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6010000000000002e-06 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586739+0000", 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2259999999999999e-06 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78833 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587707+0000", 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0062854360000000001, 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014797708999999999, 2024-09-12T05:21:14.291 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78833 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587707+0000", 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587707+0000", 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587708+0000", 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7000000000000004e-07 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587710+0000", 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.503e-06 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587718+0000", 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7370000000000006e-06 2024-09-12T05:21:14.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587724+0000", 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78897 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.295 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.595423+0000", 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4294967295.9985695, 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071338820000000002, 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78897 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.296 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595423+0000", 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595423+0000", 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595424+0000", 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2300000000000001e-07 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595426+0000", 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.835e-06 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595435+0000", 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1699999999999997e-06 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595441+0000", 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9499999999999998e-06 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.299 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78507 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584353+0000", 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0096394480000000001, 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018254039, 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78507 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.300 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584353+0000", 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584353+0000", 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584354+0000", 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0999999999999998e-07 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584356+0000", 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5380000000000001e-06 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584365+0000", 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6319999999999997e-06 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584371+0000", 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0209999999999996e-06 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.303 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78566 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585425+0000", 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0085673999999999993, 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017233096999999999, 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78566 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.304 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585425+0000", 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585425+0000", 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585426+0000", 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.89e-07 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585427+0000", 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.843e-06 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585434+0000", 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2230000000000004e-06 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585439+0000", 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8339999999999998e-06 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78626 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586088+0000", 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0079042650000000006, 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016619388999999998, 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78626 2024-09-12T05:21:14.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586088+0000", 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586088+0000", 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586089+0000", 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4900000000000001e-07 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586091+0000", 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0540000000000002e-06 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586097+0000", 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0730000000000001e-06 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586102+0000", 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7770000000000002e-06 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78696 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586745+0000", 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0072481170000000001, 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016012539999999999, 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.312 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78696 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586745+0000", 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586745+0000", 2024-09-12T05:21:14.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586745+0000", 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7300000000000002e-07 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586747+0000", 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.759e-06 2024-09-12T05:21:14.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586752+0000", 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586756+0000", 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.907e-06 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.315 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78834 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587739+0000", 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.006253616, 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015067727, 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.316 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78834 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587739+0000", 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587739+0000", 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587740+0000", 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0999999999999998e-07 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587742+0000", 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4169999999999999e-06 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587749+0000", 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.058e-06 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587755+0000", 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:21:14.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78898 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.595450+0000", 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4294967295.9985428, 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074061580000000004, 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78898 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595450+0000", 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595450+0000", 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595451+0000", 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7599999999999997e-07 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595454+0000", 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.931e-06 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595461+0000", 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309999999999993e-06 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595467+0000", 2024-09-12T05:21:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7749999999999998e-06 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78509 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584388+0000", 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0096044890000000008, 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018518152, 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78509 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584388+0000", 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584388+0000", 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584389+0000", 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7100000000000002e-07 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584391+0000", 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5909999999999998e-06 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584399+0000", 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3849999999999996e-06 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584404+0000", 2024-09-12T05:21:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3800000000000002e-06 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78567 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585445+0000", 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0085481189999999999, 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017512709000000001, 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.328 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78567 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585445+0000", 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585445+0000", 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585445+0000", 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5900000000000003e-07 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585447+0000", 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9599999999999999e-06 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585453+0000", 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9819999999999996e-06 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585458+0000", 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7700000000000001e-06 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78629 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586109+0000", 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0078837100000000004, 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016900167000000001, 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.332 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78629 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586109+0000", 2024-09-12T05:21:14.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586109+0000", 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586109+0000", 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586116+0000", 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5889999999999999e-06 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586123+0000", 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4139999999999997e-06 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586129+0000", 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3159999999999996e-06 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78699 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586762+0000", 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0072311149999999998, 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016298624000000001, 2024-09-12T05:21:14.336 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78699 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586762+0000", 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586762+0000", 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586762+0000", 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.34e-07 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586764+0000", 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.995e-06 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586770+0000", 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7989999999999999e-06 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586774+0000", 2024-09-12T05:21:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3719999999999998e-06 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78837 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587771+0000", 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0062212769999999999, 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01533987, 2024-09-12T05:21:14.340 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78837 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587771+0000", 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587771+0000", 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587772+0000", 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5799999999999999e-07 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587775+0000", 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.661e-06 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587782+0000", 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5089999999999996e-06 2024-09-12T05:21:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587788+0000", 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3199999999999999e-06 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78901 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.344 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.595480+0000", 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4294967295.9985127, 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076827989999999997, 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78901 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.345 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595480+0000", 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595480+0000", 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595481+0000", 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0699999999999997e-07 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595483+0000", 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8890000000000002e-06 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595491+0000", 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9249999999999995e-06 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595497+0000", 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3569999999999997e-06 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.348 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78511 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584424+0000", 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0095689989999999999, 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018796351999999999, 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78511 2024-09-12T05:21:14.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584424+0000", 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584424+0000", 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584424+0000", 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6199999999999998e-07 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584426+0000", 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1730000000000002e-06 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584433+0000", 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1470000000000004e-06 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584438+0000", 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9930000000000003e-06 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78570 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585464+0000", 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0085291310000000006, 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017806282, 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.353 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78570 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585464+0000", 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585464+0000", 2024-09-12T05:21:14.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585464+0000", 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2899999999999999e-07 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585466+0000", 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8649999999999999e-06 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585472+0000", 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8669999999999999e-06 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585476+0000", 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6399999999999996e-06 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.356 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78630 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586136+0000", 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0078566829999999997, 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017185180000000001, 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.357 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78630 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586136+0000", 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586136+0000", 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586136+0000", 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586139+0000", 2024-09-12T05:21:14.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1720000000000001e-06 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586145+0000", 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4439999999999996e-06 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586151+0000", 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9139999999999996e-06 2024-09-12T05:21:14.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78700 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.586780+0000", 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0072124299999999997, 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016590275000000002, 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78700 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586780+0000", 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586780+0000", 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586781+0000", 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7899999999999999e-07 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586783+0000", 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.956e-06 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586788+0000", 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8629999999999996e-06 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.586792+0000", 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.036e-06 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78838 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.587804+0000", 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.0061890809999999999, 2024-09-12T05:21:14.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015617989000000001, 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78838 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587804+0000", 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587804+0000", 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587804+0000", 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1399999999999997e-07 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587806+0000", 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9439999999999999e-06 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587813+0000", 2024-09-12T05:21:14.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6050000000000003e-06 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.587818+0000", 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0819999999999998e-06 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.369 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78902 3.0 3.c4375a0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.595506+0000", 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4294967295.9984865, 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0079694870000000008, 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "queued for pg", 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78902 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.370 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595506+0000", 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595506+0000", 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595507+0000", 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2e-07 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595509+0000", 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9119999999999998e-06 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595516+0000", 2024-09-12T05:21:14.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8619999999999997e-06 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595521+0000", 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0499999999999999e-06 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 199 2024-09-12T05:21:14.373 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:14.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:14.375 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:13.839+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:14.376 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:21:14.376 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:14.376 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 68, 2024-09-12T05:21:14.376 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:21:13.267082+0000", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:21:02.127583+0000", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:20:32.916583+0000", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5806080, 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "nodeep-scrub", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "noscrub", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:21:14.377 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 5, 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:21:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "luminous", 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:21:14.379 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:14.380 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:14.381 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:14.382 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:14.383 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:14.384 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.385 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:14.386 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:14.387 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:21:14.388 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:14.389 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:14.391 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:14.392 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.9900000095367432, 2024-09-12T05:21:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.9900000095367432, 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:21:14.394 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:14.395 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:14.396 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "67", 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:14.397 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 25, 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 67, 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:14.398 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:14.400 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.9900000095367432, 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.9900000095367432, 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:14.401 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:14.402 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 0.80352783203125, 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.403 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:14.404 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.406 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:14.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:21:14.408 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:14.409 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.411 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:14.412 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:21:14.414 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:21:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.417 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.420 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:14.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:21:14.422 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:14.423 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 42, 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:21:14.424 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:14.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.428 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:14.429 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 0, 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:14.430 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 60, 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.432 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:14.434 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.435 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/2467380900", 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/2467380900", 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/2467380900", 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/2467380900", 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:14.436 INFO:teuthology.orchestra.run.smithi059.stdout: "exists" 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:14.437 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:21:14.439 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:21:14.442 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:14.443 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:14.444 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:14.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.447 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:14.448 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.449 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:14.451 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:21:14.452 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:14.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.454 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.456 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:14.457 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:21:14.458 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:14.459 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:14.460 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 60 2024-09-12T05:21:14.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:21:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [ 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.15", 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [], 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:21:14.465 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2024-09-12T05:21:14.466 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.467 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:14.469 INFO:tasks.thrashosds.thrasher:j is {'epoch': 68, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:21:13.267082+0000', 'last_up_change': '2024-09-12T05:21:02.127583+0000', 'last_in_change': '2024-09-12T05:20:32.916583+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 67, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.80352783203125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 60, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 2467380900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 2467380900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 2467380900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 2467380900}]}, 'public_addr': '172.21.15.194:6825/2467380900', 'cluster_addr': '172.21.15.194:6827/2467380900', 'heartbeat_back_addr': '172.21.15.194:6831/2467380900', 'heartbeat_front_addr': '172.21.15.194:6829/2467380900', 'state': ['exists']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 60}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.15', 'mappings': [{'from': 3, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:21:14.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:21:14.476 INFO:teuthology.orchestra.run.smithi059.stdout:2946 read 0x8388de4 thru 0x838de86 (0x50a3 bytes) 2024-09-12T05:21:14.476 INFO:teuthology.orchestra.run.smithi059.stdout:2947 read 0x71f73e4 thru 0x71f95d0 (0x21ed bytes) 2024-09-12T05:21:14.476 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.476 INFO:teuthology.orchestra.run.smithi059.stdout:2950 write 0x2bff3e8 thru 0x2c0a3a5 (0xafbe bytes) 2024-09-12T05:21:14.476 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.476 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2955 punch from 0xad2a57c to 0xad39268, (0xecec bytes) 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2956 write 0x933dc76 thru 0x934ccec (0xf077 bytes) 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2957 trunc from 0xc122d03 to 0x41cd55 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2961 write 0x4618443 thru 0x461d0e7 (0x4ca5 bytes) 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2962 punch from 0xa94727 to 0xa94ea5, (0x77e bytes) 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2963 write 0xc54e5c9 thru 0xc55a1bf (0xbbf7 bytes) 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2964 write 0x5de6ad3 thru 0x5deadb4 (0x42e2 bytes) 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2966 trunc from 0xc55a1c0 to 0x8e0b2e5 2024-09-12T05:21:14.477 INFO:teuthology.orchestra.run.smithi059.stdout:2967 read 0x649a580 thru 0x649aeca (0x94b bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2968 punch from 0x205763f to 0x205833a, (0xcfb bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2969 write 0xb69ead2 thru 0xb6a4f06 (0x6435 bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2971 writesame 0xc9ce21 thru 0xca2eb8 data_size 0x2c(0x6098 bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2972 read 0x7c6472f thru 0x7c6ed3d (0xa60f bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2973 read 0xb548ec3 thru 0xb551689 (0x87c7 bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2974 read 0x85d5069 thru 0x85de695 (0x962d bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2975 trunc from 0xb6a4f07 to 0x69e8a56 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2978 write 0x4b4313e thru 0x4b4cbeb (0x9aae bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2979 write 0x6629b65 thru 0x66375ff (0xda9b bytes) 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2980 trunc from 0x69e8a56 to 0xd7e7cdb 2024-09-12T05:21:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:2981 writesame 0x25d7e02 thru 0x25e3dc3 data_size 0x5(0xbfc2 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2983 read 0x33aca2 thru 0x346b87 (0xbee6 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2985 read 0xd5dc390 thru 0xd5e4a54 (0x86c5 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2986 write 0x68e0b70 thru 0x68e1d35 (0x11c6 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2987 write 0xdf3e8f2 thru 0xdf40f4a (0x2659 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2989 read 0x9b6ff95 thru 0x9b706b7 (0x723 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2990 write 0x7ec7e23 thru 0x7ececd8 (0x6eb6 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2991 write 0x95e02d1 thru 0x95e55a0 (0x52d0 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2995 write 0x7f48aea thru 0x7f4d567 (0x4a7e bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2996 writesame 0xa4d2341 thru 0xa4e2240 data_size 0xa0(0xff00 bytes) 2024-09-12T05:21:14.479 INFO:teuthology.orchestra.run.smithi059.stdout:2998 write 0xb91e0b3 thru 0xb91f758 (0x16a6 bytes) 2024-09-12T05:21:14.480 INFO:teuthology.orchestra.run.smithi059.stdout:3000 read 0x58e0751 thru 0x58e702b (0x68db bytes) 2024-09-12T05:21:14.480 INFO:teuthology.orchestra.run.smithi059.stdout:3003 flatten 2024-09-12T05:21:14.481 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:14.468+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:14.481 INFO:teuthology.orchestra.run.smithi059.stdout:3004 punch from 0x4dcb44a to 0x4dd4c55, (0x980b bytes) 2024-09-12T05:21:14.495 INFO:teuthology.orchestra.run.smithi059.stdout:3005 write 0xee3bc12 thru 0xee3cb7e (0xf6d bytes) 2024-09-12T05:21:14.498 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.498 INFO:teuthology.orchestra.run.smithi059.stdout:3007 read 0x92fcc62 thru 0x92fdbc1 (0xf60 bytes) 2024-09-12T05:21:14.499 INFO:teuthology.orchestra.run.smithi059.stdout:3008 punch from 0x5a6cb76 to 0x5a7b74e, (0xebd8 bytes) 2024-09-12T05:21:14.524 INFO:teuthology.orchestra.run.smithi059.stdout:3009 trunc from 0xee3cb7f to 0x1b600b 2024-09-12T05:21:14.571 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:14.567+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:14.576 INFO:teuthology.orchestra.run.smithi059.stdout:3010 read 0xdf5b2 thru 0xeaf36 (0xb985 bytes) 2024-09-12T05:21:14.578 INFO:teuthology.orchestra.run.smithi059.stdout:3013 read 0x19f20 thru 0x2427e (0xa35f bytes) 2024-09-12T05:21:14.578 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.593 INFO:teuthology.orchestra.run.smithi059.stdout:3016 write 0x7a1549 thru 0x7aec61 (0xd719 bytes) 2024-09-12T05:21:14.602 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:14.602 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:14.602 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:14.603 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:14.603 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:14.618 INFO:teuthology.orchestra.run.smithi059.stdout:3017 write 0x4ed110f thru 0x4ed8f80 (0x7e72 bytes) 2024-09-12T05:21:14.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:14.624 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.624 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.624 INFO:teuthology.orchestra.run.smithi059.stdout:3022 punch from 0x43ab686 to 0x43b1d1a, (0x6694 bytes) 2024-09-12T05:21:14.624 INFO:teuthology.orchestra.run.smithi059.stdout:3024 read 0x3512d96 thru 0x3516b08 (0x3d73 bytes) 2024-09-12T05:21:14.624 INFO:teuthology.orchestra.run.smithi059.stdout:3025 read 0x25bec07 thru 0x25ca58c (0xb986 bytes) 2024-09-12T05:21:14.644 INFO:teuthology.orchestra.run.smithi059.stdout:3026 write 0xc5d259f thru 0xc5d4fd8 (0x2a3a bytes) 2024-09-12T05:21:14.651 INFO:teuthology.orchestra.run.smithi059.stdout:3027 write 0x1a90f34 thru 0x1a9228d (0x135a bytes) 2024-09-12T05:21:14.655 INFO:teuthology.orchestra.run.smithi059.stdout:3030 write 0xbf0f7cc thru 0xbf172c1 (0x7af6 bytes) 2024-09-12T05:21:14.662 INFO:teuthology.orchestra.run.smithi059.stdout:3031 write 0x5c7905b thru 0x5c7cfaf (0x3f55 bytes) 2024-09-12T05:21:14.664 INFO:teuthology.orchestra.run.smithi059.stdout:3033 read 0x8fc6732 thru 0x8fcb452 (0x4d21 bytes) 2024-09-12T05:21:14.665 INFO:teuthology.orchestra.run.smithi059.stdout:3034 read 0x73ac257 thru 0x73b1b57 (0x5901 bytes) 2024-09-12T05:21:14.665 INFO:teuthology.orchestra.run.smithi059.stdout:3035 read 0x9baa0a3 thru 0x9baad9d (0xcfb bytes) 2024-09-12T05:21:14.666 INFO:teuthology.orchestra.run.smithi059.stdout:3038 write 0xd59cc9 thru 0xd5ce40 (0x3178 bytes) 2024-09-12T05:21:14.668 INFO:teuthology.orchestra.run.smithi059.stdout:3039 writesame 0x9c40594 thru 0x9c41334 data_size 0x1(0xda1 bytes) 2024-09-12T05:21:14.670 INFO:teuthology.orchestra.run.smithi059.stdout:3040 writesame 0x28ada84 thru 0x28bd8f9 data_size 0x1(0xfe76 bytes) 2024-09-12T05:21:14.671 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:14.667+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:14.702 INFO:teuthology.orchestra.run.smithi059.stdout:3041 read 0x3f2550f thru 0x3f31c79 (0xc76b bytes) 2024-09-12T05:21:14.702 INFO:teuthology.orchestra.run.smithi059.stdout:3042 write 0x7c0278b thru 0x7c04c6a (0x24e0 bytes) 2024-09-12T05:21:14.708 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.708 INFO:teuthology.orchestra.run.smithi059.stdout:3047 write 0x82f220b thru 0x82f93ce (0x71c4 bytes) 2024-09-12T05:21:14.710 INFO:teuthology.orchestra.run.smithi059.stdout:3050 punch from 0x1794d06 to 0x17a0b3e, (0xbe38 bytes) 2024-09-12T05:21:14.710 INFO:teuthology.orchestra.run.smithi059.stdout:3051 write 0x316f71b thru 0x3170c90 (0x1576 bytes) 2024-09-12T05:21:14.713 INFO:teuthology.orchestra.run.smithi059.stdout:3052 write 0x89df886 thru 0x89e2324 (0x2a9f bytes) 2024-09-12T05:21:14.715 INFO:teuthology.orchestra.run.smithi059.stdout:3054 read 0x6c88beb thru 0x6c8f232 (0x6648 bytes) 2024-09-12T05:21:14.729 INFO:teuthology.orchestra.run.smithi059.stdout:3055 write 0xe8d298c thru 0xe8e15e5 (0xec5a bytes) 2024-09-12T05:21:14.732 INFO:teuthology.orchestra.run.smithi059.stdout:3056 writesame 0xcfff6ee thru 0xd009271 data_size 0x4a(0x9b84 bytes) 2024-09-12T05:21:14.738 INFO:teuthology.orchestra.run.smithi059.stdout:3057 write 0x68da797 thru 0x68dcc37 (0x24a1 bytes) 2024-09-12T05:21:14.744 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:14.744 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.326007282, 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.745 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:14.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.749 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.3145590730000001, 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:21:14.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:21:14.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2269441679999999, 2024-09-12T05:21:14.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:21:14.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:21:14.759 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.226901064, 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.760 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:14.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2268738159999999, 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.764 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:14.768 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.226847536, 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:14.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:21:14.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:21:14.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:21:14.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:21:14.773 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.773 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.773 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.773 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.773 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:14.774 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2268249250000001, 2024-09-12T05:21:14.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:21:14.774 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.775 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:21:14.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.775 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:14.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:14.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:21:14.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:21:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2267970960000001, 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.780 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:14.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:14.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:14.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:14.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:21:14.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:21:14.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:21:14.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:21:14.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:21:14.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:21:14.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:21:14.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:21:14.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:21:14.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:21:14.788 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.788 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.788 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.789 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.789 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:14.789 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2267746770000001, 2024-09-12T05:21:14.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:21:14.789 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.790 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.790 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.790 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.790 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.790 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:21:14.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.791 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:14.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:14.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:21:14.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:14.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:21:14.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:21:14.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:21:14.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:21:14.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:21:14.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:14.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:21:14.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:21:14.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:21:14.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:21:14.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.798 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.799 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.799 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:14.799 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.226753545, 2024-09-12T05:21:14.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:21:14.800 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.800 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:21:14.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.801 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:14.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:14.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2266649110000001, 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:21:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:21:14.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:21:14.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2266339770000001, 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.811 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:21:14.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:14.815 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2266078149999999, 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:14.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:21:14.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:21:14.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:21:14.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:21:14.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:21:14.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:21:14.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:21:14.821 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.821 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.821 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.226585641, 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.822 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.823 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:21:14.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.823 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:14.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:14.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:21:14.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:21:14.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:21:14.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:21:14.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:21:14.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:21:14.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:21:14.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:21:14.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:21:14.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:21:14.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.829 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:14.830 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2265645270000001, 2024-09-12T05:21:14.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:21:14.830 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.830 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.831 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:21:14.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.831 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:14.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:21:14.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:21:14.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:21:14.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:21:14.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:21:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2265428899999999, 2024-09-12T05:21:14.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78378 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.839 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2264344540000001, 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059385249000000001, 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78378 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519236+0000", 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3900000000000004e-07 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519240+0000", 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3759999999999999e-06 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519249+0000", 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519256+0000", 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578613+0000", 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059356679000000002 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578621+0000", 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5020000000000003e-06 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78379 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519267+0000", 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2264024520000001, 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059383665000000002, 2024-09-12T05:21:14.844 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78379 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519267+0000", 2024-09-12T05:21:14.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519267+0000", 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519268+0000", 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519271+0000", 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8990000000000001e-06 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519278+0000", 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2099999999999996e-06 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519284+0000", 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8819999999999998e-06 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578644+0000", 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059359749000000003 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578651+0000", 2024-09-12T05:21:14.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.396e-06 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2263779750000001, 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.849 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:14.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.853 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2263502589999999, 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:14.854 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:21:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:14.858 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:14.859 INFO:teuthology.orchestra.run.smithi059.stdout:3058 punch from 0x7e93fa0 to 0x7e94f72, (0xfd2 bytes) 2024-09-12T05:21:14.859 INFO:teuthology.orchestra.run.smithi059.stdout:3059 trunc from 0xe8e15e6 to 0x7822f74 2024-09-12T05:21:14.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:14.863 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.863 INFO:teuthology.orchestra.run.smithi059.stdout:3062 write 0x680905f thru 0x6815f18 (0xceba bytes) 2024-09-12T05:21:14.863 INFO:teuthology.orchestra.run.smithi059.stdout:3063 read 0x4caf695 thru 0x4cb824e (0x8bba bytes) 2024-09-12T05:21:14.863 INFO:teuthology.orchestra.run.smithi059.stdout:3064 read 0xdd2829 thru 0xdd5d9f (0x3577 bytes) 2024-09-12T05:21:14.863 INFO:teuthology.orchestra.run.smithi059.stdout:3065 write 0x22e1665 thru 0x22e652e (0x4eca bytes) 2024-09-12T05:21:14.863 INFO:teuthology.orchestra.run.smithi059.stdout:3066 read 0x4f8912b thru 0x4f990a5 (0xff7b bytes) 2024-09-12T05:21:14.863 INFO:teuthology.orchestra.run.smithi059.stdout:3069 write 0x14b3df0 thru 0x14ba124 (0x6335 bytes) 2024-09-12T05:21:14.864 INFO:teuthology.orchestra.run.smithi059.stdout:3070 punch from 0x35a7740 to 0x35a99ea, (0x22aa bytes) 2024-09-12T05:21:14.864 INFO:teuthology.orchestra.run.smithi059.stdout:3071 read 0x5336f1f thru 0x5341a3b (0xab1d bytes) 2024-09-12T05:21:14.864 INFO:teuthology.orchestra.run.smithi059.stdout:3072 write 0x3a589a thru 0x3a5c72 (0x3d9 bytes) 2024-09-12T05:21:14.864 INFO:teuthology.orchestra.run.smithi059.stdout:3074 write 0x8456008 thru 0x84647d6 (0xe7cf bytes) 2024-09-12T05:21:14.864 INFO:teuthology.orchestra.run.smithi059.stdout:3077 write 0x237ba44 thru 0x238468f (0x8c4c bytes) 2024-09-12T05:21:14.864 INFO:teuthology.orchestra.run.smithi059.stdout:3078 read 0x6ed0037 thru 0x6ed7429 (0x73f3 bytes) 2024-09-12T05:21:14.864 INFO:teuthology.orchestra.run.smithi059.stdout:3080 read 0x6dc27a7 thru 0x6dc883f (0x6099 bytes) 2024-09-12T05:21:14.864 INFO:teuthology.orchestra.run.smithi059.stdout:3081 write 0x41132aa thru 0x4118531 (0x5288 bytes) 2024-09-12T05:21:14.865 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:21:14.866 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:21:14.866 INFO:teuthology.orchestra.run.smithi059.stdout:3082 trunc from 0x84647d7 to 0xc5288ca 2024-09-12T05:21:14.867 INFO:teuthology.orchestra.run.smithi059.stdout:3084 writesame 0x73a6ad1 thru 0x73a8129 data_size 0x1(0x1659 bytes) 2024-09-12T05:21:14.867 INFO:teuthology.orchestra.run.smithi059.stdout:3085 write 0x71fb84 thru 0x72f393 (0xf810 bytes) 2024-09-12T05:21:14.867 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-12T05:21:13.279685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":778717870,"num_objects":1849,"num_object_clones":302,"num_object_copies":3698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":778,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1849,"num_whiteouts":1137,"num_read":92006,"num_read_kb":389846,"num_write":14144,"num_write_kb":228294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":11986431,"num_keys_recovered":17,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11876,"ondisk_log_size":11876,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":653824,"kb_used_data":314152,"kb_used_omap":12,"kb_used_meta":339507,"kb_avail":754320896,"statfs":{"total":773094113280,"available":772424597504,"internally_reserved":0,"allocated":321691648,"data_stored":387473213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":347655728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":138871902,"num_objects":348,"num_object_clones":27,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":348,"num_whiteouts":279,"num_read":11101,"num_read_kb":52582,"num_write":765,"num_write_kb":50042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.101667"},"pg_stats":[{"pgid":"3.1f","version":"66'286","reported_seq":5213,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:12.069836+0000","last_change":"2024-09-12T05:20:11.762958+0000","last_active":"2024-09-12T05:21:12.069836+0000","last_peered":"2024-09-12T05:21:12.069836+0000","last_clean":"2024-09-12T05:21:12.069836+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:21:12.069836+0000","last_undegraded":"2024-09-12T05:21:12.069836+0000","last_fullsized":"2024-09-12T05:21:12.069836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:50.520225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036800549999999998,"stat_sum":{"num_bytes":22786068,"num_objects":72,"num_object_clones":15,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":41,"num_read":5255,"num_read_kb":22411,"num_write":286,"num_write_kb":7380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"66'225","reported_seq":4081,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.831747+0000","last_change":"2024-09-12T05:20:34.070752+0000","last_active":"2024-09-12T05:21:11.831747+0000","last_peered":"2024-09-12T05:21:11.831747+0000","last_clean":"2024-09-12T05:21:11.831747+0000","last_became_active":"2024-09-12T05:20:33.940420+0000","last_became_peered":"2024-09-12T05:20:33.940420+0000","last_unstale":"2024-09-12T05:21:11.831747+0000","last_undegraded":"2024-09-12T05:21:11.831747+0000","last_fullsized":"2024-09-12T05:21:11.831747+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:12:53.338970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015371499999999999,"stat_sum":{"num_bytes":49883194,"num_objects":56,"num_object_clones":12,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":34,"num_read":3776,"num_read_kb":33154,"num_write":242,"num_write_kb":7362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"66'369","reported_seq":2448,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.840055+0000","last_change":"2024-09-12T05:21:03.152999+0000","last_active":"2024-09-12T05:21:11.840055+0000","last_peered":"2024-09-12T05:21:11.840055+0000","last_clean":"2024-09-12T05:21:01.134623+0000","last_became_active":"2024-09-12T05:21:03.152999+0000","last_became_peered":"2024-09-12T05:21:03.152999+0000","last_unstale":"2024-09-12T05:21:11.840055+0000","last_undegraded":"2024-09-12T05:21:03.151855+0000","last_fullsized":"2024-09-12T05:21:03.151583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:30.106963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098006399999999989,"stat_sum":{"num_bytes":4243178,"num_objects":57,"num_object_clones":10,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":57,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":33,"num_read":3083,"num_read_kb":3561,"num_write":401,"num_write_kb":2186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":57}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"66'301","reported_seq":1958,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.869744+0000","last_change":"2024-09-12T05:21:03.156068+0000","last_active":"2024-09-12T05:21:11.869744+0000","last_peered":"2024-09-12T05:21:11.869744+0000","last_clean":"2024-09-12T05:21:01.134412+0000","last_became_active":"2024-09-12T05:21:03.156068+0000","last_became_peered":"2024-09-12T05:21:03.156068+0000","last_unstale":"2024-09-12T05:21:11.869744+0000","last_undegraded":"2024-09-12T05:21:03.151787+0000","last_fullsized":"2024-09-12T05:21:03.151493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:57.997178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087905899999999996,"stat_sum":{"num_bytes":12898206,"num_objects":61,"num_object_clones":11,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":61,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":40,"num_read":1910,"num_read_kb":9205,"num_write":321,"num_write_kb":3965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":61}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"66'234","reported_seq":1506,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.449855+0000","last_change":"2024-09-12T05:21:03.160720+0000","last_active":"2024-09-12T05:21:11.449855+0000","last_peered":"2024-09-12T05:21:11.449855+0000","last_clean":"2024-09-12T05:21:01.133569+0000","last_became_active":"2024-09-12T05:21:03.160720+0000","last_became_peered":"2024-09-12T05:21:03.160720+0000","last_unstale":"2024-09-12T05:21:11.449855+0000","last_undegraded":"2024-09-12T05:21:03.156540+0000","last_fullsized":"2024-09-12T05:21:03.156423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:12.256710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040909680000000004,"stat_sum":{"num_bytes":14800888,"num_objects":60,"num_object_clones":9,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":60,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":43,"num_read":1234,"num_read_kb":5689,"num_write":191,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":60}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"66'294","reported_seq":2560,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.852378+0000","last_change":"2024-09-12T05:21:03.156899+0000","last_active":"2024-09-12T05:21:11.852378+0000","last_peered":"2024-09-12T05:21:11.852378+0000","last_clean":"2024-09-12T05:20:53.806542+0000","last_became_active":"2024-09-12T05:21:03.156899+0000","last_became_peered":"2024-09-12T05:21:03.156899+0000","last_unstale":"2024-09-12T05:21:11.852378+0000","last_undegraded":"2024-09-12T05:21:03.155951+0000","last_fullsized":"2024-09-12T05:21:03.155860+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:49.654455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014130220000000001,"stat_sum":{"num_bytes":22070885,"num_objects":56,"num_object_clones":9,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":56,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":36,"num_read":3279,"num_read_kb":6252,"num_write":265,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":56}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"66'275","reported_seq":1537,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.635840+0000","last_change":"2024-09-12T05:20:11.741831+0000","last_active":"2024-09-12T05:21:11.635840+0000","last_peered":"2024-09-12T05:21:11.635840+0000","last_clean":"2024-09-12T05:21:11.635840+0000","last_became_active":"2024-09-12T05:20:09.736422+0000","last_became_peered":"2024-09-12T05:20:09.736422+0000","last_unstale":"2024-09-12T05:21:11.635840+0000","last_undegraded":"2024-09-12T05:21:11.635840+0000","last_fullsized":"2024-09-12T05:21:11.635840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:10.890741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001296167,"stat_sum":{"num_bytes":11472634,"num_objects":55,"num_object_clones":5,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":35,"num_read":1541,"num_read_kb":6725,"num_write":255,"num_write_kb":3957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"66'298","reported_seq":1617,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.639432+0000","last_change":"2024-09-12T05:20:11.786941+0000","last_active":"2024-09-12T05:21:11.639432+0000","last_peered":"2024-09-12T05:21:11.639432+0000","last_clean":"2024-09-12T05:21:11.639432+0000","last_became_active":"2024-09-12T05:20:09.740953+0000","last_became_peered":"2024-09-12T05:20:09.740953+0000","last_unstale":"2024-09-12T05:21:11.639432+0000","last_undegraded":"2024-09-12T05:21:11.639432+0000","last_fullsized":"2024-09-12T05:21:11.639432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:13.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085336099999999996,"stat_sum":{"num_bytes":13978416,"num_objects":57,"num_object_clones":11,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":36,"num_read":2144,"num_read_kb":12823,"num_write":268,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"66'295","reported_seq":1261,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.510513+0000","last_change":"2024-09-12T05:20:11.763561+0000","last_active":"2024-09-12T05:21:10.510513+0000","last_peered":"2024-09-12T05:21:10.510513+0000","last_clean":"2024-09-12T05:21:10.510513+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:21:10.510513+0000","last_undegraded":"2024-09-12T05:21:10.510513+0000","last_fullsized":"2024-09-12T05:21:10.510513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:09.006285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041487850000000003,"stat_sum":{"num_bytes":22807552,"num_objects":51,"num_object_clones":9,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":34,"num_read":1681,"num_read_kb":6049,"num_write":281,"num_write_kb":3564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"66'218","reported_seq":1301,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.869277+0000","last_change":"2024-09-12T05:20:11.737024+0000","last_active":"2024-09-12T05:21:11.869277+0000","last_peered":"2024-09-12T05:21:11.869277+0000","last_clean":"2024-09-12T05:21:11.869277+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:21:11.869277+0000","last_undegraded":"2024-09-12T05:21:11.869277+0000","last_fullsized":"2024-09-12T05:21:11.869277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:11.487367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015614439999999999,"stat_sum":{"num_bytes":31072685,"num_objects":58,"num_object_clones":10,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":38,"num_read":1035,"num_read_kb":5142,"num_write":184,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"66'213","reported_seq":1123,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.831326+0000","last_change":"2024-09-12T05:20:49.043311+0000","last_active":"2024-09-12T05:21:11.831326+0000","last_peered":"2024-09-12T05:21:11.831326+0000","last_clean":"2024-09-12T05:21:11.831326+0000","last_became_active":"2024-09-12T05:20:49.041294+0000","last_became_peered":"2024-09-12T05:20:49.041294+0000","last_unstale":"2024-09-12T05:21:11.831326+0000","last_undegraded":"2024-09-12T05:21:11.831326+0000","last_fullsized":"2024-09-12T05:21:11.831326+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:43.002651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000920377,"stat_sum":{"num_bytes":15960261,"num_objects":55,"num_object_clones":12,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":29,"num_read":751,"num_read_kb":11334,"num_write":273,"num_write_kb":7455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"66'1029","reported_seq":3998,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.830587+0000","last_change":"2024-09-12T05:21:03.163718+0000","last_active":"2024-09-12T05:21:11.830587+0000","last_peered":"2024-09-12T05:21:11.830587+0000","last_clean":"2024-09-12T05:20:58.183844+0000","last_became_active":"2024-09-12T05:21:03.163718+0000","last_became_peered":"2024-09-12T05:21:03.163718+0000","last_unstale":"2024-09-12T05:21:11.830587+0000","last_undegraded":"2024-09-12T05:21:03.161795+0000","last_fullsized":"2024-09-12T05:21:03.161569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:33:24.025275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013351109999999999,"stat_sum":{"num_bytes":35153132,"num_objects":64,"num_object_clones":6,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":64,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":36,"num_read":7645,"num_read_kb":13029,"num_write":1601,"num_write_kb":22733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":64}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.197216+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:21:10.197216+0000","last_peered":"2024-09-12T05:21:10.197216+0000","last_clean":"2024-09-12T05:21:10.197216+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:21:10.197216+0000","last_undegraded":"2024-09-12T05:21:10.197216+0000","last_fullsized":"2024-09-12T05:21:10.197216+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"66'512","reported_seq":1291,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:12.004302+0000","last_change":"2024-09-12T05:20:11.760826+0000","last_active":"2024-09-12T05:21:12.004302+0000","last_peered":"2024-09-12T05:21:12.004302+0000","last_clean":"2024-09-12T05:21:12.004302+0000","last_became_active":"2024-09-12T05:20:09.741300+0000","last_became_peered":"2024-09-12T05:20:09.741300+0000","last_unstale":"2024-09-12T05:21:12.004302+0000","last_undegraded":"2024-09-12T05:21:12.004302+0000","last_fullsized":"2024-09-12T05:21:12.004302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:02.301456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015825539999999999,"stat_sum":{"num_bytes":4209994,"num_objects":66,"num_object_clones":8,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":46,"num_read":1774,"num_read_kb":3626,"num_write":641,"num_write_kb":2328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.203794+0000","last_change":"2024-09-12T05:20:33.943660+0000","last_active":"2024-09-12T05:21:10.203794+0000","last_peered":"2024-09-12T05:21:10.203794+0000","last_clean":"2024-09-12T05:21:10.203794+0000","last_became_active":"2024-09-12T05:20:33.943030+0000","last_became_peered":"2024-09-12T05:20:33.943030+0000","last_unstale":"2024-09-12T05:21:10.203794+0000","last_undegraded":"2024-09-12T05:21:10.203794+0000","last_fullsized":"2024-09-12T05:21:10.203794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:11.076201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'249","reported_seq":2070,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.451702+0000","last_change":"2024-09-12T05:20:11.787746+0000","last_active":"2024-09-12T05:21:11.451702+0000","last_peered":"2024-09-12T05:21:11.451702+0000","last_clean":"2024-09-12T05:21:11.451702+0000","last_became_active":"2024-09-12T05:20:09.747558+0000","last_became_peered":"2024-09-12T05:20:09.747558+0000","last_unstale":"2024-09-12T05:21:11.451702+0000","last_undegraded":"2024-09-12T05:21:11.451702+0000","last_fullsized":"2024-09-12T05:21:11.451702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:49.015521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001514325,"stat_sum":{"num_bytes":29822107,"num_objects":46,"num_object_clones":7,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":27,"num_read":1796,"num_read_kb":40596,"num_write":256,"num_write_kb":20381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.208188+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:21:10.208188+0000","last_peered":"2024-09-12T05:21:10.208188+0000","last_clean":"2024-09-12T05:21:10.208188+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:21:10.208188+0000","last_undegraded":"2024-09-12T05:21:10.208188+0000","last_fullsized":"2024-09-12T05:21:10.208188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"66'327","reported_seq":1439,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.521185+0000","last_change":"2024-09-12T05:20:11.742399+0000","last_active":"2024-09-12T05:21:10.521185+0000","last_peered":"2024-09-12T05:21:10.521185+0000","last_clean":"2024-09-12T05:21:10.521185+0000","last_became_active":"2024-09-12T05:20:09.731594+0000","last_became_peered":"2024-09-12T05:20:09.731594+0000","last_unstale":"2024-09-12T05:21:10.521185+0000","last_undegraded":"2024-09-12T05:21:10.521185+0000","last_fullsized":"2024-09-12T05:21:10.521185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:10.184108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109662,"stat_sum":{"num_bytes":23928913,"num_objects":55,"num_object_clones":8,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":34,"num_read":1998,"num_read_kb":7551,"num_write":333,"num_write_kb":1945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.203566+0000","last_change":"2024-09-12T05:20:01.939452+0000","last_active":"2024-09-12T05:21:10.203566+0000","last_peered":"2024-09-12T05:21:10.203566+0000","last_clean":"2024-09-12T05:21:10.203566+0000","last_became_active":"2024-09-12T05:19:59.911858+0000","last_became_peered":"2024-09-12T05:19:59.911858+0000","last_unstale":"2024-09-12T05:21:10.203566+0000","last_undegraded":"2024-09-12T05:21:10.203566+0000","last_fullsized":"2024-09-12T05:21:10.203566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:52.544225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"66'192","reported_seq":1628,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.469799+0000","last_change":"2024-09-12T05:20:11.737386+0000","last_active":"2024-09-12T05:21:10.469799+0000","last_peered":"2024-09-12T05:21:10.469799+0000","last_clean":"2024-09-12T05:21:10.469799+0000","last_became_active":"2024-09-12T05:20:09.734285+0000","last_became_peered":"2024-09-12T05:20:09.734285+0000","last_unstale":"2024-09-12T05:21:10.469799+0000","last_undegraded":"2024-09-12T05:21:10.469799+0000","last_fullsized":"2024-09-12T05:21:10.469799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:45.442547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093432200000000002,"stat_sum":{"num_bytes":17270794,"num_objects":38,"num_object_clones":4,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":25,"num_read":1493,"num_read_kb":9924,"num_write":209,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"66'359","reported_seq":3401,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.450158+0000","last_change":"2024-09-12T05:21:03.157170+0000","last_active":"2024-09-12T05:21:11.450158+0000","last_peered":"2024-09-12T05:21:11.450158+0000","last_clean":"2024-09-12T05:21:00.585064+0000","last_became_active":"2024-09-12T05:21:03.157170+0000","last_became_peered":"2024-09-12T05:21:03.157170+0000","last_unstale":"2024-09-12T05:21:11.450158+0000","last_undegraded":"2024-09-12T05:21:03.156358+0000","last_fullsized":"2024-09-12T05:21:03.156283+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:35.268400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011274589999999999,"stat_sum":{"num_bytes":11955144,"num_objects":72,"num_object_clones":11,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":72,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":46,"num_read":3778,"num_read_kb":9279,"num_write":318,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":72}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":110,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.190969+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:21:10.190969+0000","last_peered":"2024-09-12T05:21:10.190969+0000","last_clean":"2024-09-12T05:21:10.190969+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:21:10.190969+0000","last_undegraded":"2024-09-12T05:21:10.190969+0000","last_fullsized":"2024-09-12T05:21:10.190969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"66'637","reported_seq":4202,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:12.061849+0000","last_change":"2024-09-12T05:20:11.741593+0000","last_active":"2024-09-12T05:21:12.061849+0000","last_peered":"2024-09-12T05:21:12.061849+0000","last_clean":"2024-09-12T05:21:12.061849+0000","last_became_active":"2024-09-12T05:20:09.732988+0000","last_became_peered":"2024-09-12T05:20:09.732988+0000","last_unstale":"2024-09-12T05:21:12.061849+0000","last_undegraded":"2024-09-12T05:21:12.061849+0000","last_fullsized":"2024-09-12T05:21:12.061849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:04.565280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011707810000000001,"stat_sum":{"num_bytes":47121369,"num_objects":61,"num_object_clones":11,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":35,"num_read":5821,"num_read_kb":18273,"num_write":955,"num_write_kb":4322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.191510+0000","last_change":"2024-09-12T05:20:01.936885+0000","last_active":"2024-09-12T05:21:10.191510+0000","last_peered":"2024-09-12T05:21:10.191510+0000","last_clean":"2024-09-12T05:21:10.191510+0000","last_became_active":"2024-09-12T05:20:00.049870+0000","last_became_peered":"2024-09-12T05:20:00.049870+0000","last_unstale":"2024-09-12T05:21:10.191510+0000","last_undegraded":"2024-09-12T05:21:10.191510+0000","last_fullsized":"2024-09-12T05:21:10.191510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011022810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"66'359","reported_seq":1327,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:10.691628+0000","last_change":"2024-09-12T05:21:03.157382+0000","last_active":"2024-09-12T05:21:10.691628+0000","last_peered":"2024-09-12T05:21:10.691628+0000","last_clean":"2024-09-12T05:21:01.133301+0000","last_became_active":"2024-09-12T05:21:03.157382+0000","last_became_peered":"2024-09-12T05:21:03.157382+0000","last_unstale":"2024-09-12T05:21:10.691628+0000","last_undegraded":"2024-09-12T05:21:03.156161+0000","last_fullsized":"2024-09-12T05:21:03.155969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:09.764589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002046291,"stat_sum":{"num_bytes":26102269,"num_objects":53,"num_object_clones":7,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":53,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":37,"num_read":1704,"num_read_kb":6965,"num_write":431,"num_write_kb":2573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":53}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":105,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.207261+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:21:10.207261+0000","last_peered":"2024-09-12T05:21:10.207261+0000","last_clean":"2024-09-12T05:21:10.207261+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:21:10.207261+0000","last_undegraded":"2024-09-12T05:21:10.207261+0000","last_fullsized":"2024-09-12T05:21:10.207261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"66'228","reported_seq":2598,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.515959+0000","last_change":"2024-09-12T05:20:11.787268+0000","last_active":"2024-09-12T05:21:10.515959+0000","last_peered":"2024-09-12T05:21:10.515959+0000","last_clean":"2024-09-12T05:21:10.515959+0000","last_became_active":"2024-09-12T05:20:09.747825+0000","last_became_peered":"2024-09-12T05:20:09.747825+0000","last_unstale":"2024-09-12T05:21:10.515959+0000","last_undegraded":"2024-09-12T05:21:10.515959+0000","last_fullsized":"2024-09-12T05:21:10.515959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:35.972890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010361979999999999,"stat_sum":{"num_bytes":82697974,"num_objects":58,"num_object_clones":8,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":35,"num_read":2330,"num_read_kb":30975,"num_write":237,"num_write_kb":30465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":109,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.191008+0000","last_change":"2024-09-12T05:20:01.936472+0000","last_active":"2024-09-12T05:21:10.191008+0000","last_peered":"2024-09-12T05:21:10.191008+0000","last_clean":"2024-09-12T05:21:10.191008+0000","last_became_active":"2024-09-12T05:19:59.915991+0000","last_became_peered":"2024-09-12T05:19:59.915991+0000","last_unstale":"2024-09-12T05:21:10.191008+0000","last_undegraded":"2024-09-12T05:21:10.191008+0000","last_fullsized":"2024-09-12T05:21:10.191008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:23.065491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":197,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.207297+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:21:10.207297+0000","last_peered":"2024-09-12T05:21:10.207297+0000","last_clean":"2024-09-12T05:21:10.207297+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:21:10.207297+0000","last_undegraded":"2024-09-12T05:21:10.207297+0000","last_fullsized":"2024-09-12T05:21:10.207297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"66'417","reported_seq":3683,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:10.521368+0000","last_change":"2024-09-12T05:20:11.786966+0000","last_active":"2024-09-12T05:21:10.521368+0000","last_peered":"2024-09-12T05:21:10.521368+0000","last_clean":"2024-09-12T05:21:10.521368+0000","last_became_active":"2024-09-12T05:20:09.735109+0000","last_became_peered":"2024-09-12T05:20:09.735109+0000","last_unstale":"2024-09-12T05:21:10.521368+0000","last_undegraded":"2024-09-12T05:21:10.521368+0000","last_fullsized":"2024-09-12T05:21:10.521368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:37.860930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088249400000000005,"stat_sum":{"num_bytes":10377961,"num_objects":66,"num_object_clones":12,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":39,"num_read":5071,"num_read_kb":12515,"num_write":417,"num_write_kb":8039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"66'288","reported_seq":1674,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.914435+0000","last_change":"2024-09-12T05:21:03.151961+0000","last_active":"2024-09-12T05:21:11.914435+0000","last_peered":"2024-09-12T05:21:11.914435+0000","last_clean":"2024-09-12T05:20:58.131356+0000","last_became_active":"2024-09-12T05:21:03.151961+0000","last_became_peered":"2024-09-12T05:21:03.151961+0000","last_unstale":"2024-09-12T05:21:11.914435+0000","last_undegraded":"2024-09-12T05:21:03.151298+0000","last_fullsized":"2024-09-12T05:21:03.151186+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:15.944337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083728800000000005,"stat_sum":{"num_bytes":18435114,"num_objects":70,"num_object_clones":11,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":70,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":46,"num_read":1847,"num_read_kb":2122,"num_write":259,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":70}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"66'283","reported_seq":1534,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:10.655925+0000","last_change":"2024-09-12T05:21:03.161538+0000","last_active":"2024-09-12T05:21:10.655925+0000","last_peered":"2024-09-12T05:21:10.655925+0000","last_clean":"2024-09-12T05:21:02.486182+0000","last_became_active":"2024-09-12T05:21:03.161538+0000","last_became_peered":"2024-09-12T05:21:03.161538+0000","last_unstale":"2024-09-12T05:21:10.655925+0000","last_undegraded":"2024-09-12T05:21:03.158960+0000","last_fullsized":"2024-09-12T05:21:03.158767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:11.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001140198,"stat_sum":{"num_bytes":21465904,"num_objects":55,"num_object_clones":11,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":55,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":33,"num_read":2173,"num_read_kb":5860,"num_write":245,"num_write_kb":2915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1146302,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":55}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"66'286","reported_seq":4032,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.841431+0000","last_change":"2024-09-12T05:20:11.787356+0000","last_active":"2024-09-12T05:21:11.841431+0000","last_peered":"2024-09-12T05:21:11.841431+0000","last_clean":"2024-09-12T05:21:11.841431+0000","last_became_active":"2024-09-12T05:20:09.741117+0000","last_became_peered":"2024-09-12T05:20:09.741117+0000","last_unstale":"2024-09-12T05:21:11.841431+0000","last_undegraded":"2024-09-12T05:21:11.841431+0000","last_fullsized":"2024-09-12T05:21:11.841431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.386037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011192330000000001,"stat_sum":{"num_bytes":13937240,"num_objects":60,"num_object_clones":9,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":35,"num_read":4342,"num_read_kb":11540,"num_write":253,"num_write_kb":5629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"66'1643","reported_seq":2615,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.634768+0000","last_change":"2024-09-12T05:20:11.736226+0000","last_active":"2024-09-12T05:21:11.634768+0000","last_peered":"2024-09-12T05:21:11.634768+0000","last_clean":"2024-09-12T05:21:11.634768+0000","last_became_active":"2024-09-12T05:20:09.734742+0000","last_became_peered":"2024-09-12T05:20:09.734742+0000","last_unstale":"2024-09-12T05:21:11.634768+0000","last_undegraded":"2024-09-12T05:21:11.634768+0000","last_fullsized":"2024-09-12T05:21:11.634768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1643,"log_dups_size":0,"ondisk_log_size":1643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:47.836745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085690600000000005,"stat_sum":{"num_bytes":4201650,"num_objects":49,"num_object_clones":4,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":34,"num_read":8827,"num_read_kb":9966,"num_write":2886,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"66'413","reported_seq":4656,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.831521+0000","last_change":"2024-09-12T05:20:11.785456+0000","last_active":"2024-09-12T05:21:11.831521+0000","last_peered":"2024-09-12T05:21:11.831521+0000","last_clean":"2024-09-12T05:21:11.831521+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:21:11.831521+0000","last_undegraded":"2024-09-12T05:21:11.831521+0000","last_fullsized":"2024-09-12T05:21:11.831521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:17.830408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011734079999999999,"stat_sum":{"num_bytes":14672137,"num_objects":64,"num_object_clones":12,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":38,"num_read":5355,"num_read_kb":8633,"num_write":481,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"66'218","reported_seq":772,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.454687+0000","last_change":"2024-09-12T05:21:03.166584+0000","last_active":"2024-09-12T05:21:11.454687+0000","last_peered":"2024-09-12T05:21:11.454687+0000","last_clean":"2024-09-12T05:21:02.482903+0000","last_became_active":"2024-09-12T05:21:03.166584+0000","last_became_peered":"2024-09-12T05:21:03.166584+0000","last_unstale":"2024-09-12T05:21:11.454687+0000","last_undegraded":"2024-09-12T05:21:03.162462+0000","last_fullsized":"2024-09-12T05:21:03.162245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:43.083750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010563930000000001,"stat_sum":{"num_bytes":6399823,"num_objects":53,"num_object_clones":9,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":53,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":34,"num_read":561,"num_read_kb":4003,"num_write":220,"num_write_kb":3718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":53}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"66'207","reported_seq":2152,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.635041+0000","last_change":"2024-09-12T05:21:03.166642+0000","last_active":"2024-09-12T05:21:11.635041+0000","last_peered":"2024-09-12T05:21:11.635041+0000","last_clean":"2024-09-12T05:21:02.483134+0000","last_became_active":"2024-09-12T05:21:03.166642+0000","last_became_peered":"2024-09-12T05:21:03.166642+0000","last_unstale":"2024-09-12T05:21:11.635041+0000","last_undegraded":"2024-09-12T05:21:03.162452+0000","last_fullsized":"2024-09-12T05:21:03.162237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:58.147846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072867899999999998,"stat_sum":{"num_bytes":8244240,"num_objects":49,"num_object_clones":11,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":49,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":25,"num_read":1889,"num_read_kb":5249,"num_write":184,"num_write_kb":2177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":49}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"66'269","reported_seq":2343,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.869805+0000","last_change":"2024-09-12T05:20:34.018441+0000","last_active":"2024-09-12T05:21:11.869805+0000","last_peered":"2024-09-12T05:21:11.869805+0000","last_clean":"2024-09-12T05:21:11.869805+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:21:11.869805+0000","last_undegraded":"2024-09-12T05:21:11.869805+0000","last_fullsized":"2024-09-12T05:21:11.869805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:38.342007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387196,"stat_sum":{"num_bytes":48755836,"num_objects":49,"num_object_clones":7,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":28,"num_read":2460,"num_read_kb":12359,"num_write":269,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"66'333","reported_seq":1880,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.640599+0000","last_change":"2024-09-12T05:21:03.164248+0000","last_active":"2024-09-12T05:21:11.640599+0000","last_peered":"2024-09-12T05:21:11.640599+0000","last_clean":"2024-09-12T05:21:02.482711+0000","last_became_active":"2024-09-12T05:21:03.164248+0000","last_became_peered":"2024-09-12T05:21:03.164248+0000","last_unstale":"2024-09-12T05:21:11.640599+0000","last_undegraded":"2024-09-12T05:21:03.161673+0000","last_fullsized":"2024-09-12T05:21:03.161442+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:34.758580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074458300000000005,"stat_sum":{"num_bytes":68071138,"num_objects":63,"num_object_clones":9,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":63,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":35,"num_read":2203,"num_read_kb":37281,"num_write":354,"num_write_kb":20807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":63}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"66'274","reported_seq":1238,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T05:21:11.461462+0000","last_change":"2024-09-12T05:20:57.096516+0000","last_active":"2024-09-12T05:21:11.461462+0000","last_peered":"2024-09-12T05:21:11.461462+0000","last_clean":"2024-09-12T05:21:11.461462+0000","last_became_active":"2024-09-12T05:20:57.095147+0000","last_became_peered":"2024-09-12T05:20:57.095147+0000","last_unstale":"2024-09-12T05:21:11.461462+0000","last_undegraded":"2024-09-12T05:21:11.461462+0000","last_fullsized":"2024-09-12T05:21:11.461462+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:19.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347827,"stat_sum":{"num_bytes":38154657,"num_objects":51,"num_object_clones":9,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":32,"num_read":1519,"num_read_kb":11225,"num_write":296,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"66'270","reported_seq":1968,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:11.638805+0000","last_change":"2024-09-12T05:21:03.163550+0000","last_active":"2024-09-12T05:21:11.638805+0000","last_peered":"2024-09-12T05:21:11.638805+0000","last_clean":"2024-09-12T05:21:02.482791+0000","last_became_active":"2024-09-12T05:21:03.163550+0000","last_became_peered":"2024-09-12T05:21:03.163550+0000","last_unstale":"2024-09-12T05:21:11.638805+0000","last_undegraded":"2024-09-12T05:21:03.161537+0000","last_fullsized":"2024-09-12T05:21:03.161412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:24.584837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076674600000000001,"stat_sum":{"num_bytes":25176120,"num_objects":65,"num_object_clones":15,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":65,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":38,"num_read":1665,"num_read_kb":6475,"num_write":229,"num_write_kb":2115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":65}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":778127483,"num_objects":1845,"num_object_clones":302,"num_object_copies":3690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":778,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1845,"num_whiteouts":1137,"num_read":91940,"num_read_kb":389791,"num_write":14041,"num_write_kb":226664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":11986431,"num_keys_recovered":17,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344240128,"data_stored":413357230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11801,"ondisk_log_size":11801,"up":51,"acting":51,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114476,"kb_used_data":74972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94257364,"statfs":{"total":96636764160,"available":96519540736,"internally_reserved":0,"allocated":76771328,"data_stored":86264258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41640,"kb_used_data":10452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330200,"statfs":{"total":96636764160,"available":96594124800,"internally_reserved":0,"allocated":10702848,"data_stored":13856721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97620,"kb_used_data":40064,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94274220,"statfs":{"total":96636764160,"available":96536801280,"internally_reserved":0,"allocated":41025536,"data_stored":47501766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78564,"kb_used_data":39052,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94293276,"statfs":{"total":96636764160,"available":96556314624,"internally_reserved":0,"allocated":39989248,"data_stored":49268210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126108,"kb_used_data":68548,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94245732,"statfs":{"total":96636764160,"available":96507629568,"internally_reserved":0,"allocated":70193152,"data_stored":86687652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40860,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330980,"statfs":{"total":96636764160,"available":96594923520,"internally_reserved":0,"allocated":5648384,"data_stored":6055707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76688,"kb_used_data":37184,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94295152,"statfs":{"total":96636764160,"available":96558235648,"internally_reserved":0,"allocated":38076416,"data_stored":41580834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77868,"kb_used_data":38364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94293972,"statfs":{"total":96636764160,"available":96557027328,"internally_reserved":0,"allocated":39284736,"data_stored":56258065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37924864,"data_stored":55326057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37306368,"data_stored":41239175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4882432,"data_stored":5714068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":84295680,"data_stored":101211671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39358464,"data_stored":48993160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":55123968,"data_stored":62025766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9936896,"data_stored":13515082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":75411456,"data_stored":85332251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:21:14.870 INFO:tasks.thrashosds.thrasher:Setting 2.4 to [0, 4, 5, 3] 2024-09-12T05:21:14.870 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.4', '0', '4', '5', '3'] 2024-09-12T05:21:14.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.4 0 4 5 3 2024-09-12T05:21:14.871 INFO:teuthology.orchestra.run.smithi059.stdout:3086 read 0x1eda2a7 thru 0x1ee56ad (0xb407 bytes) 2024-09-12T05:21:14.871 INFO:teuthology.orchestra.run.smithi059.stdout:3087 read 0x5ee8951 thru 0x5ef6539 (0xdbe9 bytes) 2024-09-12T05:21:14.871 INFO:teuthology.orchestra.run.smithi059.stdout:3088 trunc from 0xc5288ca to 0x7505d8a 2024-09-12T05:21:14.871 INFO:teuthology.orchestra.run.smithi059.stdout:3089 trunc from 0x7505d8a to 0x9c2f423 2024-09-12T05:21:14.871 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:14.855+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:14.873 INFO:teuthology.orchestra.run.smithi059.stdout:3090 writesame 0x242ab8c thru 0x242e881 data_size 0x36(0x3cf6 bytes) 2024-09-12T05:21:14.879 INFO:teuthology.orchestra.run.smithi059.stdout:3091 trunc from 0x9c2f423 to 0x78ea58c 2024-09-12T05:21:14.894 INFO:teuthology.orchestra.run.smithi059.stdout:3092 trunc from 0x78ea58c to 0x7c34958 2024-09-12T05:21:14.904 INFO:teuthology.orchestra.run.smithi059.stdout:3095 punch from 0x64871b to 0x64a10f, (0x19f4 bytes) 2024-09-12T05:21:14.904 INFO:teuthology.orchestra.run.smithi059.stdout:3096 read 0x43ee441 thru 0x43f3ea8 (0x5a68 bytes) 2024-09-12T05:21:14.905 INFO:teuthology.orchestra.run.smithi059.stdout:3097 read 0x4c3f11a thru 0x4c4c653 (0xd53a bytes) 2024-09-12T05:21:14.906 INFO:teuthology.orchestra.run.smithi059.stdout:3098 read 0x7a8f12b thru 0x7a95ec8 (0x6d9e bytes) 2024-09-12T05:21:14.907 INFO:teuthology.orchestra.run.smithi059.stdout:3099 read 0x560e053 thru 0x5618c97 (0xac45 bytes) 2024-09-12T05:21:14.907 INFO:teuthology.orchestra.run.smithi059.stdout:3100 punch from 0x51735a7 to 0x5176883, (0x32dc bytes) 2024-09-12T05:21:14.921 INFO:teuthology.orchestra.run.smithi059.stdout:3101 write 0xa79b0c6 thru 0xa79d7e5 (0x2720 bytes) 2024-09-12T05:21:14.924 INFO:teuthology.orchestra.run.smithi059.stdout:3102 write 0x352b3aa thru 0x3530044 (0x4c9b bytes) 2024-09-12T05:21:14.931 INFO:teuthology.orchestra.run.smithi059.stdout:3103 punch from 0x8024883 to 0x802bbd5, (0x7352 bytes) 2024-09-12T05:21:14.931 INFO:teuthology.orchestra.run.smithi059.stdout:3104 writesame 0x1bb592e thru 0x1bb7753 data_size 0x11(0x1e26 bytes) 2024-09-12T05:21:14.933 INFO:teuthology.orchestra.run.smithi059.stdout:3106 write 0x32c4994 thru 0x32cf60d (0xac7a bytes) 2024-09-12T05:21:14.936 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.937 INFO:teuthology.orchestra.run.smithi059.stdout:3110 read 0x4dd60b7 thru 0x4de0eb2 (0xadfc bytes) 2024-09-12T05:21:14.937 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:14.949 INFO:teuthology.orchestra.run.smithi059.stdout:3112 trunc from 0xa79d7e6 to 0x18fa546 2024-09-12T05:21:14.960 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:14.956+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:14.994 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:14.994 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:14.994 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:14.994 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:14.996 INFO:teuthology.orchestra.run.smithi059.stdout:3114 trunc from 0x18fa546 to 0xe1f2f76 2024-09-12T05:21:15.006 INFO:teuthology.orchestra.run.smithi059.stdout:3115 write 0x64df9a thru 0x65607d (0x80e4 bytes) 2024-09-12T05:21:15.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:15.010 INFO:teuthology.orchestra.run.smithi059.stdout:3116 punch from 0xc0d7d7d to 0xc0df67d, (0x7900 bytes) 2024-09-12T05:21:15.010 INFO:teuthology.orchestra.run.smithi059.stdout:3117 writesame 0xd0d62ed thru 0xd0daf80 data_size 0x3a(0x4c94 bytes) 2024-09-12T05:21:15.018 INFO:teuthology.orchestra.run.smithi059.stdout:3118 read 0xd6647ae thru 0xd673044 (0xe897 bytes) 2024-09-12T05:21:15.019 INFO:teuthology.orchestra.run.smithi059.stdout:3119 trunc from 0xe1f2f76 to 0xd29b799 2024-09-12T05:21:15.035 INFO:teuthology.orchestra.run.smithi059.stdout:3120 writesame 0xb5a9ea thru 0xb5aa31 data_size 0x6(0x48 bytes) 2024-09-12T05:21:15.054 INFO:teuthology.orchestra.run.smithi059.stdout:3121 write 0xee2a088 thru 0xee33772 (0x96eb bytes) 2024-09-12T05:21:15.057 INFO:teuthology.orchestra.run.smithi059.stdout:3124 write 0xa6a96ea thru 0xa6b1e43 (0x875a bytes) 2024-09-12T05:21:15.061 INFO:teuthology.orchestra.run.smithi059.stdout:3125 punch from 0xeb97982 to 0xeb9b2d0, (0x394e bytes) 2024-09-12T05:21:15.061 INFO:teuthology.orchestra.run.smithi059.stdout:3127 write 0x8539738 thru 0x854099d (0x7266 bytes) 2024-09-12T05:21:15.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:15.060+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:15.070 INFO:teuthology.orchestra.run.smithi059.stdout:3128 trunc from 0xee33773 to 0x7776d15 2024-09-12T05:21:15.088 INFO:teuthology.orchestra.run.smithi059.stdout:3129 read 0x31f1212 thru 0x31f663d (0x542c bytes) 2024-09-12T05:21:15.089 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:15.089 INFO:teuthology.orchestra.run.smithi059.stdout:3131 writesame 0x543e4 thru 0x5c1aa data_size 0x1(0x7dc7 bytes) 2024-09-12T05:21:15.104 INFO:teuthology.orchestra.run.smithi059.stdout:3132 punch from 0x3d2b8d3 to 0x3d37098, (0xb7c5 bytes) 2024-09-12T05:21:15.104 INFO:teuthology.orchestra.run.smithi059.stdout:3133 write 0x14d45e8 thru 0x14db8ab (0x72c4 bytes) 2024-09-12T05:21:15.107 INFO:teuthology.orchestra.run.smithi059.stdout:3136 read 0x25c28d7 thru 0x25c7365 (0x4a8f bytes) 2024-09-12T05:21:15.107 INFO:teuthology.orchestra.run.smithi059.stdout:3137 read 0x26bd6dc thru 0x26c8a3e (0xb363 bytes) 2024-09-12T05:21:15.107 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:15.108 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:15.108 INFO:teuthology.orchestra.run.smithi059.stdout:3144 write 0x1b3ae41 thru 0x1b42476 (0x7636 bytes) 2024-09-12T05:21:15.121 INFO:teuthology.orchestra.run.smithi059.stdout:3148 write 0x8878578 thru 0x887f8ba (0x7343 bytes) 2024-09-12T05:21:15.124 INFO:teuthology.orchestra.run.smithi059.stdout:3149 clone 24 order 25 su 262144 sc 10 2024-09-12T05:21:15.129 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:15.129 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:15.129 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:15.129 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:15.129 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:15.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:15.162 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:15.160+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:15.263 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:15.260+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:15.284 INFO:teuthology.orchestra.run.smithi059.stderr:set 2.4 pg_upmap_items mapping to [0->4,5->3] 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.330283637999997, 2024-09-12T05:21:15.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.313 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.418651320999999, 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:21:15.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:21:15.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:21:15.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.035950837000001, 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:21:15.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.323 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.801907190000001, 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.324 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:21:15.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.771782858999998, 2024-09-12T05:21:15.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:21:15.330 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.330 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.330 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.330 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:15.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:15.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:15.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:21:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:21:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:21:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:21:15.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:21:15.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:21:15.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:21:15.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:21:15.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:21:15.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:21:15.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:21:15.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:21:15.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:21:15.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.209695078000003, 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:21:15.338 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.339 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.339 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.339 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:15.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:21:15.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:21:15.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:21:15.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:21:15.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:21:15.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:21:15.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:21:15.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:21:15.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:21:15.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:21:15.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:21:15.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:21:15.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:21:15.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:21:15.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.207740860000001, 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:21:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:21:15.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.266432125999998, 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.354 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.249835533000002, 2024-09-12T05:21:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:15.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.362 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.079496093000003, 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:21:15.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:21:15.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.201041840999999, 2024-09-12T05:21:15.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:15.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:21:15.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.200996747000001, 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:15.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:15.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:21:15.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:21:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:15.376 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.192435186000001, 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:15.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:21:15.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:21:15.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.390397026999999, 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:21:15.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:21:15.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:42174 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'386, mlcod=51'383)", 2024-09-12T05:21:15.385 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:15.386 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.941903029999999, 2024-09-12T05:21:15.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052593079999999999, 2024-09-12T05:21:15.386 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.386 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.386 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:15.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:15.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367642+0000", 2024-09-12T05:21:15.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:21:15.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367649+0000", 2024-09-12T05:21:15.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2400000000000001e-06 2024-09-12T05:21:15.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367663+0000", 2024-09-12T05:21:15.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3728e-05 2024-09-12T05:21:15.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367672+0000", 2024-09-12T05:21:15.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7919999999999998e-06 2024-09-12T05:21:15.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367768+0000", 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5934999999999995e-05 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367792+0000", 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3581999999999999e-05 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.372851+0000", 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050593410000000002 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.372901+0000", 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9919000000000001e-05 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:15.393 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.876273589, 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:21:15.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:21:15.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.397 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.868187497000001, 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:21:15.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.9660012499999997, 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:21:15.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:15.408 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.988601329, 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:21:15.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:21:15.414 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.236454349, 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:15.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:21:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.419 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.419 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.419 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:15.419 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:15.419 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:15.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:15.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:21:15.423 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:15.423 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:15.419+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:15.553 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:15.551+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:15.619 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:15.620 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:15.624 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:15.619+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:15.628 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-12T05:21:15.653 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:15.653 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:15.653 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:15.653 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:15.654 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:15.654 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:15.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:15.682 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:15.682 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:15.699 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:15.726 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:15.723+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:15.726 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:15.765 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:15.765 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:15.803 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:15.803 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:15.807 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:15.807 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:15.813 INFO:teuthology.orchestra.run.smithi059.stdout:3150 flatten 2024-09-12T05:21:15.827 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:15.823+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:15.835 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:15.835 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:15.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:15.892 INFO:teuthology.orchestra.run.smithi059.stdout:3152 punch from 0x4721ae6 to 0x47286d0, (0x6bea bytes) 2024-09-12T05:21:15.892 INFO:teuthology.orchestra.run.smithi059.stdout:3153 read 0x7744f9e thru 0x774f2df (0xa342 bytes) 2024-09-12T05:21:15.911 INFO:teuthology.orchestra.run.smithi059.stdout:3154 write 0xdddb741 thru 0xdddf5ed (0x3ead bytes) 2024-09-12T05:21:15.917 INFO:teuthology.orchestra.run.smithi059.stdout:3155 clone 25 order 18 su 65536 sc 4 2024-09-12T05:21:15.928 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:15.923+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:16.008 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:16.008 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:16.022 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:16.065 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:16.063+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:16.131 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:16.127+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:16.154 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:16.155 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:16.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:16.232 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:16.228+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:16.287 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:21:16.295 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:16.295 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:16.312 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:16.365 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:16.363+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:16.433 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:16.431+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:16.473 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:16.473 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:16.488 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:16.535 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:16.532+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:16.605 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:16.606 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:16.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:16.621 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-12T05:21:16.661 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:16.660+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:16.736 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:16.732+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:16.784 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:16.784 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:16.798 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:16.837 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:16.835+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:16.938 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:16.935+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:16.942 INFO:teuthology.orchestra.run.smithi059.stdout:3156 writesame 0xe3ce132 thru 0xe3d300c data_size 0x3(0x4edb bytes) 2024-09-12T05:21:16.942 INFO:teuthology.orchestra.run.smithi059.stdout:3157 writesame 0x5302f19 thru 0x5304dad data_size 0x1(0x1e95 bytes) 2024-09-12T05:21:16.952 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:16.952 INFO:teuthology.orchestra.run.smithi059.stdout:3159 write 0x9076b6e thru 0x90861ba (0xf64d bytes) 2024-09-12T05:21:16.965 INFO:teuthology.orchestra.run.smithi059.stdout:3160 read 0x780d85f thru 0x7815155 (0x78f7 bytes) 2024-09-12T05:21:16.965 INFO:teuthology.orchestra.run.smithi059.stdout:3161 punch from 0x96e9ce9 to 0x96f5bca, (0xbee1 bytes) 2024-09-12T05:21:16.965 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:16.968 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:16.968 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:16.976 INFO:teuthology.orchestra.run.smithi059.stdout:3163 trunc from 0xe3d300d to 0x7b64530 2024-09-12T05:21:16.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:17.020 INFO:teuthology.orchestra.run.smithi059.stdout:3164 write 0xa3c636a thru 0xa3d019e (0x9e35 bytes) 2024-09-12T05:21:17.027 INFO:teuthology.orchestra.run.smithi059.stdout:3165 read 0xa0e5e03 thru 0xa0e672d (0x92b bytes) 2024-09-12T05:21:17.039 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:17.036+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:17.040 INFO:teuthology.orchestra.run.smithi059.stdout:3166 trunc from 0xa3d019f to 0x38b5d54 2024-09-12T05:21:17.070 INFO:teuthology.orchestra.run.smithi059.stdout:3168 read 0xef053e thru 0xef512e (0x4bf1 bytes) 2024-09-12T05:21:17.070 INFO:teuthology.orchestra.run.smithi059.stdout:3169 punch from 0x316319e to 0x316f62d, (0xc48f bytes) 2024-09-12T05:21:17.082 INFO:teuthology.orchestra.run.smithi059.stdout:3171 trunc from 0x38b5d54 to 0x9460d34 2024-09-12T05:21:17.095 INFO:teuthology.orchestra.run.smithi059.stdout:3173 read 0x8669d0d thru 0x86735a4 (0x9898 bytes) 2024-09-12T05:21:17.096 INFO:teuthology.orchestra.run.smithi059.stdout:3174 write 0x937b66d thru 0x937d81b (0x21af bytes) 2024-09-12T05:21:17.102 INFO:teuthology.orchestra.run.smithi059.stdout:3175 read 0x213c739 thru 0x214b1b5 (0xea7d bytes) 2024-09-12T05:21:17.103 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:17.103 INFO:teuthology.orchestra.run.smithi059.stdout:3177 punch from 0x8c9b87d to 0x8ca7b39, (0xc2bc bytes) 2024-09-12T05:21:17.103 INFO:teuthology.orchestra.run.smithi059.stdout:3179 read 0x25c1621 thru 0x25c9b76 (0x8556 bytes) 2024-09-12T05:21:17.104 INFO:teuthology.orchestra.run.smithi059.stdout:3180 write 0x8510a0c thru 0x851d3dc (0xc9d1 bytes) 2024-09-12T05:21:17.106 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:17.107 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:17.111 INFO:teuthology.orchestra.run.smithi059.stdout:3182 read 0x418b142 thru 0x41964d8 (0xb397 bytes) 2024-09-12T05:21:17.111 INFO:teuthology.orchestra.run.smithi059.stdout:3183 punch from 0x5719aa0 to 0x5723bc9, (0xa129 bytes) 2024-09-12T05:21:17.122 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:3184 write 0xca02b8b thru 0xca02e01 (0x277 bytes) 2024-09-12T05:21:17.143 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:17.139+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:17.172 INFO:teuthology.orchestra.run.smithi059.stdout:3187 trunc from 0xca02e02 to 0x35061f 2024-09-12T05:21:17.210 INFO:teuthology.orchestra.run.smithi059.stdout:3188 read 0x991bc thru 0xa2111 (0x8f56 bytes) 2024-09-12T05:21:17.217 INFO:teuthology.orchestra.run.smithi059.stdout:3189 trunc from 0x35061f to 0x1e217f5 2024-09-12T05:21:17.229 INFO:teuthology.orchestra.run.smithi059.stdout:3190 writesame 0x951154 thru 0x955b1a data_size 0x11(0x49c7 bytes) 2024-09-12T05:21:17.243 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:17.239+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:17.263 INFO:teuthology.orchestra.run.smithi059.stdout:3191 trunc from 0x1e217f5 to 0xc0b16d4 2024-09-12T05:21:17.276 INFO:teuthology.orchestra.run.smithi059.stdout:3194 read 0x367df4a thru 0x367eed8 (0xf8f bytes) 2024-09-12T05:21:17.277 INFO:teuthology.orchestra.run.smithi059.stdout:3195 read 0x6c5c5c6 thru 0x6c5ed3e (0x2779 bytes) 2024-09-12T05:21:17.277 INFO:teuthology.orchestra.run.smithi059.stdout:3197 write 0x6f8cfea thru 0x6f90028 (0x303f bytes) 2024-09-12T05:21:17.288 INFO:teuthology.orchestra.run.smithi059.stdout:3198 punch from 0x3ef35fd to 0x3efdf34, (0xa937 bytes) 2024-09-12T05:21:17.289 INFO:teuthology.orchestra.run.smithi059.stdout:3199 write 0x7aecca thru 0x7b328e (0x45c5 bytes) 2024-09-12T05:21:17.300 INFO:teuthology.orchestra.run.smithi059.stdout:3200 read 0x7995ff thru 0x7a2fbf (0x99c1 bytes) 2024-09-12T05:21:17.301 INFO:teuthology.orchestra.run.smithi059.stdout:3201 read 0x4eda9db thru 0x4ee8630 (0xdc56 bytes) 2024-09-12T05:21:17.301 INFO:teuthology.orchestra.run.smithi059.stdout:3202 write 0xa5f2879 thru 0xa5f6384 (0x3b0c bytes) 2024-09-12T05:21:17.303 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:17.303 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:17.317 INFO:teuthology.orchestra.run.smithi059.stdout:3203 writesame 0x7d4b298 thru 0x7d52748 data_size 0x1(0x74b1 bytes) 2024-09-12T05:21:17.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:17.347 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:17.343+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:17.347 INFO:teuthology.orchestra.run.smithi059.stdout:3204 trunc from 0xc0b16d4 to 0xc76b631 2024-09-12T05:21:17.360 INFO:teuthology.orchestra.run.smithi059.stdout:3205 read 0x44ac739 thru 0x44b054e (0x3e16 bytes) 2024-09-12T05:21:17.360 INFO:teuthology.orchestra.run.smithi059.stdout:3206 read 0xc210fc0 thru 0xc216884 (0x58c5 bytes) 2024-09-12T05:21:17.360 INFO:teuthology.orchestra.run.smithi059.stdout:3207 punch from 0x1906eb6 to 0x190cc85, (0x5dcf bytes) 2024-09-12T05:21:17.360 INFO:teuthology.orchestra.run.smithi059.stdout:3209 read 0x821acb5 thru 0x821acce (0x1a bytes) 2024-09-12T05:21:17.361 INFO:teuthology.orchestra.run.smithi059.stdout:3212 trunc from 0xc76b631 to 0xcfdbf91 2024-09-12T05:21:17.373 INFO:teuthology.orchestra.run.smithi059.stdout:3213 write 0x290b9fd thru 0x2911702 (0x5d06 bytes) 2024-09-12T05:21:17.380 INFO:teuthology.orchestra.run.smithi059.stdout:3215 write 0xa488558 thru 0xa495197 (0xcc40 bytes) 2024-09-12T05:21:17.387 INFO:teuthology.orchestra.run.smithi059.stdout:3216 writesame 0x8de371b thru 0x8de5a90 data_size 0x11(0x2376 bytes) 2024-09-12T05:21:17.394 INFO:teuthology.orchestra.run.smithi059.stdout:3217 punch from 0x9cc9784 to 0x9cd02d4, (0x6b50 bytes) 2024-09-12T05:21:17.394 INFO:teuthology.orchestra.run.smithi059.stdout:3218 read 0x27aef86 thru 0x27b4676 (0x56f1 bytes) 2024-09-12T05:21:17.394 INFO:teuthology.orchestra.run.smithi059.stdout:3219 read 0x5d2a111 thru 0x5d2b97f (0x186f bytes) 2024-09-12T05:21:17.394 INFO:teuthology.orchestra.run.smithi059.stdout:3222 punch from 0x13ccdcf to 0x13d4e83, (0x80b4 bytes) 2024-09-12T05:21:17.394 INFO:teuthology.orchestra.run.smithi059.stdout:3224 read 0x4adbe21 thru 0x4ae500a (0x91ea bytes) 2024-09-12T05:21:17.394 INFO:teuthology.orchestra.run.smithi059.stdout:3225 write 0x10f0fc0 thru 0x10f89d4 (0x7a15 bytes) 2024-09-12T05:21:17.399 INFO:teuthology.orchestra.run.smithi059.stdout:3226 write 0x182f7ea thru 0x1834e52 (0x5669 bytes) 2024-09-12T05:21:17.407 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:17.408 INFO:teuthology.orchestra.run.smithi059.stdout:3229 read 0xaf99cc thru 0xafb51e (0x1b53 bytes) 2024-09-12T05:21:17.408 INFO:teuthology.orchestra.run.smithi059.stdout:3230 read 0x2a52acb thru 0x2a56608 (0x3b3e bytes) 2024-09-12T05:21:17.408 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:17.409 INFO:teuthology.orchestra.run.smithi059.stdout:3232 trunc from 0xcfdbf91 to 0xc83d994 2024-09-12T05:21:17.421 INFO:teuthology.orchestra.run.smithi059.stdout:3233 read 0xaf9df92 thru 0xafa6389 (0x83f8 bytes) 2024-09-12T05:21:17.421 INFO:teuthology.orchestra.run.smithi059.stdout:3234 write 0x1b0d911 thru 0x1b16f12 (0x9602 bytes) 2024-09-12T05:21:17.430 INFO:teuthology.orchestra.run.smithi059.stdout:3235 write 0x89e712a thru 0x89f5469 (0xe340 bytes) 2024-09-12T05:21:17.439 INFO:teuthology.orchestra.run.smithi059.stdout:3236 read 0x6cfa8e8 thru 0x6cfde15 (0x352e bytes) 2024-09-12T05:21:17.442 INFO:teuthology.orchestra.run.smithi059.stdout:3238 trunc from 0xc83d994 to 0xd99b516 2024-09-12T05:21:17.447 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:17.443+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:17.449 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:17.450 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:17.455 INFO:teuthology.orchestra.run.smithi059.stdout:3239 read 0x7efb320 thru 0x7efc323 (0x1004 bytes) 2024-09-12T05:21:17.456 INFO:teuthology.orchestra.run.smithi059.stdout:3241 punch from 0x34ce6b1 to 0x34d5af4, (0x7443 bytes) 2024-09-12T05:21:17.456 INFO:teuthology.orchestra.run.smithi059.stdout:3242 write 0xd0f3a5c thru 0xd0f8e31 (0x53d6 bytes) 2024-09-12T05:21:17.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:17.481 INFO:teuthology.orchestra.run.smithi059.stdout:3243 trunc from 0xd99b516 to 0x71de46c 2024-09-12T05:21:17.503 INFO:teuthology.orchestra.run.smithi059.stdout:3244 punch from 0x4653100 to 0x4657fee, (0x4eee bytes) 2024-09-12T05:21:17.503 INFO:teuthology.orchestra.run.smithi059.stdout:3246 writesame 0x5726da2 thru 0x572880d data_size 0x4(0x1a6c bytes) 2024-09-12T05:21:17.507 INFO:teuthology.orchestra.run.smithi059.stdout:3247 write 0x5501a11 thru 0x55086fd (0x6ced bytes) 2024-09-12T05:21:17.512 INFO:teuthology.orchestra.run.smithi059.stdout:3248 writesame 0x1b1532 thru 0x1b6f92 data_size 0x1(0x5a61 bytes) 2024-09-12T05:21:17.548 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:17.543+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:17.567 INFO:teuthology.orchestra.run.smithi059.stdout:3251 writesame 0xca8de59 thru 0xca9de32 data_size 0x1(0xffda bytes) 2024-09-12T05:21:17.567 INFO:teuthology.orchestra.run.smithi059.stdout:3252 read 0xade934a thru 0xadef1f2 (0x5ea9 bytes) 2024-09-12T05:21:17.567 INFO:teuthology.orchestra.run.smithi059.stdout:3253 read 0x893531e thru 0x8943891 (0xe574 bytes) 2024-09-12T05:21:17.572 INFO:teuthology.orchestra.run.smithi059.stdout:3254 trunc from 0xca9de33 to 0xaa95b08 2024-09-12T05:21:17.583 INFO:teuthology.orchestra.run.smithi059.stdout:3255 write 0x421b95d thru 0x4222014 (0x66b8 bytes) 2024-09-12T05:21:17.594 INFO:teuthology.orchestra.run.smithi059.stdout:3256 trunc from 0xaa95b08 to 0x9f70eb3 2024-09-12T05:21:17.605 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:17.605 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:17.618 INFO:teuthology.orchestra.run.smithi059.stdout:3257 write 0xb28d359 thru 0xb29c0af (0xed57 bytes) 2024-09-12T05:21:17.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:17.628 INFO:teuthology.orchestra.run.smithi059.stdout:3258 write 0x435eee thru 0x440206 (0xa319 bytes) 2024-09-12T05:21:17.638 INFO:teuthology.orchestra.run.smithi059.stdout:3259 read 0x8d218c6 thru 0x8d31055 (0xf790 bytes) 2024-09-12T05:21:17.649 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:17.644+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:17.649 INFO:teuthology.orchestra.run.smithi059.stdout:3260 trunc from 0xb29c0b0 to 0x4da7157 2024-09-12T05:21:17.669 INFO:teuthology.orchestra.run.smithi059.stdout:3263 writesame 0x9a9d85 thru 0x9aac91 data_size 0x1(0xf0d bytes) 2024-09-12T05:21:17.689 INFO:teuthology.orchestra.run.smithi059.stdout:3264 write 0x7f0cf95 thru 0x7f1c136 (0xf1a2 bytes) 2024-09-12T05:21:17.698 INFO:teuthology.orchestra.run.smithi059.stdout:3265 punch from 0x5538697 to 0x553d53f, (0x4ea8 bytes) 2024-09-12T05:21:17.702 INFO:teuthology.orchestra.run.smithi059.stdout:3266 trunc from 0x7f1c137 to 0x586a767 2024-09-12T05:21:17.744 INFO:teuthology.orchestra.run.smithi059.stdout:3267 write 0xbdd290d thru 0xbdd34b8 (0xbac bytes) 2024-09-12T05:21:17.752 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:17.748+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:17.753 INFO:teuthology.orchestra.run.smithi059.stdout:3268 writesame 0xae12dae thru 0xae1bfe5 data_size 0x4(0x9238 bytes) 2024-09-12T05:21:17.762 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:17.762 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:17.767 INFO:teuthology.orchestra.run.smithi059.stdout:3269 write 0x3e45f7e thru 0x3e47bc8 (0x1c4b bytes) 2024-09-12T05:21:17.773 INFO:teuthology.orchestra.run.smithi059.stdout:3270 read 0x1be8fcb thru 0x1bea581 (0x15b7 bytes) 2024-09-12T05:21:17.773 INFO:teuthology.orchestra.run.smithi059.stdout:3272 punch from 0x32674ff to 0x32683db, (0xedc bytes) 2024-09-12T05:21:17.773 INFO:teuthology.orchestra.run.smithi059.stdout:3273 read 0x59fd644 thru 0x5a0c04a (0xea07 bytes) 2024-09-12T05:21:17.774 INFO:teuthology.orchestra.run.smithi059.stdout:3274 writesame 0x716d1e thru 0x71d46b data_size 0x7(0x674e bytes) 2024-09-12T05:21:17.777 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:17.785 INFO:teuthology.orchestra.run.smithi059.stdout:3276 read 0x5ff8076 thru 0x5ff814a (0xd5 bytes) 2024-09-12T05:21:17.786 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:17.786 INFO:teuthology.orchestra.run.smithi059.stdout:3278 writesame 0xb0d0306 thru 0xb0d2ae7 data_size 0x5(0x27e2 bytes) 2024-09-12T05:21:17.807 INFO:teuthology.orchestra.run.smithi059.stdout:3279 trunc from 0xbdd34b9 to 0x3f78be2 2024-09-12T05:21:17.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:17.839 INFO:teuthology.orchestra.run.smithi059.stdout:3281 trunc from 0x3f78be2 to 0xc5ea008 2024-09-12T05:21:17.850 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:17.848+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:17.856 INFO:teuthology.orchestra.run.smithi059.stdout:3282 write 0xcd60bf5 thru 0xcd6f15b (0xe567 bytes) 2024-09-12T05:21:17.863 INFO:teuthology.orchestra.run.smithi059.stdout:3283 writesame 0xaa72820 thru 0xaa79e74 data_size 0x1(0x7655 bytes) 2024-09-12T05:21:17.898 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:17.898 INFO:teuthology.orchestra.run.smithi059.stdout:3285 read 0xbf7ad55 thru 0xbf7c9ba (0x1c66 bytes) 2024-09-12T05:21:17.898 INFO:teuthology.orchestra.run.smithi059.stdout:3286 read 0x49242a8 thru 0x492993c (0x5695 bytes) 2024-09-12T05:21:17.898 INFO:teuthology.orchestra.run.smithi059.stdout:3288 write 0x5722cb9 thru 0x572bcb8 (0x9000 bytes) 2024-09-12T05:21:17.905 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:17.907 INFO:teuthology.orchestra.run.smithi059.stdout:3290 read 0x7237039 thru 0x723dd5c (0x6d24 bytes) 2024-09-12T05:21:17.907 INFO:teuthology.orchestra.run.smithi059.stdout:3291 read 0x221eacf thru 0x221fcde (0x1210 bytes) 2024-09-12T05:21:17.907 INFO:teuthology.orchestra.run.smithi059.stdout:3292 write 0x593d31b thru 0x593ff25 (0x2c0b bytes) 2024-09-12T05:21:17.913 INFO:teuthology.orchestra.run.smithi059.stdout:3294 trunc from 0xcd6f15c to 0xb7980b8 2024-09-12T05:21:17.925 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:17.925 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:17.933 INFO:teuthology.orchestra.run.smithi059.stdout:3295 writesame 0xab1679a thru 0xab18e64 data_size 0x1(0x26cb bytes) 2024-09-12T05:21:17.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:17.944 INFO:teuthology.orchestra.run.smithi059.stdout:3296 read 0xb620234 thru 0xb62be04 (0xbbd1 bytes) 2024-09-12T05:21:17.944 INFO:teuthology.orchestra.run.smithi059.stdout:3297 write 0x29afdae thru 0x29bfc73 (0xfec6 bytes) 2024-09-12T05:21:17.951 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:17.948+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:17.953 INFO:teuthology.orchestra.run.smithi059.stdout:3298 read 0x645bc57 thru 0x6464356 (0x8700 bytes) 2024-09-12T05:21:17.953 INFO:teuthology.orchestra.run.smithi059.stdout:3299 writesame 0x36e8db1 thru 0x36f50d1 data_size 0x1(0xc321 bytes) 2024-09-12T05:21:17.968 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:17.968 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:17.986 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:17.986 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:17.988 INFO:teuthology.orchestra.run.smithi059.stdout:3300 writesame 0xc474d6 thru 0xc5502b data_size 0x19(0xdb56 bytes) 2024-09-12T05:21:17.998 INFO:teuthology.orchestra.run.smithi059.stdout:3302 writesame 0x5aa8cb9 thru 0x5ab1df3 data_size 0x9(0x913b bytes) 2024-09-12T05:21:18.004 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:18.016 INFO:teuthology.orchestra.run.smithi059.stdout:3304 writesame 0xcef81c0 thru 0xcf07173 data_size 0x5c(0xefb4 bytes) 2024-09-12T05:21:18.024 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:18.024 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:18.024 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:18.031 INFO:teuthology.orchestra.run.smithi059.stdout:3306 trunc from 0xcf07174 to 0x40ad2ab 2024-09-12T05:21:18.048 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:18.049 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:18.049 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.051 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:18.048+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:18.061 INFO:teuthology.orchestra.run.smithi059.stdout:3308 write 0x78e3d3a thru 0x78eea0e (0xacd5 bytes) 2024-09-12T05:21:18.070 INFO:teuthology.orchestra.run.smithi059.stdout:3309 punch from 0x16ab159 to 0x16b259c, (0x7443 bytes) 2024-09-12T05:21:18.070 INFO:teuthology.orchestra.run.smithi059.stdout:3310 read 0x17697fb thru 0x17782ca (0xead0 bytes) 2024-09-12T05:21:18.072 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:18.073 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:18.083 INFO:teuthology.orchestra.run.smithi059.stdout:3311 write 0xb62ea56 thru 0xb63322e (0x47d9 bytes) 2024-09-12T05:21:18.088 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:18.088 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:18.088 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:18.088 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:18.092 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.096 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:18.100 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:18.101 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:18.105 INFO:teuthology.orchestra.run.smithi059.stdout:3313 writesame 0xdce9e6c thru 0xdcef5c2 data_size 0x3(0x5757 bytes) 2024-09-12T05:21:18.105 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.105 INFO:teuthology.orchestra.run.smithi059.stdout:3315 writesame 0xd8ae86f thru 0xd8b7c09 data_size 0x1(0x939b bytes) 2024-09-12T05:21:18.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:18.144 INFO:teuthology.orchestra.run.smithi059.stdout:3316 read 0xd0caa5c thru 0xd0d1c20 (0x71c5 bytes) 2024-09-12T05:21:18.144 INFO:teuthology.orchestra.run.smithi059.stdout:3318 write 0x359c0ad thru 0x35aadd3 (0xed27 bytes) 2024-09-12T05:21:18.151 INFO:teuthology.orchestra.run.smithi059.stdout:3319 punch from 0x1890f3f to 0x189523f, (0x4300 bytes) 2024-09-12T05:21:18.152 INFO:teuthology.orchestra.run.smithi059.stdout:3320 read 0xadc249c thru 0xadd1d62 (0xf8c7 bytes) 2024-09-12T05:21:18.152 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:18.148+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:18.152 INFO:teuthology.orchestra.run.smithi059.stdout:3322 trunc from 0xdcef5c3 to 0xe5e28c2 2024-09-12T05:21:18.160 INFO:teuthology.orchestra.run.smithi059.stdout:3323 write 0xc46bb24 thru 0xc473a6b (0x7f48 bytes) 2024-09-12T05:21:18.169 INFO:teuthology.orchestra.run.smithi059.stdout:3324 read 0xa6dd2f thru 0xa73428 (0x56fa bytes) 2024-09-12T05:21:18.169 INFO:teuthology.orchestra.run.smithi059.stdout:3325 read 0x4a8763e thru 0x4a954c2 (0xde85 bytes) 2024-09-12T05:21:18.169 INFO:teuthology.orchestra.run.smithi059.stdout:3327 punch from 0x6a9da4 to 0x6accc3, (0x2f1f bytes) 2024-09-12T05:21:18.169 INFO:teuthology.orchestra.run.smithi059.stdout:3328 writesame 0xd3c8f05 thru 0xd3d395b data_size 0x1(0xaa57 bytes) 2024-09-12T05:21:18.192 INFO:teuthology.orchestra.run.smithi059.stdout:3329 write 0x40c4759 thru 0x40c4935 (0x1dd bytes) 2024-09-12T05:21:18.198 INFO:teuthology.orchestra.run.smithi059.stdout:3330 read 0x7d6e0f0 thru 0x7d79511 (0xb422 bytes) 2024-09-12T05:21:18.198 INFO:teuthology.orchestra.run.smithi059.stdout:3331 write 0x3169d79 thru 0x3179185 (0xf40d bytes) 2024-09-12T05:21:18.207 INFO:teuthology.orchestra.run.smithi059.stdout:3332 write 0xa4529fb thru 0xa458cf9 (0x62ff bytes) 2024-09-12T05:21:18.212 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.212 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.221 INFO:teuthology.orchestra.run.smithi059.stdout:3336 trunc from 0xe5e28c2 to 0x8bed5d5 2024-09-12T05:21:18.242 INFO:teuthology.orchestra.run.smithi059.stdout:3338 write 0xeb9c7c thru 0xebb59a (0x191f bytes) 2024-09-12T05:21:18.249 INFO:teuthology.orchestra.run.smithi059.stdout:3339 write 0x24aa9c0 thru 0x24b8a99 (0xe0da bytes) 2024-09-12T05:21:18.253 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:18.251+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:18.260 INFO:teuthology.orchestra.run.smithi059.stdout:3342 punch from 0x7ef5939 to 0x7f014e6, (0xbbad bytes) 2024-09-12T05:21:18.260 INFO:teuthology.orchestra.run.smithi059.stdout:3343 read 0x1b5f21d thru 0x1b63133 (0x3f17 bytes) 2024-09-12T05:21:18.261 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.261 INFO:teuthology.orchestra.run.smithi059.stdout:3345 write 0xf7db8c thru 0xf836d0 (0x5b45 bytes) 2024-09-12T05:21:18.281 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:18.281 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:18.281 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:18.281 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:18.281 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:18.282 INFO:teuthology.orchestra.run.smithi059.stdout:3346 write 0xd2ccbff thru 0xd2cd246 (0x648 bytes) 2024-09-12T05:21:18.289 INFO:teuthology.orchestra.run.smithi059.stdout:3347 read 0x23c2937 thru 0x23c2f1a (0x5e4 bytes) 2024-09-12T05:21:18.289 INFO:teuthology.orchestra.run.smithi059.stdout:3350 read 0x2a5ed2d thru 0x2a66970 (0x7c44 bytes) 2024-09-12T05:21:18.289 INFO:teuthology.orchestra.run.smithi059.stdout:3351 read 0x3a6ccb0 thru 0x3a7510f (0x8460 bytes) 2024-09-12T05:21:18.289 INFO:teuthology.orchestra.run.smithi059.stdout:3352 read 0x9166c65 thru 0x916ba22 (0x4dbe bytes) 2024-09-12T05:21:18.289 INFO:teuthology.orchestra.run.smithi059.stdout:3353 read 0x8e2f87d thru 0x8e3241c (0x2ba0 bytes) 2024-09-12T05:21:18.289 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.289 INFO:teuthology.orchestra.run.smithi059.stdout:3355 punch from 0x78d1e01 to 0x78d6bd1, (0x4dd0 bytes) 2024-09-12T05:21:18.290 INFO:teuthology.orchestra.run.smithi059.stdout:3356 writesame 0xcd1fb0 thru 0xcdf12a data_size 0x7(0xd17b bytes) 2024-09-12T05:21:18.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:18.299 INFO:teuthology.orchestra.run.smithi059.stdout:3357 read 0x5d8a95b thru 0x5d9186f (0x6f15 bytes) 2024-09-12T05:21:18.299 INFO:teuthology.orchestra.run.smithi059.stdout:3358 read 0x25691c9 thru 0x256d786 (0x45be bytes) 2024-09-12T05:21:18.299 INFO:teuthology.orchestra.run.smithi059.stdout:3359 writesame 0x591a5d4 thru 0x59278b3 data_size 0x38(0xd2e0 bytes) 2024-09-12T05:21:18.317 INFO:teuthology.orchestra.run.smithi059.stdout:3360 write 0xea859b1 thru 0xea868b1 (0xf01 bytes) 2024-09-12T05:21:18.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:21:18.323 INFO:teuthology.orchestra.run.smithi059.stdout:3361 write 0x86cdcf0 thru 0x86d50c4 (0x73d5 bytes) 2024-09-12T05:21:18.330 INFO:teuthology.orchestra.run.smithi059.stdout:3362 punch from 0x18cfd65 to 0x18dd688, (0xd923 bytes) 2024-09-12T05:21:18.330 INFO:teuthology.orchestra.run.smithi059.stdout:3364 read 0x92105a7 thru 0x921bda7 (0xb801 bytes) 2024-09-12T05:21:18.330 INFO:teuthology.orchestra.run.smithi059.stdout:3365 punch from 0xc713649 to 0xc717605, (0x3fbc bytes) 2024-09-12T05:21:18.338 INFO:teuthology.orchestra.run.smithi059.stdout:3367 writesame 0xed26459 thru 0xed2d403 data_size 0x3(0x6fab bytes) 2024-09-12T05:21:18.338 INFO:teuthology.orchestra.run.smithi059.stdout:3368 punch from 0x66d5af to 0x66f34f, (0x1da0 bytes) 2024-09-12T05:21:18.339 INFO:teuthology.orchestra.run.smithi059.stdout:3369 write 0xe96134a thru 0xe9693e9 (0x80a0 bytes) 2024-09-12T05:21:18.345 INFO:teuthology.orchestra.run.smithi059.stdout:3370 writesame 0xa539d31 thru 0xa549aa2 data_size 0x1(0xfd72 bytes) 2024-09-12T05:21:18.354 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:18.352+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:18.384 INFO:teuthology.orchestra.run.smithi059.stdout:3371 punch from 0x5dc14c4 to 0x5dc9f0b, (0x8a47 bytes) 2024-09-12T05:21:18.384 INFO:teuthology.orchestra.run.smithi059.stdout:3372 read 0xce88ae6 thru 0xce8b3a3 (0x28be bytes) 2024-09-12T05:21:18.386 INFO:teuthology.orchestra.run.smithi059.stdout:3373 trunc from 0xed2d404 to 0xd9ed65c 2024-09-12T05:21:18.424 INFO:teuthology.orchestra.run.smithi059.stdout:3376 trunc from 0xd9ed65c to 0x1d27183 2024-09-12T05:21:18.426 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:18.426 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:18.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:18.426 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:18.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.426 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.0076389470000002, 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:21:18.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:21:18.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:21:18.431 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.432 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.432 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.432 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:18.432 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9961907380000001, 2024-09-12T05:21:18.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.433 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:21:18.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:21:18.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:21:18.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:21:18.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:21:18.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:21:18.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:21:18.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:21:18.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.438 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9085758330000004, 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:18.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:21:18.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:21:18.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:21:18.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.908532729, 2024-09-12T05:21:18.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:18.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:21:18.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:21:18.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:21:18.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:18.449 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9085054809999997, 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:21:18.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:21:18.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9084792010000005, 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.455 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:21:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9084565900000001, 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.459 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:21:18.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:21:18.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9084287609999997, 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:21:18.463 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:18.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:18.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:18.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:18.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:21:18.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9084063420000001, 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.469 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9083852100000005, 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9082965759999997, 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.478 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:18.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9082656419999999, 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.482 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:21:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:21:18.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9082394799999998, 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.487 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:21:18.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9082173060000001, 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:21:18.491 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:21:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:21:18.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:21:18.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:21:18.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:21:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.496 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9081961920000001, 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:21:18.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:21:18.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.500 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9081745550000004, 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.501 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:21:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:21:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78378 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9080661189999999, 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059385249000000001, 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.506 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78378 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519236+0000", 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3900000000000004e-07 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519240+0000", 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3759999999999999e-06 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519249+0000", 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:21:18.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519256+0000", 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578613+0000", 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059356679000000002 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578621+0000", 2024-09-12T05:21:18.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5020000000000003e-06 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78379 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519267+0000", 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9080341169999997, 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059383665000000002, 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.510 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78379 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519267+0000", 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519267+0000", 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519268+0000", 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519271+0000", 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8990000000000001e-06 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519278+0000", 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2099999999999996e-06 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519284+0000", 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8819999999999998e-06 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578644+0000", 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059359749000000003 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578651+0000", 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.396e-06 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:18.514 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9080096399999995, 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:21:18.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:21:18.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9079819239999996, 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.519 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:21:18.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:21:18.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:21:18.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:21:18.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.524 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.524 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.524 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:18.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:18.528 INFO:teuthology.orchestra.run.smithi059.stdout:3377 writesame 0x23e8c76 thru 0x23f46c6 data_size 0xd(0xba51 bytes) 2024-09-12T05:21:18.528 INFO:teuthology.orchestra.run.smithi059.stdout:3378 writesame 0x9b0d891 thru 0x9b190d2 data_size 0x59(0xb842 bytes) 2024-09-12T05:21:18.528 INFO:teuthology.orchestra.run.smithi059.stdout:3379 write 0x90ad3ed thru 0x90bc1de (0xedf2 bytes) 2024-09-12T05:21:18.528 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.528 INFO:teuthology.orchestra.run.smithi059.stdout:3381 punch from 0x3d6ff8e to 0x3d7619e, (0x6210 bytes) 2024-09-12T05:21:18.528 INFO:teuthology.orchestra.run.smithi059.stdout:3385 writesame 0xa94fac3 thru 0xa9527d0 data_size 0x49(0x2d0e bytes) 2024-09-12T05:21:18.528 INFO:teuthology.orchestra.run.smithi059.stdout:3386 punch from 0x692a3f8 to 0x692f428, (0x5030 bytes) 2024-09-12T05:21:18.528 INFO:teuthology.orchestra.run.smithi059.stdout:3388 writesame 0x1e51ea2 thru 0x1e5cff6 data_size 0x1(0xb155 bytes) 2024-09-12T05:21:18.529 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:18.524+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:18.532 INFO:teuthology.orchestra.run.smithi059.stdout:3390 trunc from 0xa9527d1 to 0xe78b755 2024-09-12T05:21:18.540 INFO:teuthology.orchestra.run.smithi059.stdout:3391 read 0x6549f15 thru 0x654fae9 (0x5bd5 bytes) 2024-09-12T05:21:18.561 INFO:teuthology.orchestra.run.smithi059.stdout:3392 trunc from 0xe78b755 to 0x2cbb13c 2024-09-12T05:21:18.602 INFO:teuthology.orchestra.run.smithi059.stdout:3394 writesame 0xd76e286 thru 0xd776f98 data_size 0x1f(0x8d13 bytes) 2024-09-12T05:21:18.602 INFO:teuthology.orchestra.run.smithi059.stdout:3395 write 0x3586ee0 thru 0x358dcfe (0x6e1f bytes) 2024-09-12T05:21:18.606 INFO:teuthology.orchestra.run.smithi059.stdout:3396 writesame 0xbbe107c thru 0xbbe5c1a data_size 0x9(0x4b9f bytes) 2024-09-12T05:21:18.614 INFO:teuthology.orchestra.run.smithi059.stdout:3399 punch from 0xcbdb36f to 0xcbe2d65, (0x79f6 bytes) 2024-09-12T05:21:18.619 INFO:teuthology.orchestra.run.smithi059.stdout:3401 trunc from 0xd776f99 to 0xad1cc5a 2024-09-12T05:21:18.626 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:18.623+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:18.635 INFO:teuthology.orchestra.run.smithi059.stdout:3402 punch from 0x29f40d3 to 0x29f7022, (0x2f4f bytes) 2024-09-12T05:21:18.635 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.647 INFO:teuthology.orchestra.run.smithi059.stdout:3404 trunc from 0xad1cc5a to 0x36a2675 2024-09-12T05:21:18.655 INFO:teuthology.orchestra.run.smithi059.stdout:3405 read 0xfc08f4 thru 0xfc1f45 (0x1652 bytes) 2024-09-12T05:21:18.655 INFO:teuthology.orchestra.run.smithi059.stdout:3407 read 0xc40dc7 thru 0xc4e410 (0xd64a bytes) 2024-09-12T05:21:18.656 INFO:teuthology.orchestra.run.smithi059.stdout:3408 read 0x32eecd2 thru 0x32f8c5d (0x9f8c bytes) 2024-09-12T05:21:18.659 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:18.659 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:18.659 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:18.659 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:18.674 INFO:teuthology.orchestra.run.smithi059.stdout:3409 trunc from 0x36a2675 to 0xe6fb608 2024-09-12T05:21:18.682 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:18.683 INFO:teuthology.orchestra.run.smithi059.stdout:3410 punch from 0x9e7fe73 to 0x9e8868c, (0x8819 bytes) 2024-09-12T05:21:18.683 INFO:teuthology.orchestra.run.smithi059.stdout:3411 punch from 0x955c6f7 to 0x9562053, (0x595c bytes) 2024-09-12T05:21:18.683 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.683 INFO:teuthology.orchestra.run.smithi059.stdout:3415 write 0x708b906 thru 0x70930f6 (0x77f1 bytes) 2024-09-12T05:21:18.691 INFO:teuthology.orchestra.run.smithi059.stdout:3416 writesame 0x6ede191 thru 0x6ee1969 data_size 0x11(0x37d9 bytes) 2024-09-12T05:21:18.704 INFO:teuthology.orchestra.run.smithi059.stdout:3417 trunc from 0xe6fb608 to 0xb7e6982 2024-09-12T05:21:18.727 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:18.723+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:18.728 INFO:teuthology.orchestra.run.smithi059.stdout:3418 trunc from 0xb7e6982 to 0x6c2e0a 2024-09-12T05:21:18.767 INFO:teuthology.orchestra.run.smithi059.stdout:3419 write 0x16b0842 thru 0x16ba869 (0xa028 bytes) 2024-09-12T05:21:18.777 INFO:teuthology.orchestra.run.smithi059.stdout:3420 read 0xc1f414 thru 0xc2f3ac (0xff99 bytes) 2024-09-12T05:21:18.777 INFO:teuthology.orchestra.run.smithi059.stdout:3422 punch from 0x958254 to 0x95fe5e, (0x7c0a bytes) 2024-09-12T05:21:18.802 INFO:teuthology.orchestra.run.smithi059.stdout:3423 write 0xbf4c0bf thru 0xbf5bdc9 (0xfd0b bytes) 2024-09-12T05:21:18.813 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:18.814 INFO:teuthology.orchestra.run.smithi059.stdout:3426 read 0x24583c8 thru 0x245ef1d (0x6b56 bytes) 2024-09-12T05:21:18.814 INFO:teuthology.orchestra.run.smithi059.stdout:3427 write 0x8b9670 thru 0x8be1bf (0x4b50 bytes) 2024-09-12T05:21:18.814 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:18.814 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:18.814 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:18.814 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:18.814 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:18.828 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:18.823+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:18.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:18.835 INFO:teuthology.orchestra.run.smithi059.stdout:3428 trunc from 0xbf5bdca to 0x1e8a32f 2024-09-12T05:21:18.854 INFO:teuthology.orchestra.run.smithi059.stdout:3430 read 0x1410048 thru 0x14153cb (0x5384 bytes) 2024-09-12T05:21:18.854 INFO:teuthology.orchestra.run.smithi059.stdout:3431 read 0x1380dbf thru 0x138e665 (0xd8a7 bytes) 2024-09-12T05:21:18.861 INFO:teuthology.orchestra.run.smithi059.stdout:3432 trunc from 0x1e8a32f to 0x2fa533c 2024-09-12T05:21:18.866 INFO:teuthology.orchestra.run.smithi059.stdout:3434 write 0x6ece19 thru 0x6f6d39 (0x9f21 bytes) 2024-09-12T05:21:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:3435 read 0x28e1fa7 thru 0x28eeae0 (0xcb3a bytes) 2024-09-12T05:21:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:3436 read 0x2269512 thru 0x226e2f7 (0x4de6 bytes) 2024-09-12T05:21:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:3437 punch from 0x27bb82a to 0x27cb184, (0xf95a bytes) 2024-09-12T05:21:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:3438 read 0xaa7e67 thru 0xaa8284 (0x41e bytes) 2024-09-12T05:21:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:3439 read 0x15bbd21 thru 0x15bfb59 (0x3e39 bytes) 2024-09-12T05:21:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:3442 read 0x1a3c7b7 thru 0x1a4ab01 (0xe34b bytes) 2024-09-12T05:21:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:3443 clone 26 order 25 su 8388608 sc 13 2024-09-12T05:21:18.929 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:18.927+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:18.954 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 57.976218365999998, 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:21:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:21:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.064586048999999, 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.681885565000002, 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:21:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:21:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:18.968 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.447841918000002, 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:18.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:21:18.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.417717586999999, 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:18.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:21:18.977 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.855629806000003, 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:21:18.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:21:18.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:21:18.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.853675588000002, 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.985 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:21:18.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.912366853999998, 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:21:18.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.895770261000003, 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:18.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:21:18.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:21:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:18.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.725430821000003, 2024-09-12T05:21:18.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:21:19.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.846976568999999, 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:21:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.846931474999998, 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.008 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:21:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.838369913999998, 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:21:19.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:21:19.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:21:19.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:21:19.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:21:19.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.036331754999999, 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:21:19.017 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:21:19.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:42174 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'386, mlcod=51'383)", 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.587837757999999, 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052593079999999999, 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367641+0000", 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367642+0000", 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7100000000000001e-07 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367649+0000", 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2400000000000001e-06 2024-09-12T05:21:19.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367663+0000", 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3728e-05 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367672+0000", 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7919999999999998e-06 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367768+0000", 2024-09-12T05:21:19.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5934999999999995e-05 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.367792+0000", 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3581999999999999e-05 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.372851+0000", 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050593410000000002 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:50.372901+0000", 2024-09-12T05:21:19.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9919000000000001e-05 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.522208317, 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:19.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:21:19.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:21:19.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.514122225000001, 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:21:19.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:21:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:21:19.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.611935978, 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:21:19.035 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:21:19.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.634536057, 2024-09-12T05:21:19.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:21:19.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:19.045 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.882389077, 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:21:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.050 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.050 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.050 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:19.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:19.052 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:19.047+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:19.152 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:19.152+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:19.221 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:19.222 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:19.222 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:19.222 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:19.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:19.281 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:19.279+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:19.318 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:21:19.370 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:19.370 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:19.370 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:19.370 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:19.370 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:19.371 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:19.367+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:19.385 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:19.425 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone25 from 0x2fa533c (overlap 0x35061f) to 0x54d69 2024-09-12T05:21:19.469 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:19.467+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:19.555 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-12T05:21:19.555 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:19.551+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:19.566 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:19.566 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:19.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:19.566 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80148 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6594560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8511460509999997, 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047081795000000003, 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80148 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712493+0000", 2024-09-12T05:21:19.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8299999999999997e-07 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712495+0000", 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3099999999999999e-06 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712504+0000", 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5290000000000008e-06 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712509+0000", 2024-09-12T05:21:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4480000000000002e-06 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759399+0000", 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046889693000000003 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759478+0000", 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9040000000000002e-05 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759574+0000", 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6292000000000006e-05 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80149 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7028736~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8511003769999999, 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047236827000000002, 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.571 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80149 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712539+0000", 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712542+0000", 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9639999999999999e-06 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712550+0000", 2024-09-12T05:21:19.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7709999999999995e-06 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712556+0000", 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6380000000000001e-06 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759608+0000", 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047051754000000001 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759684+0000", 2024-09-12T05:21:19.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6784000000000002e-05 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759775+0000", 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000001e-05 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80150 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6701056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8510731400000004, 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047422082999999997, 2024-09-12T05:21:19.575 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80150 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:19.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713023+0000", 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00045808399999999999 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713028+0000", 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7849999999999999e-06 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713039+0000", 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0530000000000001e-05 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713046+0000", 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2710000000000003e-06 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759807+0000", 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046761182999999998 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759887+0000", 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9709999999999994e-05 2024-09-12T05:21:19.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759987+0000", 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010052000000000001 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80151 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7036928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:19.580 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8505787680000001, 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047137710999999999, 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80151 2024-09-12T05:21:19.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713063+0000", 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7460000000000001e-06 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713071+0000", 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6159999999999996e-06 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713077+0000", 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:21:19.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760020+0000", 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046943358999999997 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760098+0000", 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7519000000000001e-05 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760197+0000", 2024-09-12T05:21:19.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9778000000000006e-05 2024-09-12T05:21:19.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.586 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.586 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80152 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6709248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.586 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8505528160000004, 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047326518999999997, 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80152 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.587 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713245+0000", 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015924600000000001 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713249+0000", 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3379999999999998e-06 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713265+0000", 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6184e-05 2024-09-12T05:21:19.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713271+0000", 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6670000000000001e-06 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760231+0000", 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046960285999999997 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760311+0000", 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9643999999999998e-05 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760412+0000", 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101154 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80153 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6799360~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8503576500000003, 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047341640999999997, 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80153 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.592 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713474+0000", 2024-09-12T05:21:19.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192898 2024-09-12T05:21:19.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713477+0000", 2024-09-12T05:21:19.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3890000000000001e-06 2024-09-12T05:21:19.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713487+0000", 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713494+0000", 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4540000000000001e-06 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760444+0000", 2024-09-12T05:21:19.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046949957 2024-09-12T05:21:19.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760526+0000", 2024-09-12T05:21:19.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1361999999999998e-05 2024-09-12T05:21:19.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760622+0000", 2024-09-12T05:21:19.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6587000000000002e-05 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80154 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8413184~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.850131652, 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047319877000000003, 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.602 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.602 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.602 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80154 2024-09-12T05:21:19.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.602 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:19.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:19.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713977+0000", 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00047076399999999998 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713985+0000", 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8790000000000003e-06 2024-09-12T05:21:19.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713996+0000", 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.113e-05 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714003+0000", 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8979999999999999e-06 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760655+0000", 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046651821000000003 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760734+0000", 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9208999999999993e-05 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760827+0000", 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2176000000000007e-05 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.606 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80156 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8503296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8495971349999998, 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047199342999999998, 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.607 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.608 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.608 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.608 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80156 2024-09-12T05:21:19.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.608 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719243+0000", 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052018419999999999 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719248+0000", 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1760000000000001e-06 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719261+0000", 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3045e-05 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719269+0000", 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1130000000000001e-06 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761068+0000", 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041798096999999999 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761148+0000", 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0301000000000002e-05 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761241+0000", 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769000000000006e-05 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80227 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4956160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8435797620000001, 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047195107, 2024-09-12T05:21:19.612 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80227 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4900000000000001e-07 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720061+0000", 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0980000000000001e-06 2024-09-12T05:21:19.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720068+0000", 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.007e-06 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720074+0000", 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767070+0000", 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046996653999999999 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767150+0000", 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9919000000000005e-05 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767254+0000", 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103639 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80228 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 5718016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8435579119999996, 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047313252, 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.617 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80228 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720081+0000", 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8599999999999999e-07 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720083+0000", 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720089+0000", 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720094+0000", 2024-09-12T05:21:19.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7929999999999997e-06 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767286+0000", 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047191666 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767338+0000", 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2441000000000002e-05 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767394+0000", 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5526000000000003e-05 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80229 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4628480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:19.622 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8435379049999998, 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047505240999999997, 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80229 2024-09-12T05:21:19.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.624 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:19.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727276+0000", 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071757619999999996 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727282+0000", 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7019999999999998e-06 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727293+0000", 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0778000000000001e-05 2024-09-12T05:21:19.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727300+0000", 2024-09-12T05:21:19.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5769999999999996e-06 2024-09-12T05:21:19.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767428+0000", 2024-09-12T05:21:19.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040128193 2024-09-12T05:21:19.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767510+0000", 2024-09-12T05:21:19.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1203000000000002e-05 2024-09-12T05:21:19.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767606+0000", 2024-09-12T05:21:19.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6026000000000005e-05 2024-09-12T05:21:19.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.629 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.630 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80275 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7069696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.630 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:19.630 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8355206830000004, 2024-09-12T05:21:19.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047223138999999997, 2024-09-12T05:21:19.630 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.630 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.630 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.630 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.631 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.631 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.631 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80275 2024-09-12T05:21:19.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.631 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:19.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9399999999999995e-07 2024-09-12T05:21:19.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728120+0000", 2024-09-12T05:21:19.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2879999999999999e-06 2024-09-12T05:21:19.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728127+0000", 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8669999999999996e-06 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728133+0000", 2024-09-12T05:21:19.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775161+0000", 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047027843 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775243+0000", 2024-09-12T05:21:19.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2126999999999995e-05 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775341+0000", 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8189000000000005e-05 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80276 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6742016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8354984300000003, 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047322971999999998, 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80276 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.637 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728506+0000", 2024-09-12T05:21:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036576600000000001 2024-09-12T05:21:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728510+0000", 2024-09-12T05:21:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5689999999999998e-06 2024-09-12T05:21:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728519+0000", 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7190000000000007e-06 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728525+0000", 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775371+0000", 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046846023000000001 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775410+0000", 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8584000000000002e-05 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775463+0000", 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2964999999999999e-05 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80277 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6758400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.835097427, 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047131702999999997, 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80277 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728770+0000", 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228586 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728774+0000", 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728784+0000", 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5249999999999994e-06 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728790+0000", 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6139999999999997e-06 2024-09-12T05:21:19.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775498+0000", 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046708040999999999 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775577+0000", 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8553999999999994e-05 2024-09-12T05:21:19.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775673+0000", 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5644999999999997e-05 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80279 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6856704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8348096739999997, 2024-09-12T05:21:19.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047172124000000003, 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80279 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729026+0000", 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019762800000000001 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729030+0000", 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729039+0000", 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1209999999999996e-06 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729046+0000", 2024-09-12T05:21:19.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3450000000000002e-06 2024-09-12T05:21:19.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775825+0000", 2024-09-12T05:21:19.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046779646000000001 2024-09-12T05:21:19.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775906+0000", 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0337e-05 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776001+0000", 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5047e-05 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80281 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6635520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8345458700000004, 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047239476000000002, 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80281 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729204+0000", 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111247 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729209+0000", 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2979999999999999e-06 2024-09-12T05:21:19.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729220+0000", 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1032e-05 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729228+0000", 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.571e-06 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776155+0000", 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046927340999999997 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776236+0000", 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0551999999999997e-05 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776332+0000", 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6434999999999994e-05 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.657 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80282 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6971392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8343968830000001, 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047211569000000002, 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80282 2024-09-12T05:21:19.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729654+0000", 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000412118 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729662+0000", 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8200000000000003e-06 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729675+0000", 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2996000000000001e-05 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729684+0000", 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1629999999999996e-06 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776362+0000", 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046678450000000003 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776403+0000", 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0627999999999998e-05 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776453+0000", 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0393999999999999e-05 2024-09-12T05:21:19.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80285 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 3104768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8338151739999997, 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047179632999999999, 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.663 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80285 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730008+0000", 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018459999999999999 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730012+0000", 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6090000000000003e-06 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730024+0000", 2024-09-12T05:21:19.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1853e-05 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730033+0000", 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776826+0000", 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046792907000000002 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776908+0000", 2024-09-12T05:21:19.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1981e-05 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777003+0000", 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4712999999999999e-05 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80286 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2441216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730047+0000", 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8335914999999998, 2024-09-12T05:21:19.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047076714999999998, 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80286 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730047+0000", 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730047+0000", 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730201+0000", 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015396400000000001 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730206+0000", 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9080000000000003e-06 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730218+0000", 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2024999999999999e-05 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730225+0000", 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4850000000000003e-06 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777031+0000", 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046805401000000003 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777070+0000", 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9552999999999999e-05 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777124+0000", 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3378999999999998e-05 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80287 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2777088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8333982679999998, 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047092717999999999, 2024-09-12T05:21:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80287 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:19.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730400+0000", 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000159684 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730404+0000", 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2780000000000004e-06 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730412+0000", 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4669999999999998e-06 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730416+0000", 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6609999999999999e-06 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777158+0000", 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046741956000000001 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777236+0000", 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7960999999999994e-05 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777333+0000", 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6711000000000003e-05 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.676 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:19.677 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:19.677 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:19.678 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:19.679 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:19.676+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:19.779 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:19.775+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:19.809 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:19.809 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:19.823 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:19.880 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:19.875+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:19.946 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:19.946 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:19.946 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:19.946 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:19.947 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:19.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:20.006 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:20.004+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:20.051 INFO:teuthology.orchestra.run.smithi059.stdout:3444 trunc from 0x2fa533c to 0x9c1f32e 2024-09-12T05:21:20.073 INFO:teuthology.orchestra.run.smithi059.stdout:3445 read 0x3e5cc14 thru 0x3e698d8 (0xccc5 bytes) 2024-09-12T05:21:20.073 INFO:teuthology.orchestra.run.smithi059.stdout:3446 writesame 0x361d910 thru 0x3622ce2 data_size 0x17(0x53d3 bytes) 2024-09-12T05:21:20.081 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:20.082 INFO:teuthology.orchestra.run.smithi059.stdout:3448 write 0x65c4a49 thru 0x65d19ec (0xcfa4 bytes) 2024-09-12T05:21:20.082 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:20.079+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:20.085 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4530 3.1d 3:b845397b:::rbd_object_map.1118e5842253:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.185743537, 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034828258000000001, 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4530 2024-09-12T05:21:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898324+0000", 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898325+0000", 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898333+0000", 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3200000000000002e-06 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898372+0000", 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9403000000000002e-05 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.898403+0000", 2024-09-12T05:21:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1282999999999998e-05 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925774+0000", 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027371126999999999 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.925885+0000", 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110536 2024-09-12T05:21:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.926372+0000", 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048729900000000001 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.931755+0000", 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053824099999999998 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.932970+0000", 2024-09-12T05:21:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012150799999999999 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933079+0000", 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108736 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.933152+0000", 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3910000000000002e-05 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.021917872000003, 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.021821848999998, 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:21:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.021762545999998, 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:21:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.021705840000003, 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:21:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.020678502000003, 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:21:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.020618644999999, 2024-09-12T05:21:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:21:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:21:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.020530839000003, 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.019848400999997, 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:21:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:21:20.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.019761789, 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:21:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:11057 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 491520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.013079707000003, 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034782517999999998, 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.136 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11057 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070988+0000", 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.070989+0000", 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.268e-06 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071050+0000", 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0294000000000002e-05 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071068+0000", 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8683000000000001e-05 2024-09-12T05:21:20.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.071083+0000", 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5167999999999999e-05 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105540+0000", 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034457039000000002 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105657+0000", 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116248 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.105771+0000", 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113818 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22384 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:20.140 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 39.405645266999997, 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035328432999999999, 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22384 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678423+0000", 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:21:20.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678427+0000", 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999998e-06 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678436+0000", 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8589999999999994e-06 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678444+0000", 2024-09-12T05:21:20.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4959999999999996e-06 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705279+0000", 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026834632000000001 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705520+0000", 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024076100000000001 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.706555+0000", 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001034933 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.710982+0000", 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044268010000000002 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713437+0000", 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024553029999999998 2024-09-12T05:21:20.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713623+0000", 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018639399999999999 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713751+0000", 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012766700000000001 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22385 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 39.405613158999998, 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037690591000000002, 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22385 2024-09-12T05:21:20.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678459+0000", 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7900000000000001e-06 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678468+0000", 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8890000000000008e-06 2024-09-12T05:21:20.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678475+0000", 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8800000000000002e-06 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708857+0000", 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030381907999999999 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708999+0000", 2024-09-12T05:21:20.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014186900000000001 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.709638+0000", 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063908400000000005 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715839+0000", 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062014890000000001 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:20.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715882+0000", 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3188000000000001e-05 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716026+0000", 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014375999999999999 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716145+0000", 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011903700000000001 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22386 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 39.405582967000001, 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040447601, 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.153 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22386 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:20.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678496+0000", 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0623e-05 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678506+0000", 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7890000000000006e-06 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678513+0000", 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1359999999999999e-06 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711185+0000", 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032671814 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711506+0000", 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321417 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.712538+0000", 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010313760000000001 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716256+0000", 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037188350000000002 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718706+0000", 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024499159999999999 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718856+0000", 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015012900000000001 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718932+0000", 2024-09-12T05:21:20.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5926000000000005e-05 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22387 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 39.405543754999997, 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040806824999999998, 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22387 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678525+0000", 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678529+0000", 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678538+0000", 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1060000000000006e-06 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678545+0000", 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0260000000000002e-06 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713870+0000", 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035324960000000002 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714037+0000", 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167381 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714624+0000", 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058681300000000005 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718968+0000", 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043441749999999996 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719059+0000", 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1019000000000004e-05 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719151+0000", 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1157999999999997e-05 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719331+0000", 2024-09-12T05:21:20.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000180201 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23350 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 329728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 39.238730719000003, 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037806736000000001, 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.165 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23350 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:20.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845338+0000", 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845340+0000", 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.289e-06 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845347+0000", 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845353+0000", 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875603+0000", 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030250139999999998 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875670+0000", 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6791999999999993e-05 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.883144+0000", 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007473553 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23729 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 514048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 39.228676331000003, 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035315419000000001, 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23729 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855392+0000", 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:20.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855395+0000", 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855403+0000", 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4980000000000006e-06 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855410+0000", 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6189999999999996e-06 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890120+0000", 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034710795000000003 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890630+0000", 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000509901 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890707+0000", 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6423999999999999e-05 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25449 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:20.174 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.787031228000004, 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036956818000000002, 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25449 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297037+0000", 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-07 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297041+0000", 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297052+0000", 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0866000000000001e-05 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297060+0000", 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7829999999999999e-06 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.327882+0000", 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0308218 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328015+0000", 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133406 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328611+0000", 2024-09-12T05:21:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059631400000000002 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333062+0000", 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044503540000000001 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333708+0000", 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064637699999999995 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333878+0000", 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016978800000000001 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333993+0000", 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115344 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.180 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25659 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.523548388999998, 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035645679, 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25659 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560520+0000", 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560523+0000", 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0520000000000002e-06 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560529+0000", 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1330000000000004e-06 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560534+0000", 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-12T05:21:20.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589658+0000", 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029124035 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589799+0000", 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014103 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.590443+0000", 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064374400000000002 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.592625+0000", 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021819439999999999 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:20.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596057+0000", 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034316820000000001 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596119+0000", 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2811999999999994e-05 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596165+0000", 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5534999999999997e-05 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:54069 3.5 3:a432e2c0:::rbd_data.1118bf17036a.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.657132437000001, 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037526320000000002, 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 54069 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426936+0000", 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431511+0000", 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045748780000000001 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431528+0000", 2024-09-12T05:21:20.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7353000000000001e-05 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431546+0000", 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.825e-05 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431625+0000", 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8514000000000001e-05 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431706+0000", 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1582999999999995e-05 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.432261+0000", 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000554997 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.450928+0000", 2024-09-12T05:21:20.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018666187000000001 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464396+0000", 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013468707 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464436+0000", 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9338000000000002e-05 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:20.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464462+0000", 2024-09-12T05:21:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5891999999999999e-05 2024-09-12T05:21:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:20.193 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:20.193 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:20.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:20.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:20.196 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:20.192+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3449 punch from 0x618592e to 0x6187c78, (0x234a bytes) 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3450 write 0x601b5a7 thru 0x602446e (0x8ec8 bytes) 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3451 trunc from 0x9c1f32e to 0x5daa96b 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3452 writesame 0x1f2368b thru 0x1f237e1 data_size 0x1(0x157 bytes) 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3453 write 0x2354352 thru 0x2356eb7 (0x2b66 bytes) 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3454 write 0x9b7afcb thru 0x9b7c8ac (0x18e2 bytes) 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3455 write 0x4e143f9 thru 0x4e1a26e (0x5e76 bytes) 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3456 punch from 0x819e6d2 to 0x81ad55e, (0xee8c bytes) 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3459 punch from 0x4d36ecb to 0x4d419db, (0xab10 bytes) 2024-09-12T05:21:20.197 INFO:teuthology.orchestra.run.smithi059.stdout:3460 read 0x6ee7105 thru 0x6ef0f0b (0x9e07 bytes) 2024-09-12T05:21:20.198 INFO:teuthology.orchestra.run.smithi059.stdout:3461 trunc from 0x9b7c8ad to 0x4a58f38 2024-09-12T05:21:20.217 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:20.218 INFO:teuthology.orchestra.run.smithi059.stdout:3464 writesame 0x24c8558 thru 0x24cff54 data_size 0x11(0x79fd bytes) 2024-09-12T05:21:20.222 INFO:teuthology.orchestra.run.smithi059.stdout:3465 read 0x46eff7a thru 0x46f4970 (0x49f7 bytes) 2024-09-12T05:21:20.222 INFO:teuthology.orchestra.run.smithi059.stdout:3467 write 0x1bd1554 thru 0x1bd8547 (0x6ff4 bytes) 2024-09-12T05:21:20.225 INFO:teuthology.orchestra.run.smithi059.stdout:3468 punch from 0x47ceb83 to 0x47da856, (0xbcd3 bytes) 2024-09-12T05:21:20.225 INFO:teuthology.orchestra.run.smithi059.stdout:3469 read 0x831749 thru 0x83f807 (0xe0bf bytes) 2024-09-12T05:21:20.226 INFO:teuthology.orchestra.run.smithi059.stdout:3470 read 0x538092 thru 0x53bd23 (0x3c92 bytes) 2024-09-12T05:21:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:3472 clone 27 order 19 su 262144 sc 9 2024-09-12T05:21:20.296 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:20.291+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:20.354 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:20.372 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:20.374 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:20.374 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:20.374 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:20.374 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:20.388 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:20.394 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:20.394 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:20.412 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:20.413 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:20.413 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:20.423 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:21:20.423 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:20.424 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-12T05:21:20.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 2 2024-09-12T05:21:20.432 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:20.433 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:20.433 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:20.432+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:20.434 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone26 2024-09-12T05:21:20.453 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:20.474 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:20.478 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:20.479 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:20.512 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:20.512 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:20.525 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:20.523+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:20.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:20.538 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-12T05:21:20.556 INFO:teuthology.orchestra.run.smithi059.stdout:3473 write 0x6592a5e thru 0x65a16b0 (0xec53 bytes) 2024-09-12T05:21:20.566 INFO:teuthology.orchestra.run.smithi059.stdout:3475 writesame 0x714fae4 thru 0x71540af data_size 0x6(0x45cc bytes) 2024-09-12T05:21:20.567 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:20.567 INFO:teuthology.orchestra.run.smithi059.stdout:3480 writesame 0x5e62f5d thru 0x5e6fe7e data_size 0x1(0xcf22 bytes) 2024-09-12T05:21:20.598 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:20.595+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:20.652 INFO:teuthology.orchestra.run.smithi059.stdout:3481 write 0xc18f07c thru 0xc197025 (0x7faa bytes) 2024-09-12T05:21:20.672 INFO:teuthology.orchestra.run.smithi059.stdout:3482 write 0xd18a7c8 thru 0xd18c77c (0x1fb5 bytes) 2024-09-12T05:21:20.680 INFO:teuthology.orchestra.run.smithi059.stdout:3483 read 0x71d0073 thru 0x71d9ed3 (0x9e61 bytes) 2024-09-12T05:21:20.680 INFO:teuthology.orchestra.run.smithi059.stdout:3485 write 0x91c55a2 thru 0x91c8ad1 (0x3530 bytes) 2024-09-12T05:21:20.688 INFO:teuthology.orchestra.run.smithi059.stdout:3486 write 0x592b24c thru 0x592f6b9 (0x446e bytes) 2024-09-12T05:21:20.688 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:20.688 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:20.696 INFO:teuthology.orchestra.run.smithi059.stdout:3487 writesame 0x22d67a2 thru 0x22e5940 data_size 0x59(0xf19f bytes) 2024-09-12T05:21:20.699 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:20.695+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:20.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:20.714 INFO:teuthology.orchestra.run.smithi059.stdout:3488 trunc from 0xd18c77d to 0x7c4ac81 2024-09-12T05:21:20.736 INFO:teuthology.orchestra.run.smithi059.stdout:3489 writesame 0x5f0186b thru 0x5f080d1 data_size 0x3b(0x6867 bytes) 2024-09-12T05:21:20.743 INFO:teuthology.orchestra.run.smithi059.stdout:3491 read 0x4f13cfa thru 0x4f1bdb4 (0x80bb bytes) 2024-09-12T05:21:20.743 INFO:teuthology.orchestra.run.smithi059.stdout:3492 read 0xf0343f thru 0xf07b05 (0x46c7 bytes) 2024-09-12T05:21:20.744 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:20.744 INFO:teuthology.orchestra.run.smithi059.stdout:3494 clone 28 order 24 su 8388608 sc 6 2024-09-12T05:21:20.775 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-12T05:21:20.771+0000 7f6402832640 -1 mon.a@0(leader).osd e73 definitely_dead 0 2024-09-12T05:21:20.800 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:20.795+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:20.828 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:20.828 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:20.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:20.901 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:20.899+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:20.960 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:20.960 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:20.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:21.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:21.020+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:21.092 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:21.092 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:21.102 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:21.099+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:21.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:21.203 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:21.199+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:21.242 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:21.242 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:21.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:21.303 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:21.304+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:21.329 INFO:teuthology.orchestra.run.smithi059.stderr:marked out osd.2. 2024-09-12T05:21:21.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:21:21.409 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:21.407+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:21.425 INFO:teuthology.orchestra.run.smithi059.stdout:leaving image image_client.0-clone27 intact 2024-09-12T05:21:21.445 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:21.445 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:21.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:21.505 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:21.500+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:21.553 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-12T05:21:21.605 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:21.603+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:21.630 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:21.630 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:21.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:21.690 INFO:teuthology.orchestra.run.smithi059.stdout:3497 punch from 0x7306f52 to 0x730f227, (0x82d5 bytes) 2024-09-12T05:21:21.695 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:21.696 INFO:teuthology.orchestra.run.smithi059.stdout:3499 read 0x15bc820 thru 0x15c8041 (0xb822 bytes) 2024-09-12T05:21:21.696 INFO:teuthology.orchestra.run.smithi059.stdout:3500 write 0x2267cb8 thru 0x2275680 (0xd9c9 bytes) 2024-09-12T05:21:21.706 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:21.704+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:21.731 INFO:teuthology.orchestra.run.smithi059.stdout:3502 write 0x3898086 thru 0x389f071 (0x6fec bytes) 2024-09-12T05:21:21.807 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:21.808+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:21.810 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:21.810 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:21.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:21.913 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:21.911+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:21.997 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:21.998 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:22.009 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:22.007+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:22.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:22.110 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:22.108+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:22.179 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:22.179 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:22.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:22.241 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:22.239+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:22.312 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:22.307+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:22.323 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:22.323 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:22.331 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:21:22.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:22.413 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:22.412+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:22.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:22.525 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:22.525 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:22.525 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:22.523+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:22.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:22.628 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:22.628 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:22.628 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:22.623+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:22.645 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:22.645 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:22.664 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:22.680 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:22.681 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:22.681 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:22.702 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:22.702 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:22.708 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 61.730508288999999, 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.709 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:21:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 56.818875972000001, 2024-09-12T05:21:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 56.436175488000003, 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:21:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.724 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 56.202131841000003, 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:21:22.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:21:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 56.17200751, 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.730 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:21:22.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.609919728999998, 2024-09-12T05:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:21:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:21:22.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.740 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.607965511000003, 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:21:22.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.745 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.666656777, 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:21:22.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:21:22.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.650060183999997, 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.751 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:21:22.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:21:22.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:22.756 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 45.479720743999998, 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:21:22.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.601266492000001, 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:22.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:22.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:21:22.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.601221398, 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.767 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:22.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:21:22.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.592659836999999, 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:21:22.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.790621678000001, 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:21:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.276498239999999, 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:21:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:21:22.787 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.268412147999999, 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:21:22.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:22.792 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.366225901, 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:21:22.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:22.798 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.38882598, 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:21:22.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.6366790000000009, 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:21:22.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:21:22.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.2774292689999998, 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:22.810 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:21:22.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:21:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:22.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:22.815 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:22.817 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:22.817 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:22.818 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:22.818 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:22.819 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:22.819 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:22.819 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:22.819 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:22.815+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:22.918 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:22.915+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:22.993 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:22.994 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:22.994 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:22.994 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:23.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:23.019 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:23.020+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:23.120 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:23.120+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:23.182 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:23.182 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:23.182 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:23.182 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:23.182 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:23.196 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:23.221 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:23.220+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:23.322 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:23.320+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80148 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6594560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6112758090000003, 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047081795000000003, 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80148 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712493+0000", 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8299999999999997e-07 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712495+0000", 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3099999999999999e-06 2024-09-12T05:21:23.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712504+0000", 2024-09-12T05:21:23.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5290000000000008e-06 2024-09-12T05:21:23.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712509+0000", 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4480000000000002e-06 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759399+0000", 2024-09-12T05:21:23.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046889693000000003 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759478+0000", 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9040000000000002e-05 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759574+0000", 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6292000000000006e-05 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80149 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7028736~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6112301349999996, 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047236827000000002, 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80149 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712539+0000", 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712542+0000", 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9639999999999999e-06 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712550+0000", 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7709999999999995e-06 2024-09-12T05:21:23.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712556+0000", 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6380000000000001e-06 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759608+0000", 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047051754000000001 2024-09-12T05:21:23.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759684+0000", 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6784000000000002e-05 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759775+0000", 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000001e-05 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80150 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6701056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6112028980000002, 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047422082999999997, 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80150 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.336 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713023+0000", 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00045808399999999999 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713028+0000", 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7849999999999999e-06 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713039+0000", 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0530000000000001e-05 2024-09-12T05:21:23.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713046+0000", 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2710000000000003e-06 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759807+0000", 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046761182999999998 2024-09-12T05:21:23.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759887+0000", 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9709999999999994e-05 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759987+0000", 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010052000000000001 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80151 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7036928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6107085259999998, 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047137710999999999, 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80151 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:21:23.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713063+0000", 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7460000000000001e-06 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713071+0000", 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6159999999999996e-06 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713077+0000", 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:21:23.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760020+0000", 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046943358999999997 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760098+0000", 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7519000000000001e-05 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760197+0000", 2024-09-12T05:21:23.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9778000000000006e-05 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80152 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6709248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6106825740000001, 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047326518999999997, 2024-09-12T05:21:23.346 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80152 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713245+0000", 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015924600000000001 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713249+0000", 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3379999999999998e-06 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713265+0000", 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6184e-05 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713271+0000", 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6670000000000001e-06 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760231+0000", 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046960285999999997 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760311+0000", 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9643999999999998e-05 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760412+0000", 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101154 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.350 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80153 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6799360~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6104874080000009, 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047341640999999997, 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.351 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80153 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713474+0000", 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192898 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713477+0000", 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3890000000000001e-06 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713487+0000", 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713494+0000", 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4540000000000001e-06 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760444+0000", 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046949957 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760526+0000", 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1361999999999998e-05 2024-09-12T05:21:23.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760622+0000", 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6587000000000002e-05 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80154 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8413184~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6102614099999997, 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047319877000000003, 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.355 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80154 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713977+0000", 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00047076399999999998 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713985+0000", 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8790000000000003e-06 2024-09-12T05:21:23.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713996+0000", 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.113e-05 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714003+0000", 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8979999999999999e-06 2024-09-12T05:21:23.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760655+0000", 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046651821000000003 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760734+0000", 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9208999999999993e-05 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760827+0000", 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2176000000000007e-05 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80156 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8503296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6097268929999995, 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047199342999999998, 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.360 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80156 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719243+0000", 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052018419999999999 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719248+0000", 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1760000000000001e-06 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719261+0000", 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3045e-05 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719269+0000", 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1130000000000001e-06 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761068+0000", 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041798096999999999 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761148+0000", 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0301000000000002e-05 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761241+0000", 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769000000000006e-05 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.364 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80227 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4956160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6037095200000007, 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047195107, 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80227 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4900000000000001e-07 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720061+0000", 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0980000000000001e-06 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720068+0000", 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.007e-06 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720074+0000", 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767070+0000", 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046996653999999999 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767150+0000", 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9919000000000005e-05 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767254+0000", 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103639 2024-09-12T05:21:23.368 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80228 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 5718016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6036876699999993, 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047313252, 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.369 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80228 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720081+0000", 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8599999999999999e-07 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720083+0000", 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720089+0000", 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720094+0000", 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7929999999999997e-06 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767286+0000", 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047191666 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767338+0000", 2024-09-12T05:21:23.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2441000000000002e-05 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767394+0000", 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5526000000000003e-05 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80229 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4628480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6036676629999995, 2024-09-12T05:21:23.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047505240999999997, 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80229 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:23.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727276+0000", 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071757619999999996 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727282+0000", 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7019999999999998e-06 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727293+0000", 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0778000000000001e-05 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727300+0000", 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5769999999999996e-06 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767428+0000", 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040128193 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767510+0000", 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1203000000000002e-05 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767606+0000", 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6026000000000005e-05 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.377 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80275 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7069696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5956504410000001, 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047223138999999997, 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80275 2024-09-12T05:21:23.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9399999999999995e-07 2024-09-12T05:21:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728120+0000", 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2879999999999999e-06 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728127+0000", 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8669999999999996e-06 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728133+0000", 2024-09-12T05:21:23.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775161+0000", 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047027843 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775243+0000", 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2126999999999995e-05 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775341+0000", 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8189000000000005e-05 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80276 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6742016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5956281879999992, 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047322971999999998, 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80276 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728506+0000", 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036576600000000001 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728510+0000", 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5689999999999998e-06 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728519+0000", 2024-09-12T05:21:23.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7190000000000007e-06 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728525+0000", 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775371+0000", 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046846023000000001 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775410+0000", 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8584000000000002e-05 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775463+0000", 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2964999999999999e-05 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80277 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6758400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5952271850000006, 2024-09-12T05:21:23.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047131702999999997, 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80277 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728770+0000", 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228586 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728774+0000", 2024-09-12T05:21:23.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728784+0000", 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5249999999999994e-06 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728790+0000", 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6139999999999997e-06 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775498+0000", 2024-09-12T05:21:23.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046708040999999999 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775577+0000", 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8553999999999994e-05 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775673+0000", 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5644999999999997e-05 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80279 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6856704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5949394320000003, 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047172124000000003, 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80279 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.391 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729026+0000", 2024-09-12T05:21:23.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019762800000000001 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729030+0000", 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729039+0000", 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1209999999999996e-06 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729046+0000", 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3450000000000002e-06 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775825+0000", 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046779646000000001 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775906+0000", 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0337e-05 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776001+0000", 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5047e-05 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80281 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6635520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5946756279999992, 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047239476000000002, 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.395 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80281 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729204+0000", 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111247 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729209+0000", 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2979999999999999e-06 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729220+0000", 2024-09-12T05:21:23.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1032e-05 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729228+0000", 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.571e-06 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776155+0000", 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046927340999999997 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776236+0000", 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0551999999999997e-05 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776332+0000", 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6434999999999994e-05 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80282 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6971392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:23.399 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5945266409999999, 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047211569000000002, 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80282 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729654+0000", 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000412118 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729662+0000", 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8200000000000003e-06 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729675+0000", 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2996000000000001e-05 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729684+0000", 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1629999999999996e-06 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776362+0000", 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046678450000000003 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776403+0000", 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0627999999999998e-05 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776453+0000", 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0393999999999999e-05 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.403 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80285 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 3104768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5939449319999994, 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047179632999999999, 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.404 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80285 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730008+0000", 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018459999999999999 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730012+0000", 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6090000000000003e-06 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730024+0000", 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1853e-05 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730033+0000", 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776826+0000", 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046792907000000002 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776908+0000", 2024-09-12T05:21:23.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1981e-05 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777003+0000", 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4712999999999999e-05 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80286 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2441216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730047+0000", 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5937212580000004, 2024-09-12T05:21:23.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047076714999999998, 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80286 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730047+0000", 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730047+0000", 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730201+0000", 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015396400000000001 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730206+0000", 2024-09-12T05:21:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9080000000000003e-06 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730218+0000", 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2024999999999999e-05 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730225+0000", 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4850000000000003e-06 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777031+0000", 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046805401000000003 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777070+0000", 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9552999999999999e-05 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777124+0000", 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3378999999999998e-05 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.412 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80287 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2777088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.5935280259999995, 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047092717999999999, 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80287 2024-09-12T05:21:23.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730400+0000", 2024-09-12T05:21:23.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000159684 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730404+0000", 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2780000000000004e-06 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730412+0000", 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4669999999999998e-06 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730416+0000", 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6609999999999999e-06 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777158+0000", 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046741956000000001 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777236+0000", 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7960999999999994e-05 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:23.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:23.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777333+0000", 2024-09-12T05:21:23.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6711000000000003e-05 2024-09-12T05:21:23.417 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.417 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.417 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.417 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:23.417 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:23.417 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:23.418 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:23.436 INFO:teuthology.orchestra.run.smithi059.stdout:3504 write 0x7456a70 thru 0x745a567 (0x3af8 bytes) 2024-09-12T05:21:23.444 INFO:teuthology.orchestra.run.smithi059.stdout:3505 read 0x257746e thru 0x258720b (0xfd9e bytes) 2024-09-12T05:21:23.449 INFO:teuthology.orchestra.run.smithi059.stdout:3507 punch from 0x71b03a1 to 0x71b9bc1, (0x9820 bytes) 2024-09-12T05:21:23.450 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:23.450 INFO:teuthology.orchestra.run.smithi059.stdout:3510 punch from 0x3bbff8b to 0x3bc19e2, (0x1a57 bytes) 2024-09-12T05:21:23.450 INFO:teuthology.orchestra.run.smithi059.stdout:3511 write 0x3b7f661 thru 0x3b8205f (0x29ff bytes) 2024-09-12T05:21:23.453 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:23.453 INFO:teuthology.orchestra.run.smithi059.stdout:3514 writesame 0x67ebcbb thru 0x67ec2b7 data_size 0x3(0x5fd bytes) 2024-09-12T05:21:23.464 INFO:teuthology.orchestra.run.smithi059.stdout:3515 write 0x6500ec3 thru 0x65038c8 (0x2a06 bytes) 2024-09-12T05:21:23.467 INFO:teuthology.orchestra.run.smithi059.stdout:3517 write 0x28d8850 thru 0x28e450d (0xbcbe bytes) 2024-09-12T05:21:23.469 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:23.468+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:23.525 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:23.523+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:23.549 INFO:teuthology.orchestra.run.smithi059.stdout:3518 read 0x71af34c thru 0x71b41ac (0x4e61 bytes) 2024-09-12T05:21:23.557 INFO:teuthology.orchestra.run.smithi059.stdout:3521 trunc from 0x7c4ac81 to 0xa327a2f 2024-09-12T05:21:23.571 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:23.571 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:23.575 INFO:teuthology.orchestra.run.smithi059.stdout:3522 write 0x688372 thru 0x68cb67 (0x47f6 bytes) 2024-09-12T05:21:23.587 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:23.626 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:23.623+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:23.672 INFO:teuthology.orchestra.run.smithi059.stdout:3523 write 0x8f5b83c thru 0x8f61ddb (0x65a0 bytes) 2024-09-12T05:21:23.678 INFO:teuthology.orchestra.run.smithi059.stdout:3524 read 0x4542002 thru 0x454ef3c (0xcf3b bytes) 2024-09-12T05:21:23.696 INFO:teuthology.orchestra.run.smithi059.stdout:3525 trunc from 0xa327a2f to 0x22c9aa6 2024-09-12T05:21:23.726 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:23.723+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:23.768 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:23.768 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:23.768 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:23.768 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:23.768 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:23.778 INFO:teuthology.orchestra.run.smithi059.stdout:3526 read 0x15cba0b thru 0x15d5e8e (0xa484 bytes) 2024-09-12T05:21:23.779 INFO:teuthology.orchestra.run.smithi059.stdout:3527 read 0x2192b64 thru 0x21984e4 (0x5981 bytes) 2024-09-12T05:21:23.780 INFO:teuthology.orchestra.run.smithi059.stdout:3528 write 0x94a53 thru 0x99355 (0x4903 bytes) 2024-09-12T05:21:23.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:23.822 INFO:teuthology.orchestra.run.smithi059.stdout:3531 writesame 0xb553368 thru 0xb55aba5 data_size 0x1(0x783e bytes) 2024-09-12T05:21:23.823 INFO:teuthology.orchestra.run.smithi059.stdout:3532 writesame 0xa5ee54d thru 0xa5f2662 data_size 0x3(0x4116 bytes) 2024-09-12T05:21:23.829 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:23.828+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:23.833 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:23.833 INFO:teuthology.orchestra.run.smithi059.stdout:3535 punch from 0xabd0d19 to 0xabda86c, (0x9b53 bytes) 2024-09-12T05:21:23.833 INFO:teuthology.orchestra.run.smithi059.stdout:3536 clone 29 order 18 su 65536 sc 4 2024-09-12T05:21:23.921 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.857245724999999, 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:21:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:21:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.857149702000001, 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:21:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.857090399000001, 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:21:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:21:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:21:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.857033692999998, 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.856006354999998, 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.855946498000002, 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:21:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:21:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.855858691999998, 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.855176254, 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:21:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:21:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.855089642000003, 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22384 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.24097312, 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035328432999999999, 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22384 2024-09-12T05:21:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678423+0000", 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678427+0000", 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999998e-06 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678436+0000", 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8589999999999994e-06 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678444+0000", 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4959999999999996e-06 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705279+0000", 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026834632000000001 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705520+0000", 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024076100000000001 2024-09-12T05:21:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.706555+0000", 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001034933 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.710982+0000", 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044268010000000002 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713437+0000", 2024-09-12T05:21:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024553029999999998 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713623+0000", 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018639399999999999 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713751+0000", 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012766700000000001 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22385 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.240941012, 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037690591000000002, 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22385 2024-09-12T05:21:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678459+0000", 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7900000000000001e-06 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678468+0000", 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8890000000000008e-06 2024-09-12T05:21:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678475+0000", 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8800000000000002e-06 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708857+0000", 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030381907999999999 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708999+0000", 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014186900000000001 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.709638+0000", 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063908400000000005 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715839+0000", 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062014890000000001 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715882+0000", 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3188000000000001e-05 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716026+0000", 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014375999999999999 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716145+0000", 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011903700000000001 2024-09-12T05:21:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22386 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.240910820000003, 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040447601, 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22386 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678496+0000", 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0623e-05 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678506+0000", 2024-09-12T05:21:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7890000000000006e-06 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678513+0000", 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1359999999999999e-06 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711185+0000", 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032671814 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711506+0000", 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321417 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.712538+0000", 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010313760000000001 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716256+0000", 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037188350000000002 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718706+0000", 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024499159999999999 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718856+0000", 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015012900000000001 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718932+0000", 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5926000000000005e-05 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22387 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.240871607999999, 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040806824999999998, 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22387 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678525+0000", 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678529+0000", 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678538+0000", 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1060000000000006e-06 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678545+0000", 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0260000000000002e-06 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713870+0000", 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035324960000000002 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714037+0000", 2024-09-12T05:21:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167381 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714624+0000", 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058681300000000005 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718968+0000", 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043441749999999996 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719059+0000", 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1019000000000004e-05 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719151+0000", 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1157999999999997e-05 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719331+0000", 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000180201 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23350 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 329728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074058571999998, 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037806736000000001, 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23350 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845338+0000", 2024-09-12T05:21:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845340+0000", 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.289e-06 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845347+0000", 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845353+0000", 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875603+0000", 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030250139999999998 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875670+0000", 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6791999999999993e-05 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.883144+0000", 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007473553 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23729 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 514048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.064004183999998, 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035315419000000001, 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23729 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855392+0000", 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855395+0000", 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855403+0000", 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4980000000000006e-06 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855410+0000", 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6189999999999996e-06 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890120+0000", 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034710795000000003 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890630+0000", 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000509901 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890707+0000", 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6423999999999999e-05 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25449 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.622359080999999, 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036956818000000002, 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25449 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297037+0000", 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-07 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297041+0000", 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297052+0000", 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0866000000000001e-05 2024-09-12T05:21:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297060+0000", 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7829999999999999e-06 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.327882+0000", 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0308218 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328015+0000", 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133406 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328611+0000", 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059631400000000002 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333062+0000", 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044503540000000001 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333708+0000", 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064637699999999995 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333878+0000", 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016978800000000001 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333993+0000", 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115344 2024-09-12T05:21:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25659 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 42.358876242000001, 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035645679, 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25659 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560520+0000", 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560523+0000", 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0520000000000002e-06 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560529+0000", 2024-09-12T05:21:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1330000000000004e-06 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560534+0000", 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589658+0000", 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029124035 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589799+0000", 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014103 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.590443+0000", 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064374400000000002 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.592625+0000", 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021819439999999999 2024-09-12T05:21:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596057+0000", 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034316820000000001 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596119+0000", 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2811999999999994e-05 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596165+0000", 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5534999999999997e-05 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:54069 3.5 3:a432e2c0:::rbd_data.1118bf17036a.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.49246029, 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037526320000000002, 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 54069 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426936+0000", 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431511+0000", 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045748780000000001 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431528+0000", 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7353000000000001e-05 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431546+0000", 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.825e-05 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431625+0000", 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8514000000000001e-05 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431706+0000", 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1582999999999995e-05 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.432261+0000", 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000554997 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.450928+0000", 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018666187000000001 2024-09-12T05:21:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464396+0000", 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013468707 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464436+0000", 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9338000000000002e-05 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464462+0000", 2024-09-12T05:21:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5891999999999999e-05 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83561 3.4 e76/75 3:27947d04:::rbd_data.11182b429d69.0000000000000001:head v 76'345, mlcod=0'0)", 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.366880+0000", 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.55251563199999998, 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070455441999999993, 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.366880+0000", 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.366880+0000", 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.366880+0000", 2024-09-12T05:21:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1699999999999998e-07 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.388917+0000", 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022036304999999999 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.388950+0000", 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3321999999999997e-05 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.388968+0000", 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.389088+0000", 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119611 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.389148+0000", 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9839000000000001e-05 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.437270+0000", 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.048121917 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.437335+0000", 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5617999999999994e-05 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:83773 3.16 3:69307a13:::rbd_data.11182b429d69.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.726105+0000", 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.19329021499999999, 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042537460999999999, 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 83773 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.726105+0000", 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.726105+0000", 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.726107+0000", 2024-09-12T05:21:24.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736089+0000", 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099821630000000005 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736108+0000", 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8875000000000001e-05 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736118+0000", 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3559999999999999e-06 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736182+0000", 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4660999999999996e-05 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736337+0000", 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015453999999999999 2024-09-12T05:21:24.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.737218+0000", 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00088130700000000001 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.763903+0000", 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026684787000000001 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:24.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.768540+0000", 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046372999999999996 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.768590+0000", 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9849000000000003e-05 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.768643+0000", 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2710000000000002e-05 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.024 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.025 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.025 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.025 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.025 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:24.026 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:24.027 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:24.024+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:24.127 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:24.123+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:24.197 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:24.197 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:24.211 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:24.257 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:24.256+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:24.330 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:24.328+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:24.332 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:24.332 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:24.332 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:24.332 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:24.332 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:24.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:24.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:21:24.430 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:24.427+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:24.520 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:24.520 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:24.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.347080702, 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:21:24.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.346379182, 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:21:24.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.346256447999998, 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:21:24.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.346194234999999, 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:21:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.346127418000002, 2024-09-12T05:21:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:21:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:21:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.346067384999998, 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345987448999999, 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:21:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345927887999999, 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:21:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345853099000003, 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:21:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:21:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345715699000003, 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:21:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345563964, 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:21:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345500989999998, 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:21:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:21:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345365098000002, 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345301138000004, 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:21:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345216884999999, 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345157524999998, 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:21:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345097258000003, 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:21:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.345034265000002, 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:21:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:21:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.344873657000001, 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.901641943, 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:21:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:21:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:21:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.612 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:24.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:24.614 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:24.612+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:24.715 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:24.712+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:24.783 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:83864 3.9 3.f33e029 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:24.439575+0000", 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.345797674, 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.34583968999999998, 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:24.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 83864 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:24.439575+0000", 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:24.439575+0000", 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:24.439577+0000", 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.934e-06 2024-09-12T05:21:24.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:24.439588+0000", 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0393e-05 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:24.439616+0000", 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8322000000000001e-05 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:24.439631+0000", 2024-09-12T05:21:24.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4817000000000001e-05 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:24.439726+0000", 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5390999999999995e-05 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:24.439737+0000", 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1404e-05 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:24.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-12T05:21:24.789 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-09-12T05:21:24.789 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:24.798 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:24.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:24.841 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:24.840+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:24.917 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:24.916+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:24.966 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:24.967 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:24.967 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:24.967 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:24.967 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:24.977 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:24.978 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:24.982 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:24.996 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:24.996 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:25.013 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:25.013 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:25.018 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:25.015+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:25.122 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:25.119+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.275974602000005, 2024-09-12T05:21:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.10902002500000001, 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878726+0000", 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878741+0000", 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4696e-05 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878767+0000", 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5812999999999998e-05 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878789+0000", 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.179e-05 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878868+0000", 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9116999999999995e-05 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878878+0000", 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8549999999999997e-06 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.984853+0000", 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.105974939 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985185+0000", 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000332827 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985604+0000", 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000418477 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.986868+0000", 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001264004 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987594+0000", 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072604400000000002 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987679+0000", 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4826000000000004e-05 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987744+0000", 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4716999999999997e-05 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4322 3.13 3:ceb672dc:::rbd_data.1118e5842253.0000000000000068:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.513304716, 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056729952, 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4322 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641396+0000", 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0970000000000002e-06 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641409+0000", 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.291e-05 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641440+0000", 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0380000000000001e-05 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641456+0000", 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5906999999999999e-05 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641572+0000", 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116452 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641803+0000", 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000230671 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.651415+0000", 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096118660000000002 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697868+0000", 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046453047999999997 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697904+0000", 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6313000000000003e-05 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697997+0000", 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3356000000000005e-05 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.698123+0000", 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125952 2024-09-12T05:21:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22118 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1982464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.988195918999999, 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052766258000000003, 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22118 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166503+0000", 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1629999999999999e-06 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166508+0000", 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166526+0000", 2024-09-12T05:21:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7699000000000001e-05 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166540+0000", 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4286e-05 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219002+0000", 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052461397999999999 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219106+0000", 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104694 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219268+0000", 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000162015 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22161 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.988138425000002, 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052998134000000002, 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22161 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166561+0000", 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166566+0000", 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5860000000000004e-06 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166584+0000", 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166598+0000", 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3665999999999999e-05 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219347+0000", 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052748841999999997 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219439+0000", 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2453000000000004e-05 2024-09-12T05:21:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219558+0000", 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011851800000000001 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22163 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.988080815000004, 2024-09-12T05:21:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053262859000000003, 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22163 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166618+0000", 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1659999999999999e-06 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166624+0000", 2024-09-12T05:21:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3299999999999998e-06 2024-09-12T05:21:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166641+0000", 2024-09-12T05:21:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7016000000000001e-05 2024-09-12T05:21:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166655+0000", 2024-09-12T05:21:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4358999999999999e-05 2024-09-12T05:21:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219631+0000", 2024-09-12T05:21:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052976286999999997 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219740+0000", 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108663 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219880+0000", 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014003799999999999 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22165 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 491520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.988023165000001, 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.05349143, 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22165 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166677+0000", 2024-09-12T05:21:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-06 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166682+0000", 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166706+0000", 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4063e-05 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166721+0000", 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4851999999999999e-05 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219948+0000", 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053227479000000001 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220029+0000", 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0564999999999999e-05 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220166+0000", 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013738499999999999 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22167 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 720896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.987955755000002, 2024-09-12T05:21:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053842714, 2024-09-12T05:21:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22167 2024-09-12T05:21:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166744+0000", 2024-09-12T05:21:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166750+0000", 2024-09-12T05:21:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0499999999999997e-06 2024-09-12T05:21:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166768+0000", 2024-09-12T05:21:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7918999999999999e-05 2024-09-12T05:21:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166781+0000", 2024-09-12T05:21:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3784999999999999e-05 2024-09-12T05:21:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220258+0000", 2024-09-12T05:21:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053476165999999999 2024-09-12T05:21:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220447+0000", 2024-09-12T05:21:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018942699999999999 2024-09-12T05:21:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220585+0000", 2024-09-12T05:21:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013815 2024-09-12T05:21:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22168 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 950272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.987897695000001, 2024-09-12T05:21:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054040510999999999, 2024-09-12T05:21:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22168 2024-09-12T05:21:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166802+0000", 2024-09-12T05:21:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:21:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166807+0000", 2024-09-12T05:21:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1460000000000004e-06 2024-09-12T05:21:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166828+0000", 2024-09-12T05:21:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0752999999999999e-05 2024-09-12T05:21:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166842+0000", 2024-09-12T05:21:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4405e-05 2024-09-12T05:21:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220648+0000", 2024-09-12T05:21:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053806172999999999 2024-09-12T05:21:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220728+0000", 2024-09-12T05:21:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0175999999999999e-05 2024-09-12T05:21:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220841+0000", 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011250400000000001 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22170 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1048576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.987836203999997, 2024-09-12T05:21:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054240254000000002, 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22170 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166863+0000", 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166868+0000", 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2000000000000002e-06 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166886+0000", 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7462e-05 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166899+0000", 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3059e-05 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220904+0000", 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054004732999999999 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221006+0000", 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102895 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221102+0000", 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22172 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1277952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.987780117, 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054417, 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22172 2024-09-12T05:21:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166919+0000", 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.173e-06 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166925+0000", 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166942+0000", 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7246000000000001e-05 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166957+0000", 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4419e-05 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221168+0000", 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054211102999999997 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221251+0000", 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2956999999999999e-05 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221335+0000", 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4122000000000005e-05 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22174 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.987722679999997, 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054612105000000001, 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22174 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166977+0000", 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.156e-06 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166982+0000", 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167000+0000", 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7336000000000001e-05 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167013+0000", 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3106e-05 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221400+0000", 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054387255000000002 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221493+0000", 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3117999999999999e-05 2024-09-12T05:21:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221588+0000", 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4524000000000005e-05 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22176 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.987664293000002, 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054762312, 2024-09-12T05:21:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22176 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167035+0000", 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167064+0000", 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459e-05 2024-09-12T05:21:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167098+0000", 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4041000000000002e-05 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167156+0000", 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7401000000000002e-05 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221640+0000", 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054484170999999998 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221714+0000", 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4345999999999996e-05 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221796+0000", 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1757999999999999e-05 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22178 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.987517644, 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054845368999999998, 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22178 2024-09-12T05:21:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167182+0000", 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167189+0000", 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.81e-06 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167221+0000", 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2400999999999997e-05 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167237+0000", 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5693e-05 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221845+0000", 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054608139 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221934+0000", 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9586000000000006e-05 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.222026+0000", 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1466999999999997e-05 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:55996 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.456683721000001, 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054112130000000001, 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 55996 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698015+0000", 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.82e-07 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698017+0000", 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1799999999999999e-06 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698024+0000", 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5830000000000003e-06 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698028+0000", 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7299999999999996e-06 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748691+0000", 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050662709 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748758+0000", 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6920000000000003e-05 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752127+0000", 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033684259999999999 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56145 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.451149182000002, 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053461886, 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56145 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703552+0000", 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3879999999999998e-06 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703559+0000", 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5059999999999998e-06 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703565+0000", 2024-09-12T05:21:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.964e-06 2024-09-12T05:21:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752009+0000", 2024-09-12T05:21:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.048444050000000002 2024-09-12T05:21:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752076+0000", 2024-09-12T05:21:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7083999999999997e-05 2024-09-12T05:21:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757011+0000", 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049343850000000003 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56146 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.451125040000001, 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053664649000000002, 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56146 2024-09-12T05:21:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703574+0000", 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5699999999999998e-07 2024-09-12T05:21:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703581+0000", 2024-09-12T05:21:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5560000000000002e-06 2024-09-12T05:21:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703589+0000", 2024-09-12T05:21:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4420000000000001e-06 2024-09-12T05:21:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703595+0000", 2024-09-12T05:21:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0070000000000003e-06 2024-09-12T05:21:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757060+0000", 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053465909999999998 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757143+0000", 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2974999999999998e-05 2024-09-12T05:21:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757238+0000", 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4302000000000006e-05 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56147 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.451095418000001, 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054033454000000002, 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56147 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703606+0000", 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.305e-06 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703613+0000", 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1720000000000001e-06 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703618+0000", 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7339999999999996e-06 2024-09-12T05:21:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757277+0000", 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053658748999999999 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757529+0000", 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025211199999999997 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757636+0000", 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010683600000000001 2024-09-12T05:21:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56148 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.45107243, 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054391660000000001, 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56148 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703629+0000", 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4339999999999999e-06 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703636+0000", 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1999999999999997e-06 2024-09-12T05:21:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703642+0000", 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1829999999999999e-06 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757667+0000", 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054025148000000002 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757737+0000", 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9640000000000004e-05 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.758017+0000", 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000280594 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:81228 3.12 3:4c7b354e:::rbd_data.11185a81880a.0000000000000000:head [sparse-read 0~14172160] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:25.256 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4945056250000004, 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052732870000000001, 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 81228 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660195+0000", 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2869999999999999e-06 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660205+0000", 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0086e-05 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660236+0000", 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1386000000000001e-05 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660251+0000", 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5173e-05 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660398+0000", 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146537 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660674+0000", 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027622399999999999 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.712925+0000", 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052251177000000003 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.260 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:83607 3.12 3:4a56a2a1:::rbd_data.11182b429d69.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 886864~48318] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.661373539, 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.057842625000000002, 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:25.261 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 83607 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493327+0000", 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9539999999999998e-06 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501945+0000", 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086183170000000003 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501967+0000", 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-05 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501982+0000", 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4532000000000001e-05 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502045+0000", 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3579999999999998e-05 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502168+0000", 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012290200000000001 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502477+0000", 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000308244 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.525615+0000", 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023138784999999999 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551038+0000", 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025422836000000001 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551116+0000", 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8254e-05 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551167+0000", 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0720999999999998e-05 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:25.266 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:25.267 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:25.268 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:25.268 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:25.268 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:25.269 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:25.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:25.270 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:25.263+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:25.285 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:25.285 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:25.312 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:25.313 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:25.316 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:25.317 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:25.370 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:25.367+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:25.370 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:21:25.404 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:25.405 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:25.422 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:25.428 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone28 from 0xb55aba6 (overlap 0x22c9aa6) to 0x0 2024-09-12T05:21:25.473 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:25.471+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:25.551 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-12T05:21:25.554 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:25.555 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:25.572 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:25.572 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:25.567+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:25.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:25.667+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:25.751 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:25.752 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:25.768 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:25.772 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:25.767+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:25.841 INFO:teuthology.orchestra.run.smithi059.stdout:3537 read 0x28dc019 thru 0x28eafd3 (0xefbb bytes) 2024-09-12T05:21:25.842 INFO:teuthology.orchestra.run.smithi059.stdout:3538 writesame 0x5ba1ef1 thru 0x5ba2e55 data_size 0x1(0xf65 bytes) 2024-09-12T05:21:25.856 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:25.856 INFO:teuthology.orchestra.run.smithi059.stdout:3540 write 0x4426f2 thru 0x44787c (0x518b bytes) 2024-09-12T05:21:25.865 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:25.873 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:25.871+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:25.873 INFO:teuthology.orchestra.run.smithi059.stdout:3543 write 0xc3effb4 thru 0xc3fab1f (0xab6c bytes) 2024-09-12T05:21:25.879 INFO:teuthology.orchestra.run.smithi059.stdout:3544 punch from 0x1e2f48e to 0x1e35fe4, (0x6b56 bytes) 2024-09-12T05:21:25.880 INFO:teuthology.orchestra.run.smithi059.stdout:3546 read 0x7b7a592 thru 0x7b827a2 (0x8211 bytes) 2024-09-12T05:21:25.880 INFO:teuthology.orchestra.run.smithi059.stdout:3547 punch from 0xa59afa5 to 0xa5a9e14, (0xee6f bytes) 2024-09-12T05:21:25.880 INFO:teuthology.orchestra.run.smithi059.stdout:3548 punch from 0x83585a9 to 0x83670b4, (0xeb0b bytes) 2024-09-12T05:21:25.880 INFO:teuthology.orchestra.run.smithi059.stdout:3550 read 0x4350ad thru 0x43dbea (0x8b3e bytes) 2024-09-12T05:21:25.881 INFO:teuthology.orchestra.run.smithi059.stdout:3551 write 0x861bbbc thru 0x862ab84 (0xefc9 bytes) 2024-09-12T05:21:25.896 INFO:teuthology.orchestra.run.smithi059.stdout:3552 trunc from 0xc3fab20 to 0x6fa587e 2024-09-12T05:21:25.906 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:25.906 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:25.924 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:25.943 INFO:teuthology.orchestra.run.smithi059.stdout:3554 writesame 0xb7be4ae thru 0xb7c3f94 data_size 0x1(0x5ae7 bytes) 2024-09-12T05:21:25.943 INFO:teuthology.orchestra.run.smithi059.stdout:3555 write 0x470b076 thru 0x47124f3 (0x747e bytes) 2024-09-12T05:21:25.954 INFO:teuthology.orchestra.run.smithi059.stdout:3557 trunc from 0xb7c3f95 to 0xd5a8669 2024-09-12T05:21:25.963 INFO:teuthology.orchestra.run.smithi059.stdout:3558 read 0x2ef81b1 thru 0x2efe6a2 (0x64f2 bytes) 2024-09-12T05:21:25.963 INFO:teuthology.orchestra.run.smithi059.stdout:3559 write 0xd18e430 thru 0xd192d00 (0x48d1 bytes) 2024-09-12T05:21:25.971 INFO:teuthology.orchestra.run.smithi059.stdout:3560 flatten 2024-09-12T05:21:25.974 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:25.971+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:26.075 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:26.075+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:26.094 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:26.094 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:26.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:26.176 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:26.171+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:26.277 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:26.275+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:26.317 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:26.317 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:26.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:26.360 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6] out_osds: [2] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:21:26.361 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:26.361 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-12T05:21:26.361 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T05:21:26.361 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T05:21:26.362 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-12T05:21:26.377 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:26.375+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:26.394 INFO:teuthology.orchestra.run.smithi059.stdout:3561 write 0x2d2bd03 thru 0x2d3b193 (0xf491 bytes) 2024-09-12T05:21:26.405 INFO:teuthology.orchestra.run.smithi059.stdout:3562 trunc from 0xd5a8669 to 0x9aa06e6 2024-09-12T05:21:26.429 INFO:teuthology.orchestra.run.smithi059.stdout:3563 write 0xb12a8e9 thru 0xb133f20 (0x9638 bytes) 2024-09-12T05:21:26.437 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:26.437 INFO:teuthology.orchestra.run.smithi059.stdout:3566 read 0x532f4b0 thru 0x5332102 (0x2c53 bytes) 2024-09-12T05:21:26.437 INFO:teuthology.orchestra.run.smithi059.stdout:3567 punch from 0x1e8bce7 to 0x1e93e77, (0x8190 bytes) 2024-09-12T05:21:26.437 INFO:teuthology.orchestra.run.smithi059.stdout:3570 write 0x966d59f thru 0x9676a2f (0x9491 bytes) 2024-09-12T05:21:26.446 INFO:teuthology.orchestra.run.smithi059.stdout:3571 punch from 0x79232cc to 0x7930f52, (0xdc86 bytes) 2024-09-12T05:21:26.446 INFO:teuthology.orchestra.run.smithi059.stdout:3572 read 0x74ac673 thru 0x74bbcdd (0xf66b bytes) 2024-09-12T05:21:26.446 INFO:teuthology.orchestra.run.smithi059.stdout:3573 read 0x7a7b9b8 thru 0x7a7e8f0 (0x2f39 bytes) 2024-09-12T05:21:26.452 INFO:teuthology.orchestra.run.smithi059.stdout:3575 trunc from 0xb133f21 to 0x744df3c 2024-09-12T05:21:26.471 INFO:teuthology.orchestra.run.smithi059.stdout:3576 read 0x52bd120 thru 0x52cb86f (0xe750 bytes) 2024-09-12T05:21:26.478 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:26.475+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:26.483 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:26.483 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:26.485 INFO:teuthology.orchestra.run.smithi059.stdout:3578 write 0x9353812 thru 0x935b71b (0x7f0a bytes) 2024-09-12T05:21:26.496 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:26.496 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "" 2024-09-12T05:21:26.496 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:26.502 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:26.505 INFO:teuthology.orchestra.run.smithi059.stdout:3581 writesame 0xcf8679e thru 0xcf89051 data_size 0xa(0x28b4 bytes) 2024-09-12T05:21:26.505 INFO:teuthology.orchestra.run.smithi059.stdout:3583 punch from 0xa9c8650 to 0xa9cc692, (0x4042 bytes) 2024-09-12T05:21:26.506 INFO:teuthology.orchestra.run.smithi059.stdout:3584 read 0xc38d995 thru 0xc3914e4 (0x3b50 bytes) 2024-09-12T05:21:26.525 INFO:teuthology.orchestra.run.smithi059.stdout:3585 trunc from 0xcf89052 to 0x220fd9c 2024-09-12T05:21:26.579 INFO:teuthology.orchestra.run.smithi059.stdout:3589 writesame 0xca4d656 thru 0xca5773e data_size 0x17(0xa0e9 bytes) 2024-09-12T05:21:26.579 INFO:teuthology.orchestra.run.smithi059.stdout:3590 read 0x62cd904 thru 0x62d9d8d (0xc48a bytes) 2024-09-12T05:21:26.579 INFO:teuthology.orchestra.run.smithi059.stdout:3591 read 0x95b9999 thru 0x95c414f (0xa7b7 bytes) 2024-09-12T05:21:26.580 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:26.575+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:26.588 INFO:teuthology.orchestra.run.smithi059.stdout:3593 trunc from 0xca5773f to 0x76dfc77 2024-09-12T05:21:26.628 INFO:teuthology.orchestra.run.smithi059.stdout:3595 write 0xed99ef1 thru 0xeda952f (0xf63f bytes) 2024-09-12T05:21:26.640 INFO:teuthology.orchestra.run.smithi059.stdout:3596 trunc from 0xeda9530 to 0xd2be1d0 2024-09-12T05:21:26.643 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:26.643 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:26.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:26.663 INFO:teuthology.orchestra.run.smithi059.stdout:3597 punch from 0xbd52c17 to 0xbd60eac, (0xe295 bytes) 2024-09-12T05:21:26.664 INFO:teuthology.orchestra.run.smithi059.stdout:3598 punch from 0x7faccb to 0x80045d, (0x5792 bytes) 2024-09-12T05:21:26.664 INFO:teuthology.orchestra.run.smithi059.stdout:3600 write 0xc32573e thru 0xc33449c (0xed5f bytes) 2024-09-12T05:21:26.672 INFO:teuthology.orchestra.run.smithi059.stdout:3601 write 0x58002fb thru 0x580f4ea (0xf1f0 bytes) 2024-09-12T05:21:26.680 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:26.675+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:26.693 INFO:teuthology.orchestra.run.smithi059.stdout:3603 trunc from 0xd2be1d0 to 0x45ea5a9 2024-09-12T05:21:26.710 INFO:teuthology.orchestra.run.smithi059.stdout:3605 read 0x43d307 thru 0x43dd6b (0xa65 bytes) 2024-09-12T05:21:26.711 INFO:teuthology.orchestra.run.smithi059.stdout:3607 read 0x3c6d41b thru 0x3c78886 (0xb46c bytes) 2024-09-12T05:21:26.711 INFO:teuthology.orchestra.run.smithi059.stdout:3608 read 0x125588b thru 0x125948f (0x3c05 bytes) 2024-09-12T05:21:26.711 INFO:teuthology.orchestra.run.smithi059.stdout:3609 writesame 0x79d03c thru 0x7a9908 data_size 0x73(0xc8cd bytes) 2024-09-12T05:21:26.718 INFO:teuthology.orchestra.run.smithi059.stdout:3611 write 0x2a7e2db thru 0x2a8816d (0x9e93 bytes) 2024-09-12T05:21:26.726 INFO:teuthology.orchestra.run.smithi059.stdout:3612 write 0x23eebec thru 0x23f29e7 (0x3dfc bytes) 2024-09-12T05:21:26.752 INFO:teuthology.orchestra.run.smithi059.stdout:3613 write 0xab2696f thru 0xab344e1 (0xdb73 bytes) 2024-09-12T05:21:26.761 INFO:teuthology.orchestra.run.smithi059.stdout:3614 writesame 0x3fd5370 thru 0x3fdf169 data_size 0x2(0x9dfa bytes) 2024-09-12T05:21:26.782 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:26.779+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:26.795 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:26.795 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:26.795 INFO:teuthology.orchestra.run.smithi059.stdout:3615 writesame 0x34ff7e4 thru 0x3504f42 data_size 0x1(0x575f bytes) 2024-09-12T05:21:26.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:26.817 INFO:teuthology.orchestra.run.smithi059.stdout:3616 read 0xa6c1ba4 thru 0xa6c2e07 (0x1264 bytes) 2024-09-12T05:21:26.817 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:26.817 INFO:teuthology.orchestra.run.smithi059.stdout:3620 writesame 0x4419587 thru 0x4426793 data_size 0x1(0xd20d bytes) 2024-09-12T05:21:26.876 INFO:teuthology.orchestra.run.smithi059.stdout:3621 trunc from 0xab344e2 to 0x162acbc 2024-09-12T05:21:26.883 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:26.879+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:26.903 INFO:teuthology.orchestra.run.smithi059.stdout:3622 trunc from 0x162acbc to 0x4ffeffc 2024-09-12T05:21:26.913 INFO:teuthology.orchestra.run.smithi059.stdout:3623 punch from 0x289fdb to 0x28b404, (0x1429 bytes) 2024-09-12T05:21:26.913 INFO:teuthology.orchestra.run.smithi059.stdout:3624 writesame 0x47cffbd thru 0x47db826 data_size 0x5(0xb86a bytes) 2024-09-12T05:21:26.924 INFO:teuthology.orchestra.run.smithi059.stdout:3625 punch from 0x2a89e9 to 0x2b768e, (0xeca5 bytes) 2024-09-12T05:21:26.925 INFO:teuthology.orchestra.run.smithi059.stdout:3626 punch from 0xd8067 to 0xe165b, (0x95f4 bytes) 2024-09-12T05:21:26.925 INFO:teuthology.orchestra.run.smithi059.stdout:3627 write 0x37e57bc thru 0x37f3b20 (0xe365 bytes) 2024-09-12T05:21:26.933 INFO:teuthology.orchestra.run.smithi059.stdout:3628 punch from 0x247f410 to 0x248cf2c, (0xdb1c bytes) 2024-09-12T05:21:26.933 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:26.952 INFO:teuthology.orchestra.run.smithi059.stdout:3633 write 0x8d9b435 thru 0x8da234d (0x6f19 bytes) 2024-09-12T05:21:26.960 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:26.960 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:26.964 INFO:teuthology.orchestra.run.smithi059.stdout:3635 punch from 0x33c0ec9 to 0x33ca4be, (0x95f5 bytes) 2024-09-12T05:21:26.964 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:26.964 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:26.980 INFO:teuthology.orchestra.run.smithi059.stdout:3639 write 0xd2ccb2d thru 0xd2d6b88 (0xa05c bytes) 2024-09-12T05:21:26.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:26.985 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:26.979+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:26.990 INFO:teuthology.orchestra.run.smithi059.stdout:3640 writesame 0x71e2e56 thru 0x71e7da8 data_size 0x7(0x4f53 bytes) 2024-09-12T05:21:27.008 INFO:teuthology.orchestra.run.smithi059.stdout:3643 writesame 0xe6112b7 thru 0xe619550 data_size 0x49(0x829a bytes) 2024-09-12T05:21:27.009 INFO:teuthology.orchestra.run.smithi059.stdout:3644 read 0xa742cf thru 0xa824b3 (0xe1e5 bytes) 2024-09-12T05:21:27.027 INFO:teuthology.orchestra.run.smithi059.stdout:3645 trunc from 0xe619551 to 0x2f3a64e 2024-09-12T05:21:27.048 INFO:teuthology.orchestra.run.smithi059.stdout:3646 punch from 0xd5136f to 0xd55c5e, (0x48ef bytes) 2024-09-12T05:21:27.048 INFO:teuthology.orchestra.run.smithi059.stdout:3649 read 0x15738fe thru 0x1583731 (0xfe34 bytes) 2024-09-12T05:21:27.068 INFO:teuthology.orchestra.run.smithi059.stdout:3650 write 0xafec6cd thru 0xaffc5ca (0xfefe bytes) 2024-09-12T05:21:27.085 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:27.083+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:27.093 INFO:teuthology.orchestra.run.smithi059.stdout:3651 trunc from 0xaffc5cb to 0x1bdc5fd 2024-09-12T05:21:27.114 INFO:teuthology.orchestra.run.smithi059.stdout:3655 read 0x89fe2a thru 0x8ac215 (0xc3ec bytes) 2024-09-12T05:21:27.129 INFO:teuthology.orchestra.run.smithi059.stdout:3656 writesame 0x349f3f1 thru 0x34af052 data_size 0x8e(0xfc62 bytes) 2024-09-12T05:21:27.134 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:27.134 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:27.139 INFO:teuthology.orchestra.run.smithi059.stdout:3657 trunc from 0x34af053 to 0x87befe7 2024-09-12T05:21:27.151 INFO:teuthology.orchestra.run.smithi059.stdout:3658 read 0x519202 thru 0x519237 (0x36 bytes) 2024-09-12T05:21:27.151 INFO:teuthology.orchestra.run.smithi059.stdout:3662 punch from 0x59d76cb to 0x59e6d67, (0xf69c bytes) 2024-09-12T05:21:27.151 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:27.164 INFO:teuthology.orchestra.run.smithi059.stdout:3664 write 0xa360628 thru 0xa36260f (0x1fe8 bytes) 2024-09-12T05:21:27.169 INFO:teuthology.orchestra.run.smithi059.stdout:3666 read 0x8e3fe08 thru 0x8e49df2 (0x9feb bytes) 2024-09-12T05:21:27.169 INFO:teuthology.orchestra.run.smithi059.stdout:3668 punch from 0x40b2af0 to 0x40b5f21, (0x3431 bytes) 2024-09-12T05:21:27.169 INFO:teuthology.orchestra.run.smithi059.stdout:3671 write 0x9919cfb thru 0x992249a (0x87a0 bytes) 2024-09-12T05:21:27.177 INFO:teuthology.orchestra.run.smithi059.stdout:3672 read 0x35aade0 thru 0x35afa48 (0x4c69 bytes) 2024-09-12T05:21:27.177 INFO:teuthology.orchestra.run.smithi059.stdout:3674 writesame 0x39dba43 thru 0x39e7dc1 data_size 0x1(0xc37f bytes) 2024-09-12T05:21:27.185 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:27.183+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:27.213 INFO:teuthology.orchestra.run.smithi059.stdout:3675 write 0x83f65b4 thru 0x83f6b80 (0x5cd bytes) 2024-09-12T05:21:27.221 INFO:teuthology.orchestra.run.smithi059.stdout:3677 trunc from 0xa362610 to 0x8d51520 2024-09-12T05:21:27.241 INFO:teuthology.orchestra.run.smithi059.stdout:3678 trunc from 0x8d51520 to 0x83a5d83 2024-09-12T05:21:27.254 INFO:teuthology.orchestra.run.smithi059.stdout:3680 read 0x80bd1ef thru 0x80c59f9 (0x880b bytes) 2024-09-12T05:21:27.254 INFO:teuthology.orchestra.run.smithi059.stdout:3681 read 0x800e440 thru 0x8019497 (0xb058 bytes) 2024-09-12T05:21:27.266 INFO:teuthology.orchestra.run.smithi059.stdout:3682 writesame 0x929ff87 thru 0x92a3462 data_size 0x22(0x34dc bytes) 2024-09-12T05:21:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:3683 write 0xb4efb32 thru 0xb4fb33f (0xb80e bytes) 2024-09-12T05:21:27.287 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:27.283+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:27.287 INFO:teuthology.orchestra.run.smithi059.stdout:3684 write 0x49b2f3b thru 0x49bea87 (0xbb4d bytes) 2024-09-12T05:21:27.294 INFO:teuthology.orchestra.run.smithi059.stdout:3685 clone 30 order 19 su 65536 sc 13 2024-09-12T05:21:27.299 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:27.299 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:27.313 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:27.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:27.388 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:27.383+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:27.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:21:27.451 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:27.451 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:27.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:27.489 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:27.483+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:27.532 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:27.552 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:27.569 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:27.570 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:27.589 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:27.590 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:27.590 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:27.587+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:27.608 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:27.609 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:27.632 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:27.632 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:27.635 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:27.635 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:27.635 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:27.650 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:27.653 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-12T05:21:27.654 INFO:teuthology.orchestra.run.smithi059.stdout:3686 write 0x6c69853 thru 0x6c6b56e (0x1d1c bytes) 2024-09-12T05:21:27.657 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:27.657 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:27.662 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:27.663 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:27.677 INFO:teuthology.orchestra.run.smithi059.stdout:3689 write 0xe78bd3d thru 0xe795c23 (0x9ee7 bytes) 2024-09-12T05:21:27.683 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.684 INFO:teuthology.orchestra.run.smithi059.stdout:3693 write 0x5dff526 thru 0x5e0e17c (0xec57 bytes) 2024-09-12T05:21:27.690 INFO:teuthology.orchestra.run.smithi059.stdout:3696 writesame 0xa120fd4 thru 0xa122737 data_size 0x6(0x1764 bytes) 2024-09-12T05:21:27.694 INFO:teuthology.orchestra.run.smithi059.stdout:3697 write 0x7544fb5 thru 0x7549296 (0x42e2 bytes) 2024-09-12T05:21:27.697 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:27.695+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:27.698 INFO:teuthology.orchestra.run.smithi059.stdout:3698 write 0x68ee750 thru 0x68f2de6 (0x4697 bytes) 2024-09-12T05:21:27.702 INFO:teuthology.orchestra.run.smithi059.stdout:3699 read 0x525a16 thru 0x531de8 (0xc3d3 bytes) 2024-09-12T05:21:27.702 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.702 INFO:teuthology.orchestra.run.smithi059.stdout:3703 read 0x71e5c83 thru 0x71f30a3 (0xd421 bytes) 2024-09-12T05:21:27.702 INFO:teuthology.orchestra.run.smithi059.stdout:3704 punch from 0x22655d3 to 0x226b34e, (0x5d7b bytes) 2024-09-12T05:21:27.717 INFO:teuthology.orchestra.run.smithi059.stdout:3705 trunc from 0xe795c24 to 0x3ee2a2a 2024-09-12T05:21:27.750 INFO:teuthology.orchestra.run.smithi059.stdout:3706 read 0xb63f31 thru 0xb71296 (0xd366 bytes) 2024-09-12T05:21:27.751 INFO:teuthology.orchestra.run.smithi059.stdout:3707 punch from 0x1a7cbb3 to 0x1a89cfa, (0xd147 bytes) 2024-09-12T05:21:27.751 INFO:teuthology.orchestra.run.smithi059.stdout:3708 read 0x387b57f thru 0x3884bbf (0x9641 bytes) 2024-09-12T05:21:27.751 INFO:teuthology.orchestra.run.smithi059.stdout:3709 read 0x3b83dba thru 0x3b8bfea (0x8231 bytes) 2024-09-12T05:21:27.751 INFO:teuthology.orchestra.run.smithi059.stdout:3710 punch from 0xcdb187 to 0xcddfe3, (0x2e5c bytes) 2024-09-12T05:21:27.751 INFO:teuthology.orchestra.run.smithi059.stdout:3712 read 0x3d3d00f thru 0x3d42c52 (0x5c44 bytes) 2024-09-12T05:21:27.752 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.763 INFO:teuthology.orchestra.run.smithi059.stdout:3715 trunc from 0x3ee2a2a to 0xce00745 2024-09-12T05:21:27.771 INFO:teuthology.orchestra.run.smithi059.stdout:3716 read 0xb2ae782 thru 0xb2af343 (0xbc2 bytes) 2024-09-12T05:21:27.771 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.771 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.778 INFO:teuthology.orchestra.run.smithi059.stdout:3720 trunc from 0xce00745 to 0x830ffac 2024-09-12T05:21:27.785 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:27.785 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:27.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:27.785 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:27.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.786 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10925 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 327680~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.786 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:27.786 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.720934397999997, 2024-09-12T05:21:27.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036931288, 2024-09-12T05:21:27.786 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.787 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.787 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.787 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.787 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.787 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.788 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10925 2024-09-12T05:21:27.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.788 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:27.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062150+0000", 2024-09-12T05:21:27.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062151+0000", 2024-09-12T05:21:27.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7699999999999992e-07 2024-09-12T05:21:27.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062185+0000", 2024-09-12T05:21:27.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4415999999999997e-05 2024-09-12T05:21:27.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062205+0000", 2024-09-12T05:21:27.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9826999999999998e-05 2024-09-12T05:21:27.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062220+0000", 2024-09-12T05:21:27.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5029e-05 2024-09-12T05:21:27.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.095934+0000", 2024-09-12T05:21:27.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033714015999999999 2024-09-12T05:21:27.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.096128+0000", 2024-09-12T05:21:27.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019388700000000001 2024-09-12T05:21:27.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099081+0000", 2024-09-12T05:21:27.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029531359999999999 2024-09-12T05:21:27.796 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.797 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10926 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 376832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:27.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.720838375, 2024-09-12T05:21:27.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037537357, 2024-09-12T05:21:27.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.799 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.799 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.799 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10926 2024-09-12T05:21:27.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.800 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:27.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062246+0000", 2024-09-12T05:21:27.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062247+0000", 2024-09-12T05:21:27.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.35e-06 2024-09-12T05:21:27.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062253+0000", 2024-09-12T05:21:27.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6500000000000001e-06 2024-09-12T05:21:27.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062271+0000", 2024-09-12T05:21:27.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8556e-05 2024-09-12T05:21:27.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062286+0000", 2024-09-12T05:21:27.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4464000000000001e-05 2024-09-12T05:21:27.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099158+0000", 2024-09-12T05:21:27.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036872070999999999 2024-09-12T05:21:27.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099318+0000", 2024-09-12T05:21:27.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000159567 2024-09-12T05:21:27.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099783+0000", 2024-09-12T05:21:27.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046569899999999997 2024-09-12T05:21:27.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.808 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.809 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10927 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 425984~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.809 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:27.809 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.720779071999999, 2024-09-12T05:21:27.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038153955000000003, 2024-09-12T05:21:27.810 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.810 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.810 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.810 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.810 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.810 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.810 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10927 2024-09-12T05:21:27.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.811 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:27.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062305+0000", 2024-09-12T05:21:27.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062306+0000", 2024-09-12T05:21:27.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-12T05:21:27.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062311+0000", 2024-09-12T05:21:27.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8239999999999999e-06 2024-09-12T05:21:27.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062329+0000", 2024-09-12T05:21:27.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7606000000000001e-05 2024-09-12T05:21:27.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062343+0000", 2024-09-12T05:21:27.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4039999999999999e-05 2024-09-12T05:21:27.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:27.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037505968000000001 2024-09-12T05:21:27.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100033+0000", 2024-09-12T05:21:27.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000184203 2024-09-12T05:21:27.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100459+0000", 2024-09-12T05:21:27.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042621800000000002 2024-09-12T05:21:27.817 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.818 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.818 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.818 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10928 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 475136~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.818 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:27.819 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.720722365999997, 2024-09-12T05:21:27.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038417445000000001, 2024-09-12T05:21:27.819 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.819 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.819 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.819 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.819 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.820 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10928 2024-09-12T05:21:27.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.820 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:27.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062362+0000", 2024-09-12T05:21:27.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062364+0000", 2024-09-12T05:21:27.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-12T05:21:27.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062369+0000", 2024-09-12T05:21:27.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1240000000000004e-06 2024-09-12T05:21:27.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062387+0000", 2024-09-12T05:21:27.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8246000000000001e-05 2024-09-12T05:21:27.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.062401+0000", 2024-09-12T05:21:27.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3657e-05 2024-09-12T05:21:27.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100507+0000", 2024-09-12T05:21:27.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038106729999999998 2024-09-12T05:21:27.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100638+0000", 2024-09-12T05:21:27.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013090500000000001 2024-09-12T05:21:27.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100779+0000", 2024-09-12T05:21:27.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014111700000000001 2024-09-12T05:21:27.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.827 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.828 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10988 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.828 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:27.828 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.719695027999997, 2024-09-12T05:21:27.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037985258000000001, 2024-09-12T05:21:27.829 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.829 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.829 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.830 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10988 2024-09-12T05:21:27.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.830 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:27.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063389+0000", 2024-09-12T05:21:27.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063391+0000", 2024-09-12T05:21:27.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:27.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063395+0000", 2024-09-12T05:21:27.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7600000000000002e-06 2024-09-12T05:21:27.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063414+0000", 2024-09-12T05:21:27.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-05 2024-09-12T05:21:27.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063428+0000", 2024-09-12T05:21:27.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.451e-05 2024-09-12T05:21:27.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100823+0000", 2024-09-12T05:21:27.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037394334000000001 2024-09-12T05:21:27.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.100942+0000", 2024-09-12T05:21:27.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118888 2024-09-12T05:21:27.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101374+0000", 2024-09-12T05:21:27.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043276600000000001 2024-09-12T05:21:27.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.838 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10989 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.839 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:27.839 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.719635171, 2024-09-12T05:21:27.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038605024000000002, 2024-09-12T05:21:27.839 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.840 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.840 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.840 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10989 2024-09-12T05:21:27.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.841 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:27.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063449+0000", 2024-09-12T05:21:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063450+0000", 2024-09-12T05:21:27.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2470000000000001e-06 2024-09-12T05:21:27.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063471+0000", 2024-09-12T05:21:27.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0746000000000001e-05 2024-09-12T05:21:27.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063491+0000", 2024-09-12T05:21:27.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0270000000000001e-05 2024-09-12T05:21:27.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063506+0000", 2024-09-12T05:21:27.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4626e-05 2024-09-12T05:21:27.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101484+0000", 2024-09-12T05:21:27.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037978439000000003 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.101637+0000", 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152363 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102054+0000", 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041733299999999998 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10990 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.719547364999997, 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039028614000000003, 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10990 2024-09-12T05:21:27.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063537+0000", 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063538+0000", 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2929999999999999e-06 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063559+0000", 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0956999999999999e-05 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063770+0000", 2024-09-12T05:21:27.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021102100000000001 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.063792+0000", 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2096999999999999e-05 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102109+0000", 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038317199000000003 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102235+0000", 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012598500000000001 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102565+0000", 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000330062 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10991 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:27.851 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.718864926999998, 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038838655999999999, 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10991 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:27.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064219+0000", 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064221+0000", 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8470000000000001e-06 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064230+0000", 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064259+0000", 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8393000000000001e-05 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064277+0000", 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8885999999999998e-05 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102616+0000", 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038339020000000001 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.102704+0000", 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7595000000000004e-05 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103058+0000", 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035394499999999999 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.855 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:10992 3.5 3:a2d0d671:::rbd_data.1118f6d14695.0000000000000001:9 [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.718778315000002, 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039133027000000001, 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.856 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 10992 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064306+0000", 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064307+0000", 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.477e-06 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064313+0000", 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8329999999999999e-06 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064332+0000", 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8717000000000001e-05 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.064355+0000", 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3113e-05 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103115+0000", 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038760217999999999 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103271+0000", 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015608899999999999 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:27.103439+0000", 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016757999999999999 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22384 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.104661792999998, 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035328432999999999, 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22384 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678422+0000", 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678423+0000", 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7700000000000004e-07 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678427+0000", 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9099999999999998e-06 2024-09-12T05:21:27.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678436+0000", 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8589999999999994e-06 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678444+0000", 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4959999999999996e-06 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705279+0000", 2024-09-12T05:21:27.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026834632000000001 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.705520+0000", 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024076100000000001 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.706555+0000", 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001034933 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:27.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.710982+0000", 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044268010000000002 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713437+0000", 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024553029999999998 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713623+0000", 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018639399999999999 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713751+0000", 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012766700000000001 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22385 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.104629684999999, 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037690591000000002, 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22385 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:27.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678455+0000", 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678459+0000", 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7900000000000001e-06 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678468+0000", 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8890000000000008e-06 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678475+0000", 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8800000000000002e-06 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708857+0000", 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030381907999999999 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.708999+0000", 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014186900000000001 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.709638+0000", 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063908400000000005 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715839+0000", 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062014890000000001 2024-09-12T05:21:27.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.715882+0000", 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3188000000000001e-05 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716026+0000", 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014375999999999999 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716145+0000", 2024-09-12T05:21:27.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011903700000000001 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22386 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.104599493000002, 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040447601, 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22386 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678485+0000", 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4000000000000001e-07 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678496+0000", 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0623e-05 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678506+0000", 2024-09-12T05:21:27.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7890000000000006e-06 2024-09-12T05:21:27.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678513+0000", 2024-09-12T05:21:27.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1359999999999999e-06 2024-09-12T05:21:27.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711185+0000", 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.032671814 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.711506+0000", 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000321417 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.712538+0000", 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010313760000000001 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.716256+0000", 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0037188350000000002 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718706+0000", 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024499159999999999 2024-09-12T05:21:27.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718856+0000", 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015012900000000001 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718932+0000", 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5926000000000005e-05 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22387 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.104560280999998, 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040806824999999998, 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22387 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.879 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678524+0000", 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678525+0000", 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1299999999999999e-07 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678529+0000", 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678538+0000", 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1060000000000006e-06 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.678545+0000", 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0260000000000002e-06 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.713870+0000", 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035324960000000002 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714037+0000", 2024-09-12T05:21:27.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167381 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.714624+0000", 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058681300000000005 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.718968+0000", 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043441749999999996 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719059+0000", 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1019000000000004e-05 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719151+0000", 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1157999999999997e-05 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.719331+0000", 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000180201 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.884 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23350 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 329728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.937747244999997, 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037806736000000001, 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23350 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845337+0000", 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845338+0000", 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3000000000000001e-07 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845340+0000", 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.289e-06 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845347+0000", 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:21:27.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.845353+0000", 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875603+0000", 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.030250139999999998 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.875670+0000", 2024-09-12T05:21:27.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6791999999999993e-05 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.883144+0000", 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007473553 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:23729 3.16 3:6ca14101:::rbd_data.1118d7e09baf.0000000000000044:e [read 514048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.927692856999997, 2024-09-12T05:21:27.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035315419000000001, 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23729 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855391+0000", 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855392+0000", 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855395+0000", 2024-09-12T05:21:27.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855403+0000", 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4980000000000006e-06 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.855410+0000", 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6189999999999996e-06 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890120+0000", 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.034710795000000003 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890630+0000", 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000509901 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.890707+0000", 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6423999999999999e-05 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25449 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.486047753999998, 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.036956818000000002, 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.894 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25449 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297036+0000", 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297037+0000", 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-07 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297041+0000", 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1489999999999996e-06 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297052+0000", 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0866000000000001e-05 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.297060+0000", 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7829999999999999e-06 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.327882+0000", 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0308218 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328015+0000", 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000133406 2024-09-12T05:21:27.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.328611+0000", 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059631400000000002 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333062+0000", 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0044503540000000001 2024-09-12T05:21:27.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333708+0000", 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064637699999999995 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333878+0000", 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016978800000000001 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.333993+0000", 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115344 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:25659 3.c 3:31f3c456:::rbd_object_map.111887da7c95:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.222564915, 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.035645679, 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 25659 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560519+0000", 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560520+0000", 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560523+0000", 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0520000000000002e-06 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560529+0000", 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1330000000000004e-06 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.560534+0000", 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589658+0000", 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.029124035 2024-09-12T05:21:27.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.589799+0000", 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014103 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.590443+0000", 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00064374400000000002 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.592625+0000", 2024-09-12T05:21:27.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021819439999999999 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596057+0000", 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034316820000000001 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596119+0000", 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2811999999999994e-05 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:41.596165+0000", 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5534999999999997e-05 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:54069 3.5 3:a432e2c0:::rbd_data.1118bf17036a.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.356148963000003, 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.037526320000000002, 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.906 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 54069 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426935+0000", 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.426936+0000", 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431511+0000", 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045748780000000001 2024-09-12T05:21:27.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431528+0000", 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7353000000000001e-05 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431546+0000", 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.825e-05 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431625+0000", 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8514000000000001e-05 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.431706+0000", 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1582999999999995e-05 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.432261+0000", 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000554997 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.450928+0000", 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018666187000000001 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464396+0000", 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013468707 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464436+0000", 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9338000000000002e-05 2024-09-12T05:21:27.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.464462+0000", 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5891999999999999e-05 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83561 3.4 e76/75 3:27947d04:::rbd_data.11182b429d69.0000000000000001:head v 76'345, mlcod=0'0)", 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.366880+0000", 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4162043049999999, 2024-09-12T05:21:27.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.070455441999999993, 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.366880+0000", 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.366880+0000", 2024-09-12T05:21:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.366880+0000", 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1699999999999998e-07 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.388917+0000", 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022036304999999999 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.388950+0000", 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3321999999999997e-05 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.388968+0000", 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.389088+0000", 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119611 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.389148+0000", 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9839000000000001e-05 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.437270+0000", 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.048121917 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.437335+0000", 2024-09-12T05:21:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5617999999999994e-05 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:83773 3.16 3:69307a13:::rbd_data.11182b429d69.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.726105+0000", 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0569788879999997, 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042537460999999999, 2024-09-12T05:21:27.917 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 83773 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.726105+0000", 2024-09-12T05:21:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.726105+0000", 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.726107+0000", 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736089+0000", 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099821630000000005 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736108+0000", 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8875000000000001e-05 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736118+0000", 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3559999999999999e-06 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736182+0000", 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4660999999999996e-05 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.736337+0000", 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015453999999999999 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.737218+0000", 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00088130700000000001 2024-09-12T05:21:27.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.763903+0000", 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026684787000000001 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.768540+0000", 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046372999999999996 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:27.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.768590+0000", 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9849000000000003e-05 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.768643+0000", 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2710000000000002e-05 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:27.923 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:27.925 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:27.926 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:27.919+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:27.926 INFO:teuthology.orchestra.run.smithi059.stdout:3722 writesame 0x8e7e598 thru 0x8e8cb63 data_size 0x9a(0xe5cc bytes) 2024-09-12T05:21:27.926 INFO:teuthology.orchestra.run.smithi059.stdout:3723 read 0x714518a thru 0x714e162 (0x8fd9 bytes) 2024-09-12T05:21:27.926 INFO:teuthology.orchestra.run.smithi059.stdout:3724 punch from 0x7f8f867 to 0x7f8faf4, (0x28d bytes) 2024-09-12T05:21:27.926 INFO:teuthology.orchestra.run.smithi059.stdout:3725 read 0x290dc5f thru 0x2915b98 (0x7f3a bytes) 2024-09-12T05:21:27.927 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.927 INFO:teuthology.orchestra.run.smithi059.stdout:3729 write 0xc4d11b6 thru 0xc4e0544 (0xf38f bytes) 2024-09-12T05:21:27.927 INFO:teuthology.orchestra.run.smithi059.stdout:3730 writesame 0x992d632 thru 0x9938088 data_size 0x1(0xaa57 bytes) 2024-09-12T05:21:27.927 INFO:teuthology.orchestra.run.smithi059.stdout:3731 trunc from 0xc4e0545 to 0x525fdd4 2024-09-12T05:21:27.927 INFO:teuthology.orchestra.run.smithi059.stdout:3732 punch from 0x9db1c7 to 0x9e6328, (0xb161 bytes) 2024-09-12T05:21:27.927 INFO:teuthology.orchestra.run.smithi059.stdout:3733 write 0xd41f805 thru 0xd42e805 (0xf001 bytes) 2024-09-12T05:21:27.934 INFO:teuthology.orchestra.run.smithi059.stdout:3735 punch from 0x95f8bf0 to 0x96023e2, (0x97f2 bytes) 2024-09-12T05:21:27.934 INFO:teuthology.orchestra.run.smithi059.stdout:3737 read 0x855652d thru 0x856559a (0xf06e bytes) 2024-09-12T05:21:27.934 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.934 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.934 INFO:teuthology.orchestra.run.smithi059.stdout:3741 read 0x390c069 thru 0x39106fc (0x4694 bytes) 2024-09-12T05:21:27.935 INFO:teuthology.orchestra.run.smithi059.stdout:3742 write 0x5d2133f thru 0x5d3087d (0xf53f bytes) 2024-09-12T05:21:27.946 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.946 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.946 INFO:teuthology.orchestra.run.smithi059.stdout:3746 punch from 0xcce4742 to 0xccee6ef, (0x9fad bytes) 2024-09-12T05:21:27.946 INFO:teuthology.orchestra.run.smithi059.stdout:3748 write 0xb19367f thru 0xb19fe01 (0xc783 bytes) 2024-09-12T05:21:27.958 INFO:teuthology.orchestra.run.smithi059.stdout:3749 punch from 0xb240e57 to 0xb248e14, (0x7fbd bytes) 2024-09-12T05:21:27.958 INFO:teuthology.orchestra.run.smithi059.stdout:3750 punch from 0xa96785d to 0xa9762a8, (0xea4b bytes) 2024-09-12T05:21:27.958 INFO:teuthology.orchestra.run.smithi059.stdout:3754 read 0x5772a4e thru 0x577d61a (0xabcd bytes) 2024-09-12T05:21:27.958 INFO:teuthology.orchestra.run.smithi059.stdout:3755 write 0x5cf159 thru 0x5def2c (0xfdd4 bytes) 2024-09-12T05:21:27.973 INFO:teuthology.orchestra.run.smithi059.stdout:3756 read 0x9120c07 thru 0x9128288 (0x7682 bytes) 2024-09-12T05:21:27.973 INFO:teuthology.orchestra.run.smithi059.stdout:3757 write 0x3565a58 thru 0x356bb86 (0x612f bytes) 2024-09-12T05:21:27.982 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.983 INFO:teuthology.orchestra.run.smithi059.stdout:3760 writesame 0x1a3d532 thru 0x1a4d265 data_size 0x7(0xfd34 bytes) 2024-09-12T05:21:27.999 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:27.999 INFO:teuthology.orchestra.run.smithi059.stdout:3762 punch from 0xc5a0bf8 to 0xc5aa7c1, (0x9bc9 bytes) 2024-09-12T05:21:27.999 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:28.012 INFO:teuthology.orchestra.run.smithi059.stdout:3765 write 0xd544d5a thru 0xd54bed8 (0x717f bytes) 2024-09-12T05:21:28.019 INFO:teuthology.orchestra.run.smithi059.stdout:3767 punch from 0xa9b921b to 0xa9bb6d1, (0x24b6 bytes) 2024-09-12T05:21:28.026 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:28.023+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:28.052 INFO:teuthology.orchestra.run.smithi059.stdout:3768 trunc from 0xd54bed9 to 0x119ea97 2024-09-12T05:21:28.110 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:28.111 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:28.126 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:28.127 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:28.123+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:28.138 INFO:teuthology.orchestra.run.smithi059.stdout:3769 trunc from 0x119ea97 to 0x4dbc2c2 2024-09-12T05:21:28.152 INFO:teuthology.orchestra.run.smithi059.stdout:3770 trunc from 0x4dbc2c2 to 0x33f9538 2024-09-12T05:21:28.162 INFO:teuthology.orchestra.run.smithi059.stdout:3771 punch from 0xd78308 to 0xd789ef, (0x6e7 bytes) 2024-09-12T05:21:28.191 INFO:teuthology.orchestra.run.smithi059.stdout:3772 write 0xaa3e19a thru 0xaa405a8 (0x240f bytes) 2024-09-12T05:21:28.200 INFO:teuthology.orchestra.run.smithi059.stdout:3773 punch from 0x5108f03 to 0x510dd62, (0x4e5f bytes) 2024-09-12T05:21:28.200 INFO:teuthology.orchestra.run.smithi059.stdout:3774 read 0x9b1bc78 thru 0x9b24396 (0x871f bytes) 2024-09-12T05:21:28.200 INFO:teuthology.orchestra.run.smithi059.stdout:3775 write 0x99a7982 thru 0x99b3fea (0xc669 bytes) 2024-09-12T05:21:28.210 INFO:teuthology.orchestra.run.smithi059.stdout:3777 punch from 0x78594d3 to 0x785b824, (0x2351 bytes) 2024-09-12T05:21:28.210 INFO:teuthology.orchestra.run.smithi059.stdout:3781 write 0x63d3a90 thru 0x63d666c (0x2bdd bytes) 2024-09-12T05:21:28.218 INFO:teuthology.orchestra.run.smithi059.stdout:3782 read 0x7466496 thru 0x7472bbb (0xc726 bytes) 2024-09-12T05:21:28.218 INFO:teuthology.orchestra.run.smithi059.stdout:3783 read 0x7fe81cf thru 0x7fe936b (0x119d bytes) 2024-09-12T05:21:28.218 INFO:teuthology.orchestra.run.smithi059.stdout:3784 writesame 0xa45e65a thru 0xa46b797 data_size 0x1(0xd13e bytes) 2024-09-12T05:21:28.226 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:28.223+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:28.252 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:28.252 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:28.252 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:28.252 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:28.252 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:28.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:28.269 INFO:teuthology.orchestra.run.smithi059.stdout:3785 read 0x79ad2da thru 0x79bc690 (0xf3b7 bytes) 2024-09-12T05:21:28.269 INFO:teuthology.orchestra.run.smithi059.stdout:3786 write 0x353c93d thru 0x3545dbd (0x9481 bytes) 2024-09-12T05:21:28.277 INFO:teuthology.orchestra.run.smithi059.stdout:3787 write 0x7a0b132 thru 0x7a16711 (0xb5e0 bytes) 2024-09-12T05:21:28.286 INFO:teuthology.orchestra.run.smithi059.stdout:3789 writesame 0x7130389 thru 0x7136f9f data_size 0x7(0x6c17 bytes) 2024-09-12T05:21:28.316 INFO:teuthology.orchestra.run.smithi059.stdout:3790 trunc from 0xaa405a9 to 0x35169b7 2024-09-12T05:21:28.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:28.351+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:28.366 INFO:teuthology.orchestra.run.smithi059.stdout:3791 trunc from 0x35169b7 to 0xb273f1c 2024-09-12T05:21:28.378 INFO:teuthology.orchestra.run.smithi059.stdout:3792 clone 31 order 24 su 131072 sc 9 2024-09-12T05:21:28.399 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:21:28.428 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:28.423+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:28.432 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.260004215999999, 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.259302695999999, 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:21:28.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:21:28.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.259179961999997, 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:21:28.442 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:28.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.446 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.259117748999998, 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.447 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:21:28.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:21:28.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.259050932000001, 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.451 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:28.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.455 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258990898999997, 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:21:28.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:21:28.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258910962999998, 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:21:28.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:21:28.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.464 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258851401999998, 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:21:28.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:21:28.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258776613000002, 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:21:28.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.473 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258639213000002, 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:21:28.477 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258487477999999, 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.478 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:21:28.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:21:28.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258424503999997, 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.486 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258288612000001, 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:28.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:21:28.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.490 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258224652000003, 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:21:28.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258140398999998, 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.495 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:28.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.499 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258081038999997, 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:28.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:21:28.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.258020772000002, 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:21:28.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:28.508 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.257957779000002, 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:28.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.512 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.257797171, 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:21:28.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.8145654570000005, 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:28.517 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:21:28.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:28.522 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:28.523 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:28.529 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:28.527+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:28.630 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:28.627+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:28.690 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:28.690 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:28.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:28.731 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:28.727+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:28.832 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:28.827+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:28.870 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:28.870 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:28.871 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:28.871 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:28.871 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:28.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:28.933 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:28.931+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:29.010 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:29.010 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.130635303999995, 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.10902002500000001, 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:21:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878726+0000", 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878741+0000", 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4696e-05 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878767+0000", 2024-09-12T05:21:29.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5812999999999998e-05 2024-09-12T05:21:29.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878789+0000", 2024-09-12T05:21:29.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.179e-05 2024-09-12T05:21:29.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878868+0000", 2024-09-12T05:21:29.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9116999999999995e-05 2024-09-12T05:21:29.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:29.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878878+0000", 2024-09-12T05:21:29.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8549999999999997e-06 2024-09-12T05:21:29.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.984853+0000", 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.105974939 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985185+0000", 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000332827 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985604+0000", 2024-09-12T05:21:29.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000418477 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.986868+0000", 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001264004 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987594+0000", 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072604400000000002 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987679+0000", 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4826000000000004e-05 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987744+0000", 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4716999999999997e-05 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4322 3.13 3:ceb672dc:::rbd_data.1118e5842253.0000000000000068:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:21:29.019 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.367965417999997, 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056729952, 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4322 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641396+0000", 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0970000000000002e-06 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641409+0000", 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.291e-05 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641440+0000", 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0380000000000001e-05 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641456+0000", 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5906999999999999e-05 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641572+0000", 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116452 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641803+0000", 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000230671 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.651415+0000", 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096118660000000002 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697868+0000", 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046453047999999997 2024-09-12T05:21:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:29.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697904+0000", 2024-09-12T05:21:29.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6313000000000003e-05 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697997+0000", 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3356000000000005e-05 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.698123+0000", 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125952 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.026 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22118 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1982464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842856621000003, 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052766258000000003, 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22118 2024-09-12T05:21:29.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166503+0000", 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1629999999999999e-06 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166508+0000", 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166526+0000", 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7699000000000001e-05 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166540+0000", 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4286e-05 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219002+0000", 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052461397999999999 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219106+0000", 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104694 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219268+0000", 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000162015 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22161 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842799126999999, 2024-09-12T05:21:29.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052998134000000002, 2024-09-12T05:21:29.032 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.032 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.032 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.032 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22161 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166561+0000", 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166566+0000", 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5860000000000004e-06 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166584+0000", 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:29.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166598+0000", 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3665999999999999e-05 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219347+0000", 2024-09-12T05:21:29.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052748841999999997 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219439+0000", 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2453000000000004e-05 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219558+0000", 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011851800000000001 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22163 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842741517, 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053262859000000003, 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22163 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.037 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166618+0000", 2024-09-12T05:21:29.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1659999999999999e-06 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166624+0000", 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3299999999999998e-06 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166641+0000", 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7016000000000001e-05 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166655+0000", 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4358999999999999e-05 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219631+0000", 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052976286999999997 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219740+0000", 2024-09-12T05:21:29.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108663 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219880+0000", 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014003799999999999 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22165 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 491520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842683866999998, 2024-09-12T05:21:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.05349143, 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22165 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166677+0000", 2024-09-12T05:21:29.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-06 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166682+0000", 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166706+0000", 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4063e-05 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166721+0000", 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4851999999999999e-05 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219948+0000", 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053227479000000001 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220029+0000", 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0564999999999999e-05 2024-09-12T05:21:29.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220166+0000", 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013738499999999999 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22167 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 720896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842616456999998, 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053842714, 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22167 2024-09-12T05:21:29.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166744+0000", 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166750+0000", 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0499999999999997e-06 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166768+0000", 2024-09-12T05:21:29.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7918999999999999e-05 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166781+0000", 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3784999999999999e-05 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220258+0000", 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053476165999999999 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220447+0000", 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018942699999999999 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220585+0000", 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013815 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.051 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22168 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 950272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842558396999998, 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054040510999999999, 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22168 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166802+0000", 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166807+0000", 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1460000000000004e-06 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166828+0000", 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0752999999999999e-05 2024-09-12T05:21:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166842+0000", 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4405e-05 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220648+0000", 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053806172999999999 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220728+0000", 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0175999999999999e-05 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220841+0000", 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011250400000000001 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.056 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22170 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1048576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842496906000001, 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054240254000000002, 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.057 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22170 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:29.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166863+0000", 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166868+0000", 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2000000000000002e-06 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166886+0000", 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7462e-05 2024-09-12T05:21:29.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166899+0000", 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3059e-05 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220904+0000", 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054004732999999999 2024-09-12T05:21:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221006+0000", 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102895 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221102+0000", 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22172 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1277952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842440818999997, 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054417, 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22172 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166919+0000", 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.173e-06 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166925+0000", 2024-09-12T05:21:29.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166942+0000", 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7246000000000001e-05 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166957+0000", 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4419e-05 2024-09-12T05:21:29.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221168+0000", 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054211102999999997 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221251+0000", 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2956999999999999e-05 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221335+0000", 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4122000000000005e-05 2024-09-12T05:21:29.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22174 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842383382000001, 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054612105000000001, 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22174 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166977+0000", 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.156e-06 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166982+0000", 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167000+0000", 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7336000000000001e-05 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167013+0000", 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3106e-05 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221400+0000", 2024-09-12T05:21:29.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054387255000000002 2024-09-12T05:21:29.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221493+0000", 2024-09-12T05:21:29.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3117999999999999e-05 2024-09-12T05:21:29.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221588+0000", 2024-09-12T05:21:29.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4524000000000005e-05 2024-09-12T05:21:29.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22176 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842324994999998, 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054762312, 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22176 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167035+0000", 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167064+0000", 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459e-05 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167098+0000", 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4041000000000002e-05 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167156+0000", 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7401000000000002e-05 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221640+0000", 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054484170999999998 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221714+0000", 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4345999999999996e-05 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221796+0000", 2024-09-12T05:21:29.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1757999999999999e-05 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22178 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 48.842178345999997, 2024-09-12T05:21:29.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054845368999999998, 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22178 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:29.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167182+0000", 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167189+0000", 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.81e-06 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167221+0000", 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2400999999999997e-05 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167237+0000", 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5693e-05 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221845+0000", 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054608139 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221934+0000", 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9586000000000006e-05 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.222026+0000", 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1466999999999997e-05 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.083 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:55996 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.311344423000001, 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054112130000000001, 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.084 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 55996 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698015+0000", 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.82e-07 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698017+0000", 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1799999999999999e-06 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698024+0000", 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5830000000000003e-06 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698028+0000", 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7299999999999996e-06 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748691+0000", 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050662709 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748758+0000", 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6920000000000003e-05 2024-09-12T05:21:29.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752127+0000", 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033684259999999999 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56145 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:29.089 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.305809883999999, 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053461886, 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56145 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703552+0000", 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3879999999999998e-06 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703559+0000", 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5059999999999998e-06 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703565+0000", 2024-09-12T05:21:29.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.964e-06 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752009+0000", 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.048444050000000002 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752076+0000", 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7083999999999997e-05 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757011+0000", 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049343850000000003 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56146 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.305785741999998, 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053664649000000002, 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.094 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56146 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703574+0000", 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5699999999999998e-07 2024-09-12T05:21:29.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703581+0000", 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5560000000000002e-06 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703589+0000", 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4420000000000001e-06 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703595+0000", 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0070000000000003e-06 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757060+0000", 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053465909999999998 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757143+0000", 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2974999999999998e-05 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757238+0000", 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4302000000000006e-05 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56147 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.305756119999998, 2024-09-12T05:21:29.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054033454000000002, 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56147 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:29.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703606+0000", 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.305e-06 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703613+0000", 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1720000000000001e-06 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703618+0000", 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7339999999999996e-06 2024-09-12T05:21:29.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757277+0000", 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053658748999999999 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757529+0000", 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025211199999999997 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757636+0000", 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010683600000000001 2024-09-12T05:21:29.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56148 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.305733132, 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054391660000000001, 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56148 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703629+0000", 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4339999999999999e-06 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703636+0000", 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1999999999999997e-06 2024-09-12T05:21:29.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703642+0000", 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1829999999999999e-06 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757667+0000", 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054025148000000002 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757737+0000", 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9640000000000004e-05 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.758017+0000", 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000280594 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:81228 3.12 3:4c7b354e:::rbd_data.11185a81880a.0000000000000000:head [sparse-read 0~14172160] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.349166327000001, 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052732870000000001, 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 81228 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.109 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660195+0000", 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2869999999999999e-06 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660205+0000", 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0086e-05 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660236+0000", 2024-09-12T05:21:29.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1386000000000001e-05 2024-09-12T05:21:29.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660251+0000", 2024-09-12T05:21:29.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5173e-05 2024-09-12T05:21:29.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660398+0000", 2024-09-12T05:21:29.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146537 2024-09-12T05:21:29.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660674+0000", 2024-09-12T05:21:29.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027622399999999999 2024-09-12T05:21:29.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.712925+0000", 2024-09-12T05:21:29.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052251177000000003 2024-09-12T05:21:29.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.114 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.115 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:83607 3.12 3:4a56a2a1:::rbd_data.11182b429d69.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 886864~48318] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:29.115 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:29.115 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5160342409999998, 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.057842625000000002, 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 83607 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493327+0000", 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9539999999999998e-06 2024-09-12T05:21:29.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501945+0000", 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086183170000000003 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501967+0000", 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-05 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501982+0000", 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4532000000000001e-05 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502045+0000", 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3579999999999998e-05 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502168+0000", 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012290200000000001 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:21:29.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502477+0000", 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000308244 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.525615+0000", 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023138784999999999 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551038+0000", 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025422836000000001 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551116+0000", 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8254e-05 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551167+0000", 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0720999999999998e-05 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:29.121 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:29.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:29.123 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:29.123+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:29.225 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:29.219+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:29.259 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:29.259 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:29.259 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:29.259 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:29.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:29.361 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:29.359+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:29.426 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:29.423+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:29.456 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:29.456 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:29.456 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:29.456 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:29.456 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:29.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:29.527 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:29.523+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:29.549 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone30 2024-09-12T05:21:29.628 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:29.623+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:29.663 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:29.663 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:29.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:29.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:29.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.541853798999998, 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.665 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.665 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:21:29.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.665 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:29.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:29.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:21:29.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:21:29.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:21:29.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:21:29.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:21:29.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:29.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:21:29.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:21:29.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:21:29.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:21:29.674 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.674 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.674 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.211252729000002, 2024-09-12T05:21:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:21:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:29.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.676 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:21:29.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.676 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:21:29.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:21:29.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:21:29.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:21:29.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:21:29.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:21:29.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:21:29.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:21:29.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:21:29.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.084692291, 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.682 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:29.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:29.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:29.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:21:29.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:21:29.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:21:29.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:21:29.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:21:29.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:21:29.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.084166765999999, 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.689 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:21:29.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:29.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:21:29.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:21:29.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:21:29.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:21:29.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:21:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:29.694 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.084144217999999, 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:29.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:29.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:21:29.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:21:29.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:21:29.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:21:29.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.084122428000001, 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:21:29.700 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:21:29.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:21:29.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:21:29.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:21:29.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:21:29.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:29.705 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.084101062999999, 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:29.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:29.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:21:29.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:21:29.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:21:29.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:21:29.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.084078517999998, 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.711 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:21:29.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:21:29.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.084056282999999, 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:21:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:21:29.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:21:29.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:21:29.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:21:29.721 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.721 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.721 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.084034699, 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.722 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:21:29.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.083833299999998, 2024-09-12T05:21:29.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:29.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:29.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:29.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:29.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:21:29.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:21:29.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:21:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:21:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:21:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.0838079, 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.733 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:21:29.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.737 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.076534623000001, 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:21:29.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.076512232999999, 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.743 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.744 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.744 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.744 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:21:29.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.744 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:21:29.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:21:29.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:21:29.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.749 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.076489585000001, 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.750 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:21:29.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:21:29.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.076469096, 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.756 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:21:29.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.076443031, 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:21:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.076419814000001, 2024-09-12T05:21:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:21:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:21:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:21:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:21:29.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:21:29.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.076397450000002, 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:21:29.771 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:21:29.775 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.599857073999999, 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:29.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:21:29.780 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.781 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.781 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.781 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:29.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:29.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:29.784 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-12T05:21:29.784 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:29.779+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:29.884 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:29.879+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:87673 3.8 e81/23 3:147fd087:::rbd_header.11184bf9b08e:head v 81'476, mlcod=79'474)", 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:29.961775+0000", 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.000904808, 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00091976600000000003, 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:29.961 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.961775+0000", 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.961775+0000", 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:29.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.961777+0000", 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7150000000000001e-06 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.961786+0000", 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.961804+0000", 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7870999999999999e-05 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.961811+0000", 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1600000000000001e-06 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.961875+0000", 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3859e-05 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:29.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.961898+0000", 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3314000000000001e-05 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.962635+0000", 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00073666300000000003 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:29.962695+0000", 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0516000000000001e-05 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:29.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:29.966 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:29.966 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 1 2024-09-12T05:21:29.966 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:29.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:29.985 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:29.979+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:29.996 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:30.014 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:30.033 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:30.033 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:30.050 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:30.050 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:30.050 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:30.072 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:30.072 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:30.085 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:30.083+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:30.093 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:30.093 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:30.113 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:30.116 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:30.116 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:30.117 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:30.118 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:30.118 INFO:teuthology.orchestra.run.smithi059.stdout:3793 trunc from 0xb273f1c to 0xdc37c64 2024-09-12T05:21:30.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:30.142 INFO:teuthology.orchestra.run.smithi059.stdout:3794 write 0xcab9c37 thru 0xcac14ea (0x78b4 bytes) 2024-09-12T05:21:30.151 INFO:teuthology.orchestra.run.smithi059.stdout:3795 read 0x6105eae thru 0x6114a8b (0xebde bytes) 2024-09-12T05:21:30.151 INFO:teuthology.orchestra.run.smithi059.stdout:3796 punch from 0xc31c51 to 0xc3dbe7, (0xbf96 bytes) 2024-09-12T05:21:30.161 INFO:teuthology.orchestra.run.smithi059.stdout:3797 trunc from 0xdc37c64 to 0x7108242 2024-09-12T05:21:30.186 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:30.183+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:30.233 INFO:teuthology.orchestra.run.smithi059.stdout:3799 punch from 0x4c8eddd to 0x4c985b4, (0x97d7 bytes) 2024-09-12T05:21:30.239 INFO:teuthology.orchestra.run.smithi059.stdout:3800 trunc from 0x7108242 to 0x286ca57 2024-09-12T05:21:30.262 INFO:teuthology.orchestra.run.smithi059.stdout:3801 write 0x142fd2 thru 0x143d88 (0xdb7 bytes) 2024-09-12T05:21:30.271 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:30.272 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:30.284 INFO:teuthology.orchestra.run.smithi059.stdout:3802 write 0x6a811eb thru 0x6a90cfd (0xfb13 bytes) 2024-09-12T05:21:30.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:30.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:30.283+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:30.290 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.311 INFO:teuthology.orchestra.run.smithi059.stdout:3805 write 0x89fac50 thru 0x8a0a022 (0xf3d3 bytes) 2024-09-12T05:21:30.331 INFO:teuthology.orchestra.run.smithi059.stdout:3806 writesame 0xaa4c7da thru 0xaa4f241 data_size 0x2e(0x2a68 bytes) 2024-09-12T05:21:30.347 INFO:teuthology.orchestra.run.smithi059.stdout:3807 write 0xc26516b thru 0xc2657e8 (0x67e bytes) 2024-09-12T05:21:30.367 INFO:teuthology.orchestra.run.smithi059.stdout:3808 trunc from 0xc2657e9 to 0x6c1a137 2024-09-12T05:21:30.387 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:30.383+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:30.401 INFO:teuthology.orchestra.run.smithi059.stdout:3810 punch from 0x5eb8a4 to 0x5f6911, (0xb06d bytes) 2024-09-12T05:21:30.402 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.420 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:30.420 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:30.421 INFO:teuthology.orchestra.run.smithi059.stdout:3813 writesame 0x91ed7de thru 0x91eeced data_size 0x8(0x1510 bytes) 2024-09-12T05:21:30.421 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:21:30.429 INFO:teuthology.orchestra.run.smithi059.stdout:3816 trunc from 0x91eecee to 0xcb90855 2024-09-12T05:21:30.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:30.442 INFO:teuthology.orchestra.run.smithi059.stdout:3818 writesame 0x68c62a9 thru 0x68cd214 data_size 0x6(0x6f6c bytes) 2024-09-12T05:21:30.445 INFO:teuthology.orchestra.run.smithi059.stdout:3819 write 0x54e7bb2 thru 0x54ec714 (0x4b63 bytes) 2024-09-12T05:21:30.449 INFO:teuthology.orchestra.run.smithi059.stdout:3820 read 0x6e44a25 thru 0x6e4e439 (0x9a15 bytes) 2024-09-12T05:21:30.450 INFO:teuthology.orchestra.run.smithi059.stdout:3822 write 0x1bc47e6 thru 0x1bcfabf (0xb2da bytes) 2024-09-12T05:21:30.468 INFO:teuthology.orchestra.run.smithi059.stdout:3823 writesame 0xd6ae58f thru 0xd6b5b06 data_size 0x54(0x7578 bytes) 2024-09-12T05:21:30.469 INFO:teuthology.orchestra.run.smithi059.stdout:3825 read 0x6210572 thru 0x621d2e5 (0xcd74 bytes) 2024-09-12T05:21:30.469 INFO:teuthology.orchestra.run.smithi059.stdout:3826 read 0x1f93838 thru 0x1f9f4fc (0xbcc5 bytes) 2024-09-12T05:21:30.470 INFO:teuthology.orchestra.run.smithi059.stdout:3827 read 0x605a522 thru 0x6065d1e (0xb7fd bytes) 2024-09-12T05:21:30.471 INFO:teuthology.orchestra.run.smithi059.stdout:3828 read 0xa8b31ba thru 0xa8b6ce7 (0x3b2e bytes) 2024-09-12T05:21:30.471 INFO:teuthology.orchestra.run.smithi059.stdout:3829 write 0x6032d50 thru 0x603b06d (0x831e bytes) 2024-09-12T05:21:30.475 INFO:teuthology.orchestra.run.smithi059.stdout:3830 read 0x699a04b thru 0x699f055 (0x500b bytes) 2024-09-12T05:21:30.476 INFO:teuthology.orchestra.run.smithi059.stdout:3831 writesame 0x9a54a92 thru 0x9a60d15 data_size 0x76(0xc284 bytes) 2024-09-12T05:21:30.484 INFO:teuthology.orchestra.run.smithi059.stdout:3832 write 0x5565a9a thru 0x5566668 (0xbcf bytes) 2024-09-12T05:21:30.488 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:30.483+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:30.488 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.499 INFO:teuthology.orchestra.run.smithi059.stdout:3834 trunc from 0xd6b5b07 to 0x611ab96 2024-09-12T05:21:30.530 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.530 INFO:teuthology.orchestra.run.smithi059.stdout:3836 read 0x39b47bd thru 0x39c1be9 (0xd42d bytes) 2024-09-12T05:21:30.531 INFO:teuthology.orchestra.run.smithi059.stdout:3837 write 0x1aa64c5 thru 0x1ab4702 (0xe23e bytes) 2024-09-12T05:21:30.548 INFO:teuthology.orchestra.run.smithi059.stdout:3838 write 0x67aef0d thru 0x67bcc8f (0xdd83 bytes) 2024-09-12T05:21:30.550 INFO:teuthology.orchestra.run.smithi059.stdout:3839 writesame 0x23d54d6 thru 0x23d54e2 data_size 0x1(0xd bytes) 2024-09-12T05:21:30.552 INFO:teuthology.orchestra.run.smithi059.stdout:3840 punch from 0x35f7d73 to 0x3604416, (0xc6a3 bytes) 2024-09-12T05:21:30.553 INFO:teuthology.orchestra.run.smithi059.stdout:3841 read 0x5959916 thru 0x595b491 (0x1b7c bytes) 2024-09-12T05:21:30.553 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.553 INFO:teuthology.orchestra.run.smithi059.stdout:3844 punch from 0x47defde to 0x47e0a7b, (0x1a9d bytes) 2024-09-12T05:21:30.553 INFO:teuthology.orchestra.run.smithi059.stdout:3845 writesame 0xe5df2f thru 0xe5e4e9 data_size 0x3(0x5bb bytes) 2024-09-12T05:21:30.556 INFO:teuthology.orchestra.run.smithi059.stdout:3846 write 0x3695332 thru 0x36a3247 (0xdf16 bytes) 2024-09-12T05:21:30.581 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:30.582 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:30.584 INFO:teuthology.orchestra.run.smithi059.stdout:3847 write 0xea6a24e thru 0xea70701 (0x64b4 bytes) 2024-09-12T05:21:30.589 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:30.587+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:30.592 INFO:teuthology.orchestra.run.smithi059.stdout:3848 read 0x50b6034 thru 0x50c34e7 (0xd4b4 bytes) 2024-09-12T05:21:30.593 INFO:teuthology.orchestra.run.smithi059.stdout:3849 write 0xdd40d3f thru 0xdd43945 (0x2c07 bytes) 2024-09-12T05:21:30.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:30.601 INFO:teuthology.orchestra.run.smithi059.stdout:3850 read 0xc052523 thru 0xc058713 (0x61f1 bytes) 2024-09-12T05:21:30.601 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.609 INFO:teuthology.orchestra.run.smithi059.stdout:3853 trunc from 0xea70702 to 0x86dd035 2024-09-12T05:21:30.641 INFO:teuthology.orchestra.run.smithi059.stdout:3854 read 0x19d90a5 thru 0x19e1bcd (0x8b29 bytes) 2024-09-12T05:21:30.642 INFO:teuthology.orchestra.run.smithi059.stdout:3855 trunc from 0x86dd035 to 0x7678da0 2024-09-12T05:21:30.662 INFO:teuthology.orchestra.run.smithi059.stdout:3857 punch from 0x287e777 to 0x28800a7, (0x1930 bytes) 2024-09-12T05:21:30.686 INFO:teuthology.orchestra.run.smithi059.stdout:3858 write 0xc3f977e thru 0xc4040af (0xa932 bytes) 2024-09-12T05:21:30.689 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:30.687+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:30.697 INFO:teuthology.orchestra.run.smithi059.stdout:3859 punch from 0x8bb7fcd to 0x8bc55d7, (0xd60a bytes) 2024-09-12T05:21:30.698 INFO:teuthology.orchestra.run.smithi059.stdout:3860 punch from 0x476642d to 0x4774846, (0xe419 bytes) 2024-09-12T05:21:30.698 INFO:teuthology.orchestra.run.smithi059.stdout:3861 write 0x856b941 thru 0x8573162 (0x7822 bytes) 2024-09-12T05:21:30.706 INFO:teuthology.orchestra.run.smithi059.stdout:3865 trunc from 0xc4040b0 to 0x8d3c66e 2024-09-12T05:21:30.735 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:30.735 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:30.740 INFO:teuthology.orchestra.run.smithi059.stdout:3866 read 0x222d479 thru 0x2231292 (0x3e1a bytes) 2024-09-12T05:21:30.741 INFO:teuthology.orchestra.run.smithi059.stdout:3867 punch from 0x4b81a9d to 0x4b9058f, (0xeaf2 bytes) 2024-09-12T05:21:30.741 INFO:teuthology.orchestra.run.smithi059.stdout:3868 punch from 0x5a6aea3 to 0x5a705ef, (0x574c bytes) 2024-09-12T05:21:30.741 INFO:teuthology.orchestra.run.smithi059.stdout:3869 read 0x448687a thru 0x448c084 (0x580b bytes) 2024-09-12T05:21:30.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:30.767 INFO:teuthology.orchestra.run.smithi059.stdout:3870 writesame 0xea1a46a thru 0xea24e43 data_size 0x3(0xa9da bytes) 2024-09-12T05:21:30.767 INFO:teuthology.orchestra.run.smithi059.stdout:3872 read 0x8e7179e thru 0x8e74197 (0x29fa bytes) 2024-09-12T05:21:30.767 INFO:teuthology.orchestra.run.smithi059.stdout:3873 read 0x3004460 thru 0x300e63c (0xa1dd bytes) 2024-09-12T05:21:30.768 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.768 INFO:teuthology.orchestra.run.smithi059.stdout:3876 punch from 0xd12c96e to 0xd1318c8, (0x4f5a bytes) 2024-09-12T05:21:30.768 INFO:teuthology.orchestra.run.smithi059.stdout:3877 write 0x9e4ee31 thru 0x9e5c17a (0xd34a bytes) 2024-09-12T05:21:30.777 INFO:teuthology.orchestra.run.smithi059.stdout:3879 punch from 0x516118c to 0x5161527, (0x39b bytes) 2024-09-12T05:21:30.777 INFO:teuthology.orchestra.run.smithi059.stdout:3881 read 0x8933a85 thru 0x893f9c6 (0xbf42 bytes) 2024-09-12T05:21:30.777 INFO:teuthology.orchestra.run.smithi059.stdout:3883 read 0x8e1b872 thru 0x8e298e0 (0xe06f bytes) 2024-09-12T05:21:30.778 INFO:teuthology.orchestra.run.smithi059.stdout:3884 read 0x851bcb7 thru 0x8522622 (0x696c bytes) 2024-09-12T05:21:30.779 INFO:teuthology.orchestra.run.smithi059.stdout:3886 read 0x44c6036 thru 0x44cc914 (0x68df bytes) 2024-09-12T05:21:30.780 INFO:teuthology.orchestra.run.smithi059.stdout:3887 write 0x5b08071 thru 0x5b1769f (0xf62f bytes) 2024-09-12T05:21:30.784 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.791 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:30.787+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:30.792 INFO:teuthology.orchestra.run.smithi059.stdout:3889 trunc from 0xea24e44 to 0x9888886 2024-09-12T05:21:30.809 INFO:teuthology.orchestra.run.smithi059.stdout:3892 read 0x20f27f5 thru 0x21027ad (0xffb9 bytes) 2024-09-12T05:21:30.810 INFO:teuthology.orchestra.run.smithi059.stdout:3893 read 0x41f7faa thru 0x41f92b6 (0x130d bytes) 2024-09-12T05:21:30.811 INFO:teuthology.orchestra.run.smithi059.stdout:3894 punch from 0x48d78df to 0x48e05b8, (0x8cd9 bytes) 2024-09-12T05:21:30.816 INFO:teuthology.orchestra.run.smithi059.stdout:3895 trunc from 0x9888886 to 0xd57f550 2024-09-12T05:21:30.831 INFO:teuthology.orchestra.run.smithi059.stdout:3896 writesame 0x8bd6ff8 thru 0x8be31bf data_size 0x9f(0xc1c8 bytes) 2024-09-12T05:21:30.835 INFO:teuthology.orchestra.run.smithi059.stdout:3898 read 0xaf55007 thru 0xaf640a7 (0xf0a1 bytes) 2024-09-12T05:21:30.835 INFO:teuthology.orchestra.run.smithi059.stdout:3899 punch from 0x601b795 to 0x602a4c9, (0xed34 bytes) 2024-09-12T05:21:30.850 INFO:teuthology.orchestra.run.smithi059.stdout:3901 write 0xda0823a thru 0xda14ae3 (0xc8aa bytes) 2024-09-12T05:21:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:3902 write 0x9bdf175 thru 0x9be7ff7 (0x8e83 bytes) 2024-09-12T05:21:30.867 INFO:teuthology.orchestra.run.smithi059.stdout:3903 punch from 0x91ceb5b to 0x91d738a, (0x882f bytes) 2024-09-12T05:21:30.867 INFO:teuthology.orchestra.run.smithi059.stdout:3904 writesame 0xa72045e thru 0xa7237a5 data_size 0xc(0x3348 bytes) 2024-09-12T05:21:30.871 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:30.871 INFO:teuthology.orchestra.run.smithi059.stdout:3906 write 0x162c769 thru 0x1634d76 (0x860e bytes) 2024-09-12T05:21:30.891 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:30.891 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:30.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:30.887+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:30.904 INFO:teuthology.orchestra.run.smithi059.stdout:3907 trunc from 0xda14ae4 to 0x279d16 2024-09-12T05:21:30.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:3908 read 0xe8986 thru 0xf0b00 (0x817b bytes) 2024-09-12T05:21:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:3909 punch from 0x1c64ca to 0x1c731a, (0xe50 bytes) 2024-09-12T05:21:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:3910 trunc from 0x279d16 to 0x264f9d 2024-09-12T05:21:30.955 INFO:teuthology.orchestra.run.smithi059.stdout:3912 read 0xf3f48 thru 0xf8d56 (0x4e0f bytes) 2024-09-12T05:21:30.966 INFO:teuthology.orchestra.run.smithi059.stdout:3913 trunc from 0x264f9d to 0x66ec490 2024-09-12T05:21:30.979 INFO:teuthology.orchestra.run.smithi059.stdout:3914 write 0x2ba6e10 thru 0x2bb6b41 (0xfd32 bytes) 2024-09-12T05:21:30.982 INFO:teuthology.orchestra.run.smithi059.stdout:3916 read 0x27005a1 thru 0x2706dd2 (0x6832 bytes) 2024-09-12T05:21:30.992 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:30.987+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:30.997 INFO:teuthology.orchestra.run.smithi059.stdout:3918 write 0x7218102 thru 0x7227762 (0xf661 bytes) 2024-09-12T05:21:31.003 INFO:teuthology.orchestra.run.smithi059.stdout:3919 punch from 0x855aab to 0x861f49, (0xc49e bytes) 2024-09-12T05:21:31.031 INFO:teuthology.orchestra.run.smithi059.stdout:3920 writesame 0xed376e2 thru 0xed4246b data_size 0x61(0xad8a bytes) 2024-09-12T05:21:31.031 INFO:teuthology.orchestra.run.smithi059.stdout:3921 writesame 0xbdfabf6 thru 0xbdffd39 data_size 0x7(0x5144 bytes) 2024-09-12T05:21:31.042 INFO:teuthology.orchestra.run.smithi059.stdout:3922 read 0xb9ed47f thru 0xb9f82b2 (0xae34 bytes) 2024-09-12T05:21:31.042 INFO:teuthology.orchestra.run.smithi059.stdout:3924 punch from 0x2f1d357 to 0x2f23043, (0x5cec bytes) 2024-09-12T05:21:31.042 INFO:teuthology.orchestra.run.smithi059.stdout:3925 writesame 0x7a32f8f thru 0x7a3cef7 data_size 0x3d(0x9f69 bytes) 2024-09-12T05:21:31.048 INFO:teuthology.orchestra.run.smithi059.stdout:3926 trunc from 0xed4246c to 0xd2433bd 2024-09-12T05:21:31.065 INFO:teuthology.orchestra.run.smithi059.stdout:3927 punch from 0x12eae80 to 0x12f5eb4, (0xb034 bytes) 2024-09-12T05:21:31.065 INFO:teuthology.orchestra.run.smithi059.stdout:3928 read 0xb474f6a thru 0xb480784 (0xb81b bytes) 2024-09-12T05:21:31.065 INFO:teuthology.orchestra.run.smithi059.stdout:3929 read 0xa82ab40 thru 0xa8359af (0xae70 bytes) 2024-09-12T05:21:31.066 INFO:teuthology.orchestra.run.smithi059.stdout:3930 read 0x57b7f7f thru 0x57b838c (0x40e bytes) 2024-09-12T05:21:31.066 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.070 INFO:teuthology.orchestra.run.smithi059.stdout:3932 trunc from 0xd2433bd to 0xb46fbb7 2024-09-12T05:21:31.075 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:31.075 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:31.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:31.091 INFO:teuthology.orchestra.run.smithi059.stdout:3935 trunc from 0xb46fbb7 to 0xcebe664 2024-09-12T05:21:31.092 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:31.087+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:31.104 INFO:teuthology.orchestra.run.smithi059.stdout:3936 writesame 0x5a3db05 thru 0x5a40f73 data_size 0x1(0x346f bytes) 2024-09-12T05:21:31.110 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.123 INFO:teuthology.orchestra.run.smithi059.stdout:3940 writesame 0xd5b6f5c thru 0xd5c59c3 data_size 0x34(0xea68 bytes) 2024-09-12T05:21:31.123 INFO:teuthology.orchestra.run.smithi059.stdout:3941 read 0x62f6592 thru 0x62fe2cc (0x7d3b bytes) 2024-09-12T05:21:31.124 INFO:teuthology.orchestra.run.smithi059.stdout:3943 read 0x93d4ad8 thru 0x93d8e09 (0x4332 bytes) 2024-09-12T05:21:31.124 INFO:teuthology.orchestra.run.smithi059.stdout:3944 punch from 0x772fed0 to 0x7731bfc, (0x1d2c bytes) 2024-09-12T05:21:31.137 INFO:teuthology.orchestra.run.smithi059.stdout:3945 write 0xde210ef thru 0xde2f257 (0xe169 bytes) 2024-09-12T05:21:31.143 INFO:teuthology.orchestra.run.smithi059.stdout:3946 writesame 0x25c21d9 thru 0x25c2330 data_size 0x2(0x158 bytes) 2024-09-12T05:21:31.146 INFO:teuthology.orchestra.run.smithi059.stdout:3948 read 0xf1ac2b thru 0xf2377b (0x8b51 bytes) 2024-09-12T05:21:31.147 INFO:teuthology.orchestra.run.smithi059.stdout:3949 read 0xacc1842 thru 0xacc6cda (0x5499 bytes) 2024-09-12T05:21:31.155 INFO:teuthology.orchestra.run.smithi059.stdout:3950 trunc from 0xde2f258 to 0x93a094c 2024-09-12T05:21:31.171 INFO:teuthology.orchestra.run.smithi059.stdout:3951 punch from 0x7599da3 to 0x75a9063, (0xf2c0 bytes) 2024-09-12T05:21:31.185 INFO:teuthology.orchestra.run.smithi059.stdout:3952 writesame 0x977978b thru 0x977ce8b data_size 0x1(0x3701 bytes) 2024-09-12T05:21:31.185 INFO:teuthology.orchestra.run.smithi059.stdout:3953 read 0x6d9f57 thru 0x6e42bc (0xa366 bytes) 2024-09-12T05:21:31.193 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:31.191+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:31.205 INFO:teuthology.orchestra.run.smithi059.stdout:3954 write 0xc2d93c4 thru 0xc2dbc41 (0x287e bytes) 2024-09-12T05:21:31.213 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.213 INFO:teuthology.orchestra.run.smithi059.stdout:3956 punch from 0xb95a1c1 to 0xb962897, (0x86d6 bytes) 2024-09-12T05:21:31.213 INFO:teuthology.orchestra.run.smithi059.stdout:3957 punch from 0xe876f1 to 0xe963c1, (0xecd0 bytes) 2024-09-12T05:21:31.213 INFO:teuthology.orchestra.run.smithi059.stdout:3958 writesame 0x6de6591 thru 0x6df35bf data_size 0x3(0xd02f bytes) 2024-09-12T05:21:31.217 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:31.217 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:31.232 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:31.232 INFO:teuthology.orchestra.run.smithi059.stdout:3959 read 0x15dd06b thru 0x15e978e (0xc724 bytes) 2024-09-12T05:21:31.234 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.248 INFO:teuthology.orchestra.run.smithi059.stdout:3961 write 0xc60a199 thru 0xc611f08 (0x7d70 bytes) 2024-09-12T05:21:31.253 INFO:teuthology.orchestra.run.smithi059.stdout:3963 read 0x5456fbc thru 0x545c0b8 (0x50fd bytes) 2024-09-12T05:21:31.254 INFO:teuthology.orchestra.run.smithi059.stdout:3964 read 0x3d903cc thru 0x3d9dd2e (0xd963 bytes) 2024-09-12T05:21:31.255 INFO:teuthology.orchestra.run.smithi059.stdout:3965 write 0x98c0e5b thru 0x98c383b (0x29e1 bytes) 2024-09-12T05:21:31.257 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.257 INFO:teuthology.orchestra.run.smithi059.stdout:3968 writesame 0x6422f55 thru 0x6432e5c data_size 0x4(0xff08 bytes) 2024-09-12T05:21:31.271 INFO:teuthology.orchestra.run.smithi059.stdout:3971 read 0x19e1728 thru 0x19e822e (0x6b07 bytes) 2024-09-12T05:21:31.272 INFO:teuthology.orchestra.run.smithi059.stdout:3972 read 0x4e2d960 thru 0x4e33330 (0x59d1 bytes) 2024-09-12T05:21:31.272 INFO:teuthology.orchestra.run.smithi059.stdout:3973 read 0xb1d90f1 thru 0xb1e85b7 (0xf4c7 bytes) 2024-09-12T05:21:31.274 INFO:teuthology.orchestra.run.smithi059.stdout:3974 trunc from 0xc611f09 to 0xc387c08 2024-09-12T05:21:31.286 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.286 INFO:teuthology.orchestra.run.smithi059.stdout:3977 read 0xafc250f thru 0xafcd015 (0xab07 bytes) 2024-09-12T05:21:31.286 INFO:teuthology.orchestra.run.smithi059.stdout:3978 write 0x65b7466 thru 0x65c3ad4 (0xc66f bytes) 2024-09-12T05:21:31.293 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.294 INFO:teuthology.orchestra.run.smithi059.stdout:3981 write 0x6438537 thru 0x643918d (0xc57 bytes) 2024-09-12T05:21:31.294 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:31.291+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:31.295 INFO:teuthology.orchestra.run.smithi059.stdout:3982 write 0x9f9482f thru 0x9f9b549 (0x6d1b bytes) 2024-09-12T05:21:31.298 INFO:teuthology.orchestra.run.smithi059.stdout:3983 write 0x5a51461 thru 0x5a59b39 (0x86d9 bytes) 2024-09-12T05:21:31.301 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.301 INFO:teuthology.orchestra.run.smithi059.stdout:3985 write 0x489bf61 thru 0x48aaf82 (0xf022 bytes) 2024-09-12T05:21:31.303 INFO:teuthology.orchestra.run.smithi059.stdout:3986 read 0xbec1689 thru 0xbecba4a (0xa3c2 bytes) 2024-09-12T05:21:31.310 INFO:teuthology.orchestra.run.smithi059.stdout:3987 trunc from 0xc387c08 to 0x99f1e83 2024-09-12T05:21:31.323 INFO:teuthology.orchestra.run.smithi059.stdout:3988 write 0x66362c7 thru 0x663a4d1 (0x420b bytes) 2024-09-12T05:21:31.327 INFO:teuthology.orchestra.run.smithi059.stdout:3989 read 0x24d9ccc thru 0x24dd3c0 (0x36f5 bytes) 2024-09-12T05:21:31.328 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:31.352 INFO:teuthology.orchestra.run.smithi059.stdout:3992 write 0xdf5538e thru 0xdf5e711 (0x9384 bytes) 2024-09-12T05:21:31.370 INFO:teuthology.orchestra.run.smithi059.stdout:3994 trunc from 0xdf5e712 to 0x90b6b2e 2024-09-12T05:21:31.370 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:31.371 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:31.389 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:31.395 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:31.391+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:31.396 INFO:teuthology.orchestra.run.smithi059.stdout:3995 punch from 0x7de79c1 to 0x7df77c0, (0xfdff bytes) 2024-09-12T05:21:31.396 INFO:teuthology.orchestra.run.smithi059.stdout:3996 read 0x23cb728 thru 0x23ceb87 (0x3460 bytes) 2024-09-12T05:21:31.397 INFO:teuthology.orchestra.run.smithi059.stdout:3998 punch from 0x22472a5 to 0x2254232, (0xcf8d bytes) 2024-09-12T05:21:31.397 INFO:teuthology.orchestra.run.smithi059.stdout:3999 clone 32 order 20 su 16384 sc 7 2024-09-12T05:21:31.406 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:21:31.496 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:31.491+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:31.508 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:31.509 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:31.511 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6] out_osds: [2] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:21:31.511 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:31.511 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T05:21:31.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:21:31.523 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:31.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:31.611+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:31.690 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:31.690 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:31.697 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:31.695+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:31.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:31.798 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:31.795+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 82, 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:21:31.390281+0000", 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:21:02.127583+0000", 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:21:21.323025+0000", 2024-09-12T05:21:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5799936, 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 5, 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:21:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "luminous", 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:21:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:21:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:21:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:21:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:21:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 2, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 2, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.75, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.5, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.5, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:21:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "81", 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 33, 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 81, 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 2.25, 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 2.25, 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.75, 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.690000057220459, 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.690000057220459, 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 0.80352783203125, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:21:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 77, 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:21:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 0, 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 0, 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 76, 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:21:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:21:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 74, 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:21:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:21:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:21:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 0, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:21:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 60, 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/2467380900", 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/2467380900", 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/2467380900", 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/2467380900", 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "exists" 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 74, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:21:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:21:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 77, 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:21:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:21:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:21:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 65536, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 60 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [ 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.4", 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 0, 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 4 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.15", 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [ 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.4", 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: 0 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.9", 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: 7, 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:21:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:21:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:21:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:21:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:21:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:21:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:21:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:21:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:21:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:31.916 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:31.918 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:31.918 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:31.919 INFO:tasks.thrashosds.thrasher:j is {'epoch': 82, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:21:31.390281+0000', 'last_up_change': '2024-09-12T05:21:02.127583+0000', 'last_in_change': '2024-09-12T05:21:21.323025+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 81, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 0.75, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.80352783203125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 77, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 76, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 60, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 2467380900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 2467380900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 2467380900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 2467380900}]}, 'public_addr': '172.21.15.194:6825/2467380900', 'cluster_addr': '172.21.15.194:6827/2467380900', 'heartbeat_back_addr': '172.21.15.194:6831/2467380900', 'heartbeat_front_addr': '172.21.15.194:6829/2467380900', 'state': ['exists']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 77, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 60}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.4', 'mappings': [{'from': 0, 'to': 4}]}, {'pgid': '3.15', 'mappings': [{'from': 3, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '2.4', 'osds': [1, 0]}, {'pgid': '3.9', 'osds': [7, 2]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:21:31.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:21:31.920 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:31.920 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:31.915+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:32.018 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:32.015+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:32.087 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:32.087 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:32.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:32.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:32.149 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:32.147+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:32.220 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:32.215+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:32.224 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:32.224 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:32.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:32.257 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:32.257 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:32.273 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:32.280 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:21:32.281 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:21:32.291 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:32.299 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-12T05:21:31.405183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1045887382,"num_objects":1979,"num_object_clones":332,"num_object_copies":3958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":756,"num_objects_misplaced":73,"num_objects_unfound":0,"num_objects_dirty":1979,"num_whiteouts":1169,"num_read":110266,"num_read_kb":582473,"num_write":15864,"num_write_kb":383672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":407,"num_bytes_recovered":16820010,"num_keys_recovered":39,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13242,"ondisk_log_size":13242,"up":68,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":810844,"kb_used_data":523152,"kb_used_omap":10,"kb_used_meta":287541,"kb_avail":659792036,"statfs":{"total":676457349120,"available":675627044864,"internally_reserved":0,"allocated":535707648,"data_stored":684770495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11157,"internal_metadata":294442091},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":67292083,"num_objects":98,"num_object_clones":18,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":73,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":53,"num_read":5325,"num_read_kb":38538,"num_write":689,"num_write_kb":54859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":4833579,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.485439"},"pg_stats":[{"pgid":"3.1f","version":"78'315","reported_seq":8109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.727677+0000","last_change":"2024-09-12T05:20:11.762958+0000","last_active":"2024-09-12T05:21:26.727677+0000","last_peered":"2024-09-12T05:21:26.727677+0000","last_clean":"2024-09-12T05:21:26.727677+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:21:26.727677+0000","last_undegraded":"2024-09-12T05:21:26.727677+0000","last_fullsized":"2024-09-12T05:21:26.727677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:01.085355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036800549999999998,"stat_sum":{"num_bytes":22917177,"num_objects":76,"num_object_clones":16,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":42,"num_read":8397,"num_read_kb":32395,"num_write":310,"num_write_kb":7541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"78'240","reported_seq":5725,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.763851+0000","last_change":"2024-09-12T05:20:34.070752+0000","last_active":"2024-09-12T05:21:26.763851+0000","last_peered":"2024-09-12T05:21:26.763851+0000","last_clean":"2024-09-12T05:21:26.763851+0000","last_became_active":"2024-09-12T05:20:33.940420+0000","last_became_peered":"2024-09-12T05:20:33.940420+0000","last_unstale":"2024-09-12T05:21:26.763851+0000","last_undegraded":"2024-09-12T05:21:26.763851+0000","last_fullsized":"2024-09-12T05:21:26.763851+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:45.430728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015371499999999999,"stat_sum":{"num_bytes":57185668,"num_objects":58,"num_object_clones":12,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":34,"num_read":5383,"num_read_kb":55103,"num_write":263,"num_write_kb":10677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"78'415","reported_seq":2676,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:25.915723+0000","last_change":"2024-09-12T05:21:03.152999+0000","last_active":"2024-09-12T05:21:25.915723+0000","last_peered":"2024-09-12T05:21:25.915723+0000","last_clean":"2024-09-12T05:21:01.134623+0000","last_became_active":"2024-09-12T05:21:03.152999+0000","last_became_peered":"2024-09-12T05:21:03.152999+0000","last_unstale":"2024-09-12T05:21:25.915723+0000","last_undegraded":"2024-09-12T05:21:03.151855+0000","last_fullsized":"2024-09-12T05:21:03.151583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:41.829305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098006399999999989,"stat_sum":{"num_bytes":21542821,"num_objects":60,"num_object_clones":10,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":60,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":34,"num_read":3243,"num_read_kb":4078,"num_write":438,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":60}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"78'331","reported_seq":2164,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:26.963860+0000","last_change":"2024-09-12T05:21:03.156068+0000","last_active":"2024-09-12T05:21:26.963860+0000","last_peered":"2024-09-12T05:21:26.963860+0000","last_clean":"2024-09-12T05:21:01.134412+0000","last_became_active":"2024-09-12T05:21:03.156068+0000","last_became_peered":"2024-09-12T05:21:03.156068+0000","last_unstale":"2024-09-12T05:21:26.963860+0000","last_undegraded":"2024-09-12T05:21:03.151787+0000","last_fullsized":"2024-09-12T05:21:03.151493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:22.164165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087905899999999996,"stat_sum":{"num_bytes":17262759,"num_objects":63,"num_object_clones":11,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":63,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":40,"num_read":2069,"num_read_kb":9763,"num_write":347,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":63}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'253","reported_seq":1641,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:26.839055+0000","last_change":"2024-09-12T05:21:03.160720+0000","last_active":"2024-09-12T05:21:26.839055+0000","last_peered":"2024-09-12T05:21:26.839055+0000","last_clean":"2024-09-12T05:21:01.133569+0000","last_became_active":"2024-09-12T05:21:03.160720+0000","last_became_peered":"2024-09-12T05:21:03.160720+0000","last_unstale":"2024-09-12T05:21:26.839055+0000","last_undegraded":"2024-09-12T05:21:03.156540+0000","last_fullsized":"2024-09-12T05:21:03.156423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:02.203597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040909680000000004,"stat_sum":{"num_bytes":32102466,"num_objects":66,"num_object_clones":10,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":43,"num_read":1338,"num_read_kb":27149,"num_write":224,"num_write_kb":20833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":66}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"78'304","reported_seq":2826,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:27.034460+0000","last_change":"2024-09-12T05:21:03.156899+0000","last_active":"2024-09-12T05:21:27.034460+0000","last_peered":"2024-09-12T05:21:27.034460+0000","last_clean":"2024-09-12T05:20:53.806542+0000","last_became_active":"2024-09-12T05:21:03.156899+0000","last_became_peered":"2024-09-12T05:21:03.156899+0000","last_unstale":"2024-09-12T05:21:27.034460+0000","last_undegraded":"2024-09-12T05:21:03.155951+0000","last_fullsized":"2024-09-12T05:21:03.155860+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:21.592334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014130220000000001,"stat_sum":{"num_bytes":22070885,"num_objects":57,"num_object_clones":10,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":57,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":37,"num_read":3507,"num_read_kb":10578,"num_write":274,"num_write_kb":17591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":57}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"78'308","reported_seq":1865,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.649844+0000","last_change":"2024-09-12T05:20:11.741831+0000","last_active":"2024-09-12T05:21:25.649844+0000","last_peered":"2024-09-12T05:21:25.649844+0000","last_clean":"2024-09-12T05:21:25.649844+0000","last_became_active":"2024-09-12T05:20:09.736422+0000","last_became_peered":"2024-09-12T05:20:09.736422+0000","last_unstale":"2024-09-12T05:21:25.649844+0000","last_undegraded":"2024-09-12T05:21:25.649844+0000","last_fullsized":"2024-09-12T05:21:25.649844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:24.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001296167,"stat_sum":{"num_bytes":20188938,"num_objects":60,"num_object_clones":5,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":35,"num_read":2079,"num_read_kb":8145,"num_write":284,"num_write_kb":4290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"78'415","reported_seq":2324,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.492959+0000","last_change":"2024-09-12T05:20:11.786941+0000","last_active":"2024-09-12T05:21:26.492959+0000","last_peered":"2024-09-12T05:21:26.492959+0000","last_clean":"2024-09-12T05:21:26.492959+0000","last_became_active":"2024-09-12T05:20:09.740953+0000","last_became_peered":"2024-09-12T05:20:09.740953+0000","last_unstale":"2024-09-12T05:21:26.492959+0000","last_undegraded":"2024-09-12T05:21:26.492959+0000","last_fullsized":"2024-09-12T05:21:26.492959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:05.843642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085336099999999996,"stat_sum":{"num_bytes":13978513,"num_objects":60,"num_object_clones":11,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":36,"num_read":3736,"num_read_kb":15055,"num_write":391,"num_write_kb":8540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"78'407","reported_seq":1406,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:27.047469+0000","last_change":"2024-09-12T05:20:11.763561+0000","last_active":"2024-09-12T05:21:27.047469+0000","last_peered":"2024-09-12T05:21:27.047469+0000","last_clean":"2024-09-12T05:21:27.047469+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:21:27.047469+0000","last_undegraded":"2024-09-12T05:21:27.047469+0000","last_fullsized":"2024-09-12T05:21:27.047469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:22.751617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041487850000000003,"stat_sum":{"num_bytes":22807762,"num_objects":52,"num_object_clones":9,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":34,"num_read":2230,"num_read_kb":6491,"num_write":472,"num_write_kb":3794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"78'243","reported_seq":1665,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.796707+0000","last_change":"2024-09-12T05:20:11.737024+0000","last_active":"2024-09-12T05:21:26.796707+0000","last_peered":"2024-09-12T05:21:26.796707+0000","last_clean":"2024-09-12T05:21:26.796707+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:21:26.796707+0000","last_undegraded":"2024-09-12T05:21:26.796707+0000","last_fullsized":"2024-09-12T05:21:26.796707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:15.127015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015614439999999999,"stat_sum":{"num_bytes":44245133,"num_objects":66,"num_object_clones":13,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":41,"num_read":1350,"num_read_kb":13437,"num_write":205,"num_write_kb":11680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"71'232","reported_seq":1223,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.381507+0000","last_change":"2024-09-12T05:20:49.043311+0000","last_active":"2024-09-12T05:21:25.381507+0000","last_peered":"2024-09-12T05:21:25.381507+0000","last_clean":"2024-09-12T05:21:25.381507+0000","last_became_active":"2024-09-12T05:20:49.041294+0000","last_became_peered":"2024-09-12T05:20:49.041294+0000","last_unstale":"2024-09-12T05:21:25.381507+0000","last_undegraded":"2024-09-12T05:21:25.381507+0000","last_fullsized":"2024-09-12T05:21:25.381507+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:35.314389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000920377,"stat_sum":{"num_bytes":28543173,"num_objects":56,"num_object_clones":12,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":29,"num_read":801,"num_read_kb":11334,"num_write":288,"num_write_kb":7637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"78'1044","reported_seq":4062,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:26.639117+0000","last_change":"2024-09-12T05:21:03.163718+0000","last_active":"2024-09-12T05:21:26.639117+0000","last_peered":"2024-09-12T05:21:26.639117+0000","last_clean":"2024-09-12T05:20:58.183844+0000","last_became_active":"2024-09-12T05:21:03.163718+0000","last_became_peered":"2024-09-12T05:21:03.163718+0000","last_unstale":"2024-09-12T05:21:26.639117+0000","last_undegraded":"2024-09-12T05:21:03.161795+0000","last_fullsized":"2024-09-12T05:21:03.161569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:16.171404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013351109999999999,"stat_sum":{"num_bytes":38036716,"num_objects":67,"num_object_clones":7,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":67,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":37,"num_read":7668,"num_read_kb":33117,"num_write":1617,"num_write_kb":23100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":67}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.381962+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:21:25.381962+0000","last_peered":"2024-09-12T05:21:25.381962+0000","last_clean":"2024-09-12T05:21:25.381962+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:21:25.381962+0000","last_undegraded":"2024-09-12T05:21:25.381962+0000","last_fullsized":"2024-09-12T05:21:25.381962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"78'559","reported_seq":1569,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.639602+0000","last_change":"2024-09-12T05:20:11.760826+0000","last_active":"2024-09-12T05:21:26.639602+0000","last_peered":"2024-09-12T05:21:26.639602+0000","last_clean":"2024-09-12T05:21:26.639602+0000","last_became_active":"2024-09-12T05:20:09.741300+0000","last_became_peered":"2024-09-12T05:20:09.741300+0000","last_unstale":"2024-09-12T05:21:26.639602+0000","last_undegraded":"2024-09-12T05:21:26.639602+0000","last_fullsized":"2024-09-12T05:21:26.639602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:26.912102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015825539999999999,"stat_sum":{"num_bytes":21249352,"num_objects":71,"num_object_clones":9,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":48,"num_read":2184,"num_read_kb":9607,"num_write":686,"num_write_kb":19107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.378795+0000","last_change":"2024-09-12T05:20:33.943660+0000","last_active":"2024-09-12T05:21:25.378795+0000","last_peered":"2024-09-12T05:21:25.378795+0000","last_clean":"2024-09-12T05:21:25.378795+0000","last_became_active":"2024-09-12T05:20:33.943030+0000","last_became_peered":"2024-09-12T05:20:33.943030+0000","last_unstale":"2024-09-12T05:21:25.378795+0000","last_undegraded":"2024-09-12T05:21:25.378795+0000","last_fullsized":"2024-09-12T05:21:25.378795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:11.076201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"78'269","reported_seq":2488,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.342894+0000","last_change":"2024-09-12T05:20:11.787746+0000","last_active":"2024-09-12T05:21:26.342894+0000","last_peered":"2024-09-12T05:21:26.342894+0000","last_clean":"2024-09-12T05:21:26.342894+0000","last_became_active":"2024-09-12T05:20:09.747558+0000","last_became_peered":"2024-09-12T05:20:09.747558+0000","last_unstale":"2024-09-12T05:21:26.342894+0000","last_undegraded":"2024-09-12T05:21:26.342894+0000","last_fullsized":"2024-09-12T05:21:26.342894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:03.200778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001514325,"stat_sum":{"num_bytes":43809148,"num_objects":56,"num_object_clones":10,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":31,"num_read":2183,"num_read_kb":41245,"num_write":271,"num_write_kb":20481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.382373+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:21:25.382373+0000","last_peered":"2024-09-12T05:21:25.382373+0000","last_clean":"2024-09-12T05:21:25.382373+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:21:25.382373+0000","last_undegraded":"2024-09-12T05:21:25.382373+0000","last_fullsized":"2024-09-12T05:21:25.382373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"78'354","reported_seq":1955,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.462166+0000","last_change":"2024-09-12T05:21:25.382269+0000","last_active":"2024-09-12T05:21:26.462166+0000","last_peered":"2024-09-12T05:21:26.462166+0000","last_clean":"2024-09-12T05:21:26.462166+0000","last_became_active":"2024-09-12T05:21:25.381741+0000","last_became_peered":"2024-09-12T05:21:25.381741+0000","last_unstale":"2024-09-12T05:21:26.462166+0000","last_undegraded":"2024-09-12T05:21:26.462166+0000","last_fullsized":"2024-09-12T05:21:26.462166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:51:15.681043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109662,"stat_sum":{"num_bytes":32739300,"num_objects":60,"num_object_clones":10,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":36,"num_read":2267,"num_read_kb":15938,"num_write":366,"num_write_kb":27086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":1412756,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":136,"reported_epoch":78,"state":"active+clean+remapped","last_fresh":"2024-09-12T05:21:25.379676+0000","last_change":"2024-09-12T05:21:17.330061+0000","last_active":"2024-09-12T05:21:25.379676+0000","last_peered":"2024-09-12T05:21:25.379676+0000","last_clean":"2024-09-12T05:21:25.379676+0000","last_became_active":"2024-09-12T05:21:17.329019+0000","last_became_peered":"2024-09-12T05:21:17.329019+0000","last_unstale":"2024-09-12T05:21:25.379676+0000","last_undegraded":"2024-09-12T05:21:25.379676+0000","last_fullsized":"2024-09-12T05:21:25.379676+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:21.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"78'209","reported_seq":1700,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.918058+0000","last_change":"2024-09-12T05:20:11.737386+0000","last_active":"2024-09-12T05:21:25.918058+0000","last_peered":"2024-09-12T05:21:25.918058+0000","last_clean":"2024-09-12T05:21:25.918058+0000","last_became_active":"2024-09-12T05:20:09.734285+0000","last_became_peered":"2024-09-12T05:20:09.734285+0000","last_unstale":"2024-09-12T05:21:25.918058+0000","last_undegraded":"2024-09-12T05:21:25.918058+0000","last_fullsized":"2024-09-12T05:21:25.918058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:12.647849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093432200000000002,"stat_sum":{"num_bytes":19480773,"num_objects":40,"num_object_clones":4,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":25,"num_read":1525,"num_read_kb":10673,"num_write":229,"num_write_kb":6118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"78'393","reported_seq":3977,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:26.389265+0000","last_change":"2024-09-12T05:21:03.157170+0000","last_active":"2024-09-12T05:21:26.389265+0000","last_peered":"2024-09-12T05:21:26.389265+0000","last_clean":"2024-09-12T05:21:00.585064+0000","last_became_active":"2024-09-12T05:21:03.157170+0000","last_became_peered":"2024-09-12T05:21:03.157170+0000","last_unstale":"2024-09-12T05:21:26.389265+0000","last_undegraded":"2024-09-12T05:21:03.156358+0000","last_fullsized":"2024-09-12T05:21:03.156283+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.645671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011274589999999999,"stat_sum":{"num_bytes":31132837,"num_objects":78,"num_object_clones":12,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":78,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":47,"num_read":4399,"num_read_kb":16559,"num_write":378,"num_write_kb":25061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":78}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.377422+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:21:25.377422+0000","last_peered":"2024-09-12T05:21:25.377422+0000","last_clean":"2024-09-12T05:21:25.377422+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:21:25.377422+0000","last_undegraded":"2024-09-12T05:21:25.377422+0000","last_fullsized":"2024-09-12T05:21:25.377422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"78'655","reported_seq":7506,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.297448+0000","last_change":"2024-09-12T05:21:25.385366+0000","last_active":"2024-09-12T05:21:26.297448+0000","last_peered":"2024-09-12T05:21:26.297448+0000","last_clean":"2024-09-12T05:21:26.297448+0000","last_became_active":"2024-09-12T05:21:25.384689+0000","last_became_peered":"2024-09-12T05:21:25.384689+0000","last_unstale":"2024-09-12T05:21:26.297448+0000","last_undegraded":"2024-09-12T05:21:26.297448+0000","last_fullsized":"2024-09-12T05:21:26.297448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:27.092366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011707810000000001,"stat_sum":{"num_bytes":55575513,"num_objects":66,"num_object_clones":14,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":38,"num_read":8886,"num_read_kb":35880,"num_write":972,"num_write_kb":20798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2681329,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.394997+0000","last_change":"2024-09-12T05:21:22.389445+0000","last_active":"2024-09-12T05:21:25.394997+0000","last_peered":"2024-09-12T05:21:25.394997+0000","last_clean":"2024-09-12T05:21:25.394997+0000","last_became_active":"2024-09-12T05:21:22.389028+0000","last_became_peered":"2024-09-12T05:21:22.389028+0000","last_unstale":"2024-09-12T05:21:25.394997+0000","last_undegraded":"2024-09-12T05:21:25.394997+0000","last_fullsized":"2024-09-12T05:21:25.394997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:51.255477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"78'382","reported_seq":1407,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:26.885265+0000","last_change":"2024-09-12T05:21:03.157382+0000","last_active":"2024-09-12T05:21:26.885265+0000","last_peered":"2024-09-12T05:21:26.885265+0000","last_clean":"2024-09-12T05:21:01.133301+0000","last_became_active":"2024-09-12T05:21:03.157382+0000","last_became_peered":"2024-09-12T05:21:03.157382+0000","last_unstale":"2024-09-12T05:21:26.885265+0000","last_undegraded":"2024-09-12T05:21:03.156161+0000","last_fullsized":"2024-09-12T05:21:03.155969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:05.037654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002046291,"stat_sum":{"num_bytes":29098451,"num_objects":57,"num_object_clones":7,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":57,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":38,"num_read":1740,"num_read_kb":7855,"num_write":457,"num_write_kb":3668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":57}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.381084+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:21:25.381084+0000","last_peered":"2024-09-12T05:21:25.381084+0000","last_clean":"2024-09-12T05:21:25.381084+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:21:25.381084+0000","last_undegraded":"2024-09-12T05:21:25.381084+0000","last_fullsized":"2024-09-12T05:21:25.381084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"78'249","reported_seq":2658,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.681955+0000","last_change":"2024-09-12T05:20:11.787268+0000","last_active":"2024-09-12T05:21:26.681955+0000","last_peered":"2024-09-12T05:21:26.681955+0000","last_clean":"2024-09-12T05:21:26.681955+0000","last_became_active":"2024-09-12T05:20:09.747825+0000","last_became_peered":"2024-09-12T05:20:09.747825+0000","last_unstale":"2024-09-12T05:21:26.681955+0000","last_undegraded":"2024-09-12T05:21:26.681955+0000","last_fullsized":"2024-09-12T05:21:26.681955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:23.318118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010361979999999999,"stat_sum":{"num_bytes":82763510,"num_objects":61,"num_object_clones":10,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":37,"num_read":2343,"num_read_kb":37911,"num_write":256,"num_write_kb":30733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.377442+0000","last_change":"2024-09-12T05:21:22.352049+0000","last_active":"2024-09-12T05:21:25.377442+0000","last_peered":"2024-09-12T05:21:25.377442+0000","last_clean":"2024-09-12T05:21:25.377442+0000","last_became_active":"2024-09-12T05:21:22.346674+0000","last_became_peered":"2024-09-12T05:21:22.346674+0000","last_unstale":"2024-09-12T05:21:25.377442+0000","last_undegraded":"2024-09-12T05:21:25.377442+0000","last_fullsized":"2024-09-12T05:21:25.377442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:18.993897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":221,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.381166+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:21:25.381166+0000","last_peered":"2024-09-12T05:21:25.381166+0000","last_clean":"2024-09-12T05:21:25.381166+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:21:25.381166+0000","last_undegraded":"2024-09-12T05:21:25.381166+0000","last_fullsized":"2024-09-12T05:21:25.381166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"78'459","reported_seq":3927,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:27.049452+0000","last_change":"2024-09-12T05:20:11.786966+0000","last_active":"2024-09-12T05:21:27.049452+0000","last_peered":"2024-09-12T05:21:27.049452+0000","last_clean":"2024-09-12T05:21:27.049452+0000","last_became_active":"2024-09-12T05:20:09.735109+0000","last_became_peered":"2024-09-12T05:20:09.735109+0000","last_unstale":"2024-09-12T05:21:27.049452+0000","last_undegraded":"2024-09-12T05:21:27.049452+0000","last_fullsized":"2024-09-12T05:21:27.049452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:00.938623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088249400000000005,"stat_sum":{"num_bytes":27286265,"num_objects":71,"num_object_clones":13,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":39,"num_read":5557,"num_read_kb":33596,"num_write":476,"num_write_kb":23888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"78'316","reported_seq":1847,"reported_epoch":78,"state":"active+clean+remapped","last_fresh":"2024-09-12T05:21:27.036516+0000","last_change":"2024-09-12T05:21:25.389120+0000","last_active":"2024-09-12T05:21:27.036516+0000","last_peered":"2024-09-12T05:21:27.036516+0000","last_clean":"2024-09-12T05:21:27.036516+0000","last_became_active":"2024-09-12T05:21:25.385057+0000","last_became_peered":"2024-09-12T05:21:25.385057+0000","last_unstale":"2024-09-12T05:21:27.036516+0000","last_undegraded":"2024-09-12T05:21:27.036516+0000","last_fullsized":"2024-09-12T05:21:27.036516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:14.276706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083728800000000005,"stat_sum":{"num_bytes":21852337,"num_objects":73,"num_object_clones":12,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":73,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":47,"num_read":1971,"num_read_kb":3286,"num_write":280,"num_write_kb":1390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":739494,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[{"shards":"2,7","objects":73}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"78'642","reported_seq":1973,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:25.479060+0000","last_change":"2024-09-12T05:21:03.161538+0000","last_active":"2024-09-12T05:21:25.479060+0000","last_peered":"2024-09-12T05:21:25.479060+0000","last_clean":"2024-09-12T05:21:02.486182+0000","last_became_active":"2024-09-12T05:21:03.161538+0000","last_became_peered":"2024-09-12T05:21:03.161538+0000","last_unstale":"2024-09-12T05:21:25.479060+0000","last_undegraded":"2024-09-12T05:21:03.158960+0000","last_fullsized":"2024-09-12T05:21:03.158767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:04.985800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001140198,"stat_sum":{"num_bytes":36090361,"num_objects":60,"num_object_clones":12,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":60,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":34,"num_read":3942,"num_read_kb":7347,"num_write":820,"num_write_kb":3713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1146302,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":60}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"78'299","reported_seq":4116,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.925492+0000","last_change":"2024-09-12T05:20:11.787356+0000","last_active":"2024-09-12T05:21:26.925492+0000","last_peered":"2024-09-12T05:21:26.925492+0000","last_clean":"2024-09-12T05:21:26.925492+0000","last_became_active":"2024-09-12T05:20:09.741117+0000","last_became_peered":"2024-09-12T05:20:09.741117+0000","last_unstale":"2024-09-12T05:21:26.925492+0000","last_undegraded":"2024-09-12T05:21:26.925492+0000","last_fullsized":"2024-09-12T05:21:26.925492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:16.819840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011192330000000001,"stat_sum":{"num_bytes":14199384,"num_objects":61,"num_object_clones":9,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":35,"num_read":4484,"num_read_kb":11660,"num_write":267,"num_write_kb":6009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"78'1656","reported_seq":2666,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.244084+0000","last_change":"2024-09-12T05:20:11.736226+0000","last_active":"2024-09-12T05:21:26.244084+0000","last_peered":"2024-09-12T05:21:26.244084+0000","last_clean":"2024-09-12T05:21:26.244084+0000","last_became_active":"2024-09-12T05:20:09.734742+0000","last_became_peered":"2024-09-12T05:20:09.734742+0000","last_unstale":"2024-09-12T05:21:26.244084+0000","last_undegraded":"2024-09-12T05:21:26.244084+0000","last_fullsized":"2024-09-12T05:21:26.244084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1656,"log_dups_size":0,"ondisk_log_size":1656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:07.606839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085690600000000005,"stat_sum":{"num_bytes":4234628,"num_objects":50,"num_object_clones":4,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":34,"num_read":8835,"num_read_kb":10023,"num_write":2900,"num_write_kb":4732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"72'435","reported_seq":4761,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.382107+0000","last_change":"2024-09-12T05:20:11.785456+0000","last_active":"2024-09-12T05:21:25.382107+0000","last_peered":"2024-09-12T05:21:25.382107+0000","last_clean":"2024-09-12T05:21:25.382107+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:21:25.382107+0000","last_undegraded":"2024-09-12T05:21:25.382107+0000","last_fullsized":"2024-09-12T05:21:25.382107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:45.233505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011734079999999999,"stat_sum":{"num_bytes":14934318,"num_objects":67,"num_object_clones":13,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":38,"num_read":5467,"num_read_kb":9592,"num_write":510,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"78'313","reported_seq":1279,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:26.460355+0000","last_change":"2024-09-12T05:21:03.166584+0000","last_active":"2024-09-12T05:21:26.460355+0000","last_peered":"2024-09-12T05:21:26.460355+0000","last_clean":"2024-09-12T05:21:02.482903+0000","last_became_active":"2024-09-12T05:21:03.166584+0000","last_became_peered":"2024-09-12T05:21:03.166584+0000","last_unstale":"2024-09-12T05:21:26.460355+0000","last_undegraded":"2024-09-12T05:21:03.162462+0000","last_fullsized":"2024-09-12T05:21:03.162245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:20.067963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010563930000000001,"stat_sum":{"num_bytes":38247891,"num_objects":61,"num_object_clones":9,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":61,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":35,"num_read":1539,"num_read_kb":5410,"num_write":317,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":61}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"78'236","reported_seq":2465,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:26.735297+0000","last_change":"2024-09-12T05:21:03.166642+0000","last_active":"2024-09-12T05:21:26.735297+0000","last_peered":"2024-09-12T05:21:26.735297+0000","last_clean":"2024-09-12T05:21:02.483134+0000","last_became_active":"2024-09-12T05:21:03.166642+0000","last_became_peered":"2024-09-12T05:21:03.166642+0000","last_unstale":"2024-09-12T05:21:26.735297+0000","last_undegraded":"2024-09-12T05:21:03.162452+0000","last_fullsized":"2024-09-12T05:21:03.162237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:48.386995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072867899999999998,"stat_sum":{"num_bytes":16146549,"num_objects":53,"num_object_clones":11,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":53,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":25,"num_read":2511,"num_read_kb":6500,"num_write":209,"num_write_kb":2515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":53}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"78'300","reported_seq":2495,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:26.863345+0000","last_change":"2024-09-12T05:20:34.018441+0000","last_active":"2024-09-12T05:21:26.863345+0000","last_peered":"2024-09-12T05:21:26.863345+0000","last_clean":"2024-09-12T05:21:26.863345+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:21:26.863345+0000","last_undegraded":"2024-09-12T05:21:26.863345+0000","last_fullsized":"2024-09-12T05:21:26.863345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:53.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387196,"stat_sum":{"num_bytes":66674688,"num_objects":58,"num_object_clones":9,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":30,"num_read":2576,"num_read_kb":13755,"num_write":306,"num_write_kb":3344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"78'349","reported_seq":2225,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:26.992145+0000","last_change":"2024-09-12T05:21:03.164248+0000","last_active":"2024-09-12T05:21:26.992145+0000","last_peered":"2024-09-12T05:21:26.992145+0000","last_clean":"2024-09-12T05:21:02.482711+0000","last_became_active":"2024-09-12T05:21:03.164248+0000","last_became_peered":"2024-09-12T05:21:03.164248+0000","last_unstale":"2024-09-12T05:21:26.992145+0000","last_undegraded":"2024-09-12T05:21:03.161673+0000","last_fullsized":"2024-09-12T05:21:03.161442+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.576425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074458300000000005,"stat_sum":{"num_bytes":68071138,"num_objects":66,"num_object_clones":11,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":37,"num_read":2603,"num_read_kb":38546,"num_write":366,"num_write_kb":20907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":66}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"78'292","reported_seq":1427,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T05:21:25.641224+0000","last_change":"2024-09-12T05:20:57.096516+0000","last_active":"2024-09-12T05:21:25.641224+0000","last_peered":"2024-09-12T05:21:25.641224+0000","last_clean":"2024-09-12T05:21:25.641224+0000","last_became_active":"2024-09-12T05:20:57.095147+0000","last_became_peered":"2024-09-12T05:20:57.095147+0000","last_unstale":"2024-09-12T05:21:25.641224+0000","last_undegraded":"2024-09-12T05:21:25.641224+0000","last_fullsized":"2024-09-12T05:21:25.641224+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:26.701755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347827,"stat_sum":{"num_bytes":55652384,"num_objects":57,"num_object_clones":11,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":33,"num_read":1664,"num_read_kb":33882,"num_write":332,"num_write_kb":28722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"78'293","reported_seq":2072,"reported_epoch":78,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:27.036152+0000","last_change":"2024-09-12T05:21:03.163550+0000","last_active":"2024-09-12T05:21:27.036152+0000","last_peered":"2024-09-12T05:21:27.036152+0000","last_clean":"2024-09-12T05:21:02.482791+0000","last_became_active":"2024-09-12T05:21:03.163550+0000","last_became_peered":"2024-09-12T05:21:03.163550+0000","last_unstale":"2024-09-12T05:21:27.036152+0000","last_undegraded":"2024-09-12T05:21:03.161537+0000","last_fullsized":"2024-09-12T05:21:03.161412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:19.893467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076674600000000001,"stat_sum":{"num_bytes":25176157,"num_objects":68,"num_object_clones":16,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":68,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":40,"num_read":1723,"num_read_kb":6508,"num_write":250,"num_write_kb":2213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":68}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1045296995,"num_objects":1975,"num_object_clones":332,"num_object_copies":3950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":756,"num_objects_misplaced":73,"num_objects_unfound":0,"num_objects_dirty":1975,"num_whiteouts":1169,"num_read":110200,"num_read_kb":582418,"num_write":15761,"num_write_kb":382042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":16820010,"num_keys_recovered":39,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528445440,"data_stored":680822853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13167,"ondisk_log_size":13167,"up":51,"acting":52,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140344,"kb_used_data":100840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94231496,"statfs":{"total":96636764160,"available":96493051904,"internally_reserved":0,"allocated":103260160,"data_stored":139981225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60616,"kb_used_data":25264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311224,"statfs":{"total":96636764160,"available":96574693376,"internally_reserved":0,"allocated":25870336,"data_stored":28780817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119004,"kb_used_data":73932,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94252836,"statfs":{"total":96636764160,"available":96514904064,"internally_reserved":0,"allocated":75706368,"data_stored":83024047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78564,"kb_used_data":39052,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94293276,"statfs":{"total":96636764160,"available":96556314624,"internally_reserved":0,"allocated":39989248,"data_stored":49268210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148504,"kb_used_data":103424,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94223336,"statfs":{"total":96636764160,"available":96484696064,"internally_reserved":0,"allocated":105906176,"data_stored":136300694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":60129542166,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126316,"kb_used_data":86808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94245524,"statfs":{"total":96636764160,"available":96507416576,"internally_reserved":0,"allocated":88891392,"data_stored":106350319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137496,"kb_used_data":93832,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94234344,"statfs":{"total":96636764160,"available":96495968256,"internally_reserved":0,"allocated":96083968,"data_stored":141065183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94511104,"data_stored":139997265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":87973888,"data_stored":105935065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":806912,"data_stored":753846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":104509440,"data_stored":135405726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39358464,"data_stored":48993160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":74559488,"data_stored":82381944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24956928,"data_stored":28365582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":101769216,"data_stored":138990265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:21:32.302 INFO:tasks.thrashosds.thrasher:Setting 2.1 to [4, 7, 3, 6] 2024-09-12T05:21:32.302 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.1', '4', '7', '3', '6'] 2024-09-12T05:21:32.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.1 4 7 3 6 2024-09-12T05:21:32.309 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:32.309 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:32.309 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:32.325 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:32.323+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:32.329 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:32.330 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:32.349 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:32.349 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:32.370 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:32.374 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:32.374 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:32.407 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:32.407 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:88505 3.13 3.b13b5c33 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:32.406379+0000", 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.0028301289999999998, 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028715780000000001, 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "op must wait for map", 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 88505 2024-09-12T05:21:32.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:32.406379+0000", 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:32.406379+0000", 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:32.406382+0000", 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6500000000000002e-06 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:32.406399+0000", 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6492999999999999e-05 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:32.406432+0000", 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3646000000000003e-05 2024-09-12T05:21:32.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:32.406451+0000", 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:32.406612+0000", 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016126399999999999 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:32.406625+0000", 2024-09-12T05:21:32.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2493999999999999e-05 2024-09-12T05:21:32.412 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.412 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.412 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.412 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.412 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-12T05:21:32.412 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-09-12T05:21:32.412 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:32.421 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:32.419+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:32.424 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:32.507 INFO:teuthology.orchestra.run.smithi059.stdout:leaving image image_client.0-clone31 intact 2024-09-12T05:21:32.522 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:32.519+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:32.584 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:32.584 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:32.584 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:32.584 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:32.584 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:32.597 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:32.641 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:32.639+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:32.682 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-12T05:21:32.724 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:32.719+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:32.769 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.889548452, 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.10902002500000001, 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.770 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4198", 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.194:0/2900323474", 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 1 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878724+0000", 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878726+0000", 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.92e-06 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878741+0000", 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4696e-05 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878767+0000", 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5812999999999998e-05 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878789+0000", 2024-09-12T05:21:32.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.179e-05 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878868+0000", 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9116999999999995e-05 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.878878+0000", 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8549999999999997e-06 2024-09-12T05:21:32.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.984853+0000", 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.105974939 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985185+0000", 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000332827 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.985604+0000", 2024-09-12T05:21:32.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000418477 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.986868+0000", 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001264004 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987594+0000", 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072604400000000002 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987679+0000", 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4826000000000004e-05 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:19:54.987744+0000", 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4716999999999997e-05 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:4322 3.13 3:ceb672dc:::rbd_data.1118e5842253.0000000000000068:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T05:21:32.777 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.126878566000002, 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056729952, 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4322 2024-09-12T05:21:32.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641393+0000", 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641396+0000", 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0970000000000002e-06 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641409+0000", 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.291e-05 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641440+0000", 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0380000000000001e-05 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641456+0000", 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5906999999999999e-05 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641572+0000", 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116452 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.641803+0000", 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000230671 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.651415+0000", 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096118660000000002 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697868+0000", 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046453047999999997 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:32.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697904+0000", 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6313000000000003e-05 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.697997+0000", 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3356000000000005e-05 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:21.698123+0000", 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125952 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.783 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22118 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1982464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601769769000001, 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052766258000000003, 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22118 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166502+0000", 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166503+0000", 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1629999999999999e-06 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166508+0000", 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166526+0000", 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7699000000000001e-05 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166540+0000", 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4286e-05 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219002+0000", 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052461397999999999 2024-09-12T05:21:32.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219106+0000", 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104694 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219268+0000", 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000162015 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22161 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601712274999997, 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052998134000000002, 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22161 2024-09-12T05:21:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166560+0000", 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166561+0000", 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166566+0000", 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5860000000000004e-06 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166584+0000", 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166598+0000", 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3665999999999999e-05 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219347+0000", 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052748841999999997 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219439+0000", 2024-09-12T05:21:32.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2453000000000004e-05 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219558+0000", 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011851800000000001 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22163 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601654664999998, 2024-09-12T05:21:32.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053262859000000003, 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22163 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166617+0000", 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166618+0000", 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1659999999999999e-06 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166624+0000", 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3299999999999998e-06 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166641+0000", 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7016000000000001e-05 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166655+0000", 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4358999999999999e-05 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219631+0000", 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052976286999999997 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219740+0000", 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108663 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219880+0000", 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014003799999999999 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22165 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 491520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601597015000003, 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.05349143, 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22165 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166675+0000", 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166677+0000", 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-06 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166682+0000", 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166706+0000", 2024-09-12T05:21:32.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4063e-05 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166721+0000", 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4851999999999999e-05 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219948+0000", 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053227479000000001 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220029+0000", 2024-09-12T05:21:32.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0564999999999999e-05 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220166+0000", 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013738499999999999 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22167 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 720896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601529605000003, 2024-09-12T05:21:32.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053842714, 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22167 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166742+0000", 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166744+0000", 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166750+0000", 2024-09-12T05:21:32.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0499999999999997e-06 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166768+0000", 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7918999999999999e-05 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166781+0000", 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3784999999999999e-05 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220258+0000", 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053476165999999999 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220447+0000", 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018942699999999999 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220585+0000", 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013815 2024-09-12T05:21:32.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22168 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 950272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601471545000003, 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054040510999999999, 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.807 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22168 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166800+0000", 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166802+0000", 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3540000000000001e-06 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166807+0000", 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1460000000000004e-06 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166828+0000", 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0752999999999999e-05 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166842+0000", 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4405e-05 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220648+0000", 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053806172999999999 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220728+0000", 2024-09-12T05:21:32.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0175999999999999e-05 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220841+0000", 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011250400000000001 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22170 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1048576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601410053999999, 2024-09-12T05:21:32.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054240254000000002, 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22170 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166862+0000", 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166863+0000", 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166868+0000", 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2000000000000002e-06 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166886+0000", 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7462e-05 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166899+0000", 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3059e-05 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220904+0000", 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054004732999999999 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221006+0000", 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102895 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221102+0000", 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22172 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1277952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601353967000001, 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054417, 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.816 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22172 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166918+0000", 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166919+0000", 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.173e-06 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166925+0000", 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166942+0000", 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7246000000000001e-05 2024-09-12T05:21:32.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166957+0000", 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4419e-05 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221168+0000", 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054211102999999997 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221251+0000", 2024-09-12T05:21:32.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2956999999999999e-05 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221335+0000", 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4122000000000005e-05 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22174 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601296529999999, 2024-09-12T05:21:32.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054612105000000001, 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22174 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166975+0000", 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166977+0000", 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.156e-06 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.166982+0000", 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167000+0000", 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7336000000000001e-05 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167013+0000", 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3106e-05 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221400+0000", 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054387255000000002 2024-09-12T05:21:32.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221493+0000", 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3117999999999999e-05 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221588+0000", 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4524000000000005e-05 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22176 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601238143000003, 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054762312, 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22176 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167034+0000", 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167035+0000", 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:32.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167064+0000", 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459e-05 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167098+0000", 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4041000000000002e-05 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167156+0000", 2024-09-12T05:21:32.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7401000000000002e-05 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221640+0000", 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054484170999999998 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221714+0000", 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4345999999999996e-05 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221796+0000", 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1757999999999999e-05 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22178 3.13 3:c8eab12a:::rbd_data.11186ec76cc4.0000000000000001:c [read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.601091494000002, 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054845368999999998, 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.829 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22178 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167180+0000", 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167182+0000", 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2729999999999999e-06 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167189+0000", 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.81e-06 2024-09-12T05:21:32.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167221+0000", 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2400999999999997e-05 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.167237+0000", 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5693e-05 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221845+0000", 2024-09-12T05:21:32.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054608139 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.221934+0000", 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9586000000000006e-05 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.222026+0000", 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1466999999999997e-05 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:55996 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.070257570999999, 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054112130000000001, 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 55996 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698014+0000", 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698015+0000", 2024-09-12T05:21:32.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.82e-07 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698017+0000", 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1799999999999999e-06 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698024+0000", 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5830000000000003e-06 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.698028+0000", 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7299999999999996e-06 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748691+0000", 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050662709 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.748758+0000", 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6920000000000003e-05 2024-09-12T05:21:32.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752127+0000", 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033684259999999999 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56145 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.064723032000003, 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053461886, 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.838 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56145 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703549+0000", 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703552+0000", 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3879999999999998e-06 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703559+0000", 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5059999999999998e-06 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703565+0000", 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.964e-06 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752009+0000", 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.048444050000000002 2024-09-12T05:21:32.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.752076+0000", 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7083999999999997e-05 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757011+0000", 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049343850000000003 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56146 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.064698890000003, 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053664649000000002, 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56146 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.843 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703573+0000", 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703574+0000", 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5699999999999998e-07 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703581+0000", 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5560000000000002e-06 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703589+0000", 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4420000000000001e-06 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703595+0000", 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0070000000000003e-06 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757060+0000", 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053465909999999998 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757143+0000", 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2974999999999998e-05 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757238+0000", 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4302000000000006e-05 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56147 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.064669268000003, 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054033454000000002, 2024-09-12T05:21:32.847 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56147 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703603+0000", 2024-09-12T05:21:32.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703606+0000", 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.305e-06 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703613+0000", 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1720000000000001e-06 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703618+0000", 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7339999999999996e-06 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757277+0000", 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.053658748999999999 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757529+0000", 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025211199999999997 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757636+0000", 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010683600000000001 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:56148 3.d 3:b275d0a9:::rbd_data.11182d2a28db.000000000000002b:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.064646279999998, 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054391660000000001, 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.852 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 56148 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703626+0000", 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703629+0000", 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4339999999999999e-06 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703636+0000", 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1999999999999997e-06 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.703642+0000", 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1829999999999999e-06 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757667+0000", 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.054025148000000002 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.757737+0000", 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9640000000000004e-05 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:55.758017+0000", 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000280594 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:81228 3.12 3:4c7b354e:::rbd_data.11185a81880a.0000000000000000:head [sparse-read 0~14172160] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.108079475, 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052732870000000001, 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 81228 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660192+0000", 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660195+0000", 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2869999999999999e-06 2024-09-12T05:21:32.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660205+0000", 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0086e-05 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660236+0000", 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1386000000000001e-05 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660251+0000", 2024-09-12T05:21:32.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5173e-05 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660398+0000", 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146537 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.660674+0000", 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027622399999999999 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:15.712925+0000", 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052251177000000003 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:83607 3.12 3:4a56a2a1:::rbd_data.11182b429d69.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 886864~48318] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.2749473889999994, 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.057842625000000002, 2024-09-12T05:21:32.861 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 83607 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493325+0000", 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.493327+0000", 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9539999999999998e-06 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501945+0000", 2024-09-12T05:21:32.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086183170000000003 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501967+0000", 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-05 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.501982+0000", 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4532000000000001e-05 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502045+0000", 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3579999999999998e-05 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502168+0000", 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012290200000000001 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.502477+0000", 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000308244 2024-09-12T05:21:32.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.525615+0000", 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023138784999999999 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551038+0000", 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025422836000000001 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551116+0000", 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8254e-05 2024-09-12T05:21:32.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.551167+0000", 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0720999999999998e-05 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:32.867 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:32.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:32.869 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:32.867+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:32.970 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:32.967+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:32.998 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:33.062 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:33.062 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:33.062 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:33.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:33.079 INFO:teuthology.orchestra.run.smithi059.stdout:4000 writesame 0x55760e7 thru 0x557ee0d data_size 0x63(0x8d27 bytes) 2024-09-12T05:21:33.079 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:33.075+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:33.125 INFO:teuthology.orchestra.run.smithi059.stdout:4001 writesame 0x1290af2 thru 0x12918c1 data_size 0x22(0xdd0 bytes) 2024-09-12T05:21:33.140 INFO:teuthology.orchestra.run.smithi059.stdout:4002 trunc from 0x90b6b2e to 0x87b0a79 2024-09-12T05:21:33.171 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:33.167+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:33.201 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:33.201 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:33.201 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:33.202 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:33.202 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:33.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:33.218 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:33.233 INFO:teuthology.orchestra.run.smithi059.stdout:4004 write 0xd54e5e8 thru 0xd553447 (0x4e60 bytes) 2024-09-12T05:21:33.241 INFO:teuthology.orchestra.run.smithi059.stdout:4006 read 0x8926027 thru 0x892911e (0x30f8 bytes) 2024-09-12T05:21:33.242 INFO:teuthology.orchestra.run.smithi059.stdout:4007 read 0x2425927 thru 0x2431867 (0xbf41 bytes) 2024-09-12T05:21:33.243 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:33.254 INFO:teuthology.orchestra.run.smithi059.stdout:4009 write 0xee13a11 thru 0xee1ed03 (0xb2f3 bytes) 2024-09-12T05:21:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:4010 punch from 0x44f2b11 to 0x44fe6f6, (0xbbe5 bytes) 2024-09-12T05:21:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:4011 punch from 0x43d61a2 to 0x43dad58, (0x4bb6 bytes) 2024-09-12T05:21:33.269 INFO:teuthology.orchestra.run.smithi059.stdout:4014 read 0xd19d331 thru 0xd1a8719 (0xb3e9 bytes) 2024-09-12T05:21:33.269 INFO:teuthology.orchestra.run.smithi059.stdout:4015 write 0x1ace8ba thru 0x1ad09b7 (0x20fe bytes) 2024-09-12T05:21:33.272 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:33.267+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:33.295 INFO:teuthology.orchestra.run.smithi059.stdout:4016 punch from 0x1733ba to 0x17fe86, (0xcacc bytes) 2024-09-12T05:21:33.295 INFO:teuthology.orchestra.run.smithi059.stdout:4017 read 0xaf241c2 thru 0xaf3305f (0xee9e bytes) 2024-09-12T05:21:33.295 INFO:teuthology.orchestra.run.smithi059.stdout:4019 write 0xb5112f0 thru 0xb518171 (0x6e82 bytes) 2024-09-12T05:21:33.305 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:33.305 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:33.305 INFO:teuthology.orchestra.run.smithi059.stdout:4023 write 0x53d6e8d thru 0x53e2c8c (0xbe00 bytes) 2024-09-12T05:21:33.367 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.247571078999997, 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.368 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:21:33.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:21:33.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.916970009, 2024-09-12T05:21:33.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.790409571000001, 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.385 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789884046000001, 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.386 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:33.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:21:33.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789861498, 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:21:33.391 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:21:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789839707999999, 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:21:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:21:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789818343, 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:21:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789795798, 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:21:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789773563000001, 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789751979000002, 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:21:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:21:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:21:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:21:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:21:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:21:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:21:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.78955058, 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:21:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:21:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:21:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789525179999998, 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:21:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:21:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.782251902999999, 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:21:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:21:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.782229513000001, 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.782206864999999, 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.782186375999999, 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:21:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:21:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.782160310999998, 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:21:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:21:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.782137093999999, 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:21:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.78211473, 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:21:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:21:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.305574354000001, 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:21:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:21:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:21:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.473 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:33.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:21:33.474 INFO:teuthology.orchestra.run.smithi059.stdout:4024 trunc from 0xee1ed04 to 0x50d0be0 2024-09-12T05:21:33.475 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:33.471+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:33.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:33.476 INFO:teuthology.orchestra.run.smithi059.stderr:set 2.1 pg_upmap_items mapping to [4->7,3->6] 2024-09-12T05:21:33.477 INFO:teuthology.orchestra.run.smithi059.stdout:4025 writesame 0xb7c1b97 thru 0xb7c879b data_size 0x1(0x6c05 bytes) 2024-09-12T05:21:33.477 INFO:teuthology.orchestra.run.smithi059.stdout:4026 write 0xb6b4647 thru 0xb6b4bc2 (0x57c bytes) 2024-09-12T05:21:33.478 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:33.478 INFO:teuthology.orchestra.run.smithi059.stdout:4028 write 0x674dbe6 thru 0x674f54b (0x1966 bytes) 2024-09-12T05:21:33.478 INFO:teuthology.orchestra.run.smithi059.stdout:4029 write 0x7a2dfa4 thru 0x7a3547b (0x74d8 bytes) 2024-09-12T05:21:33.483 INFO:teuthology.orchestra.run.smithi059.stdout:4031 writesame 0x7c67c45 thru 0x7c749e9 data_size 0x1(0xcda5 bytes) 2024-09-12T05:21:33.525 INFO:teuthology.orchestra.run.smithi059.stdout:4032 write 0xe75630c thru 0xe7595a2 (0x3297 bytes) 2024-09-12T05:21:33.549 INFO:teuthology.orchestra.run.smithi059.stdout:4033 trunc from 0xe7595a3 to 0x5305308 2024-09-12T05:21:33.575 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:33.571+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:33.578 INFO:teuthology.orchestra.run.smithi059.stdout:4034 writesame 0x3728207 thru 0x3728576 data_size 0x14(0x370 bytes) 2024-09-12T05:21:33.597 INFO:teuthology.orchestra.run.smithi059.stdout:4035 read 0x4742574 thru 0x4748857 (0x62e4 bytes) 2024-09-12T05:21:33.607 INFO:teuthology.orchestra.run.smithi059.stdout:4036 write 0x556226f thru 0x55662ff (0x4091 bytes) 2024-09-12T05:21:33.615 INFO:teuthology.orchestra.run.smithi059.stdout:4038 clone 33 order 22 su 16384 sc 14 2024-09-12T05:21:33.620 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:33.620 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:33.620 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:33.620 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:33.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:33.681 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:33.679+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:33.777 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:33.775+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:33.798 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:33.798 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:33.798 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:33.798 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:33.798 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:33.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:33.877 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:33.875+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:33.978 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:33.975+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:33.981 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.561196647999999, 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:21:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.549748438999998, 2024-09-12T05:21:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:21:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.462133533999999, 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:21:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.46209043, 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.462063182000001, 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:21:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:21:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.462036902000001, 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:21:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:21:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:21:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.462014290999999, 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:21:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461986461999999, 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461964042999998, 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:21:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:21:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461942911000001, 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461854277, 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:21:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:21:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461823342999999, 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:21:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461797181000001, 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:21:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461775007, 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:21:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461753893000001, 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:21:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461732256000001, 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78378 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.46162382, 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059385249000000001, 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78378 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519236+0000", 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3900000000000004e-07 2024-09-12T05:21:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519240+0000", 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3759999999999999e-06 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519249+0000", 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519256+0000", 2024-09-12T05:21:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578613+0000", 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059356679000000002 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578621+0000", 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5020000000000003e-06 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461567340999999, 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:21:34.057 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.461539625, 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.058 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:21:34.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.376011729, 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.062 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:21:34.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:21:34.067 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.068 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.068 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.068 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:34.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:34.079 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:34.075+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:34.180 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:34.175+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:34.201 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:34.202 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:34.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:34.301 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:34.299+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:34.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:34.377 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:34.377 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:34.377 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:34.378 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:34.378 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:34.382 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:34.383+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:34.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:21:34.493 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:34.491+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:34.517 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone32 from 0x5566300 (overlap 0x50d0be0) to 0x307d3ec 2024-09-12T05:21:34.560 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:34.561 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:34.566 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:34.566 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:34.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:34.566 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:34.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.566 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 73.587830823999994, 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:21:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 68.676198506999995, 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:21:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:21:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:21:34.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 68.293498022999998, 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:21:34.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:21:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:21:34.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 68.059454376000005, 2024-09-12T05:21:34.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:34.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 68.029330044999995, 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:21:34.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.467242264000006, 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:21:34.589 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:21:34.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.465288045999998, 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:21:34.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.523979312000002, 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.598 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:21:34.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.507382718999999, 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:21:34.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:21:34.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 57.337043279, 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:21:34.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:21:34.611 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.458589027000002, 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:21:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:21:34.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.458543933000001, 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:21:34.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.449982372000001, 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:21:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:21:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:21:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.647944213000002, 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:21:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:21:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.133820774999997, 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:21:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:21:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:21:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.125734682999997, 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:21:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.223548436000002, 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:21:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.246148515000002, 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:21:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:21:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.494001534999999, 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:21:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:21:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.134751804, 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:21:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:21:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:21:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:34.657 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:34.658 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:34.658 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:34.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:34.660 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:34.660 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:34.660 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:34.661 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:34.661 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:34.661 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:34.661 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:34.662 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:34.655+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:34.672 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:34.691 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:34.695 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:34.695 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:34.760 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:34.755+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:34.789 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:34.789 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:34.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:34.861 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:34.855+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:34.937 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:34.938 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:34.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:35.001 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:34.999+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:35.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:35.059+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:35.118 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:35.119 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:35.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:35.181 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:35.179+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:35.191 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-12T05:21:35.264 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:35.264 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:35.265 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:35.263+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:35.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:35.365 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:35.363+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:35.443 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:35.444 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:35.458 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:35.501 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:35.499+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:35.522 INFO:teuthology.orchestra.run.smithi059.stdout:4039 punch from 0xdc036a to 0xdc2101, (0x1d97 bytes) 2024-09-12T05:21:35.530 INFO:teuthology.orchestra.run.smithi059.stdout:4040 read 0x4af3522 thru 0x4af8ca9 (0x5788 bytes) 2024-09-12T05:21:35.531 INFO:teuthology.orchestra.run.smithi059.stdout:4041 punch from 0x3919924 to 0x392194d, (0x8029 bytes) 2024-09-12T05:21:35.543 INFO:teuthology.orchestra.run.smithi059.stdout:4042 trunc from 0x5566300 to 0xdc99eba 2024-09-12T05:21:35.554 INFO:teuthology.orchestra.run.smithi059.stdout:4043 read 0x744ce98 thru 0x7457ec8 (0xb031 bytes) 2024-09-12T05:21:35.567 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:35.563+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:35.569 INFO:teuthology.orchestra.run.smithi059.stdout:4044 write 0xe7acbd7 thru 0xe7b6488 (0x98b2 bytes) 2024-09-12T05:21:35.581 INFO:teuthology.orchestra.run.smithi059.stdout:4047 read 0x20952e7 thru 0x2096236 (0xf50 bytes) 2024-09-12T05:21:35.582 INFO:teuthology.orchestra.run.smithi059.stdout:4048 read 0xc9cd5de thru 0xc9d83e0 (0xae03 bytes) 2024-09-12T05:21:35.582 INFO:teuthology.orchestra.run.smithi059.stdout:4049 read 0xb19935e thru 0xb1a1b62 (0x8805 bytes) 2024-09-12T05:21:35.582 INFO:teuthology.orchestra.run.smithi059.stdout:4050 write 0xdcd8a3f thru 0xdcdc4b0 (0x3a72 bytes) 2024-09-12T05:21:35.589 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:35.590 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:35.590 INFO:teuthology.orchestra.run.smithi059.stdout:4054 read 0x4260f61 thru 0x426e6c7 (0xd767 bytes) 2024-09-12T05:21:35.591 INFO:teuthology.orchestra.run.smithi059.stdout:4055 write 0xce3fcaf thru 0xce4dbf7 (0xdf49 bytes) 2024-09-12T05:21:35.605 INFO:teuthology.orchestra.run.smithi059.stdout:4056 writesame 0x3d2dd23 thru 0x3d39f17 data_size 0x1b(0xc1f5 bytes) 2024-09-12T05:21:35.647 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:35.647 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:35.665 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:35.668 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:35.669 INFO:teuthology.orchestra.run.smithi059.stdout:4058 write 0x7989146 thru 0x798b023 (0x1ede bytes) 2024-09-12T05:21:35.674 INFO:teuthology.orchestra.run.smithi059.stdout:4059 writesame 0xe1ec839 thru 0xe1edddd data_size 0x1(0x15a5 bytes) 2024-09-12T05:21:35.694 INFO:teuthology.orchestra.run.smithi059.stdout:4060 write 0xed02370 thru 0xed09cc8 (0x7959 bytes) 2024-09-12T05:21:35.705 INFO:teuthology.orchestra.run.smithi059.stdout:4062 write 0x75de331 thru 0x75e4495 (0x6165 bytes) 2024-09-12T05:21:35.709 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:35.707+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:35.719 INFO:teuthology.orchestra.run.smithi059.stdout:4063 writesame 0x6048b77 thru 0x6052298 data_size 0x49(0x9722 bytes) 2024-09-12T05:21:35.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:35.767+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:35.770 INFO:teuthology.orchestra.run.smithi059.stdout:4065 write 0x2e05d1d thru 0x2e13c92 (0xdf76 bytes) 2024-09-12T05:21:35.853 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:35.854 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:35.870 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:35.870 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:35.867+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:35.883 INFO:teuthology.orchestra.run.smithi059.stdout:4066 punch from 0xc3d7e75 to 0xc3de604, (0x678f bytes) 2024-09-12T05:21:35.884 INFO:teuthology.orchestra.run.smithi059.stdout:4067 punch from 0xe8bfc28 to 0xe8cda23, (0xddfb bytes) 2024-09-12T05:21:35.884 INFO:teuthology.orchestra.run.smithi059.stdout:4068 write 0xd58f9a9 thru 0xd59e759 (0xedb1 bytes) 2024-09-12T05:21:35.909 INFO:teuthology.orchestra.run.smithi059.stdout:4069 trunc from 0xed09cc9 to 0x73323e7 2024-09-12T05:21:35.932 INFO:teuthology.orchestra.run.smithi059.stdout:4071 read 0x90ed09 thru 0x915510 (0x6808 bytes) 2024-09-12T05:21:35.949 INFO:teuthology.orchestra.run.smithi059.stdout:4073 write 0xb814be2 thru 0xb81e3ae (0x97cd bytes) 2024-09-12T05:21:35.966 INFO:teuthology.orchestra.run.smithi059.stdout:4075 write 0xc529ca7 thru 0xc5326af (0x8a09 bytes) 2024-09-12T05:21:35.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:35.967+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:35.974 INFO:teuthology.orchestra.run.smithi059.stdout:4079 writesame 0x4463f82 thru 0x4472740 data_size 0x1(0xe7bf bytes) 2024-09-12T05:21:35.998 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.002 INFO:teuthology.orchestra.run.smithi059.stdout:4081 trunc from 0xc5326b0 to 0xe79987e 2024-09-12T05:21:36.012 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.013 INFO:teuthology.orchestra.run.smithi059.stdout:4083 write 0x51efa25 thru 0x51f629c (0x6878 bytes) 2024-09-12T05:21:36.049 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:36.049 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:36.063 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:36.073 INFO:teuthology.orchestra.run.smithi059.stdout:4085 trunc from 0xe79987e to 0x417f6c6 2024-09-12T05:21:36.105 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:36.103+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:36.172 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:36.167+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:36.181 INFO:teuthology.orchestra.run.smithi059.stdout:4086 trunc from 0x417f6c6 to 0x9d5a15e 2024-09-12T05:21:36.191 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.191 INFO:teuthology.orchestra.run.smithi059.stdout:4088 write 0x4e5018d thru 0x4e55082 (0x4ef6 bytes) 2024-09-12T05:21:36.194 INFO:teuthology.orchestra.run.smithi059.stdout:4090 write 0x68c7df8 thru 0x68d7d0d (0xff16 bytes) 2024-09-12T05:21:36.199 INFO:teuthology.orchestra.run.smithi059.stdout:4092 write 0x5bb2772 thru 0x5bc16a1 (0xef30 bytes) 2024-09-12T05:21:36.203 INFO:teuthology.orchestra.run.smithi059.stdout:4093 read 0x2cc06f2 thru 0x2cc19a4 (0x12b3 bytes) 2024-09-12T05:21:36.222 INFO:teuthology.orchestra.run.smithi059.stdout:4094 writesame 0xe070cd9 thru 0xe0740dc data_size 0x2(0x3404 bytes) 2024-09-12T05:21:36.222 INFO:teuthology.orchestra.run.smithi059.stdout:4095 read 0x1b92287 thru 0x1b99618 (0x7392 bytes) 2024-09-12T05:21:36.223 INFO:teuthology.orchestra.run.smithi059.stdout:4096 punch from 0x298af58 to 0x2995ec2, (0xaf6a bytes) 2024-09-12T05:21:36.223 INFO:teuthology.orchestra.run.smithi059.stdout:4097 write 0x3f04c21 thru 0x3f1362d (0xea0d bytes) 2024-09-12T05:21:36.230 INFO:teuthology.orchestra.run.smithi059.stdout:4100 write 0xbeec7f5 thru 0xbef6d99 (0xa5a5 bytes) 2024-09-12T05:21:36.238 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:36.238 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:36.251 INFO:teuthology.orchestra.run.smithi059.stdout:4101 trunc from 0xe0740dd to 0x874cb27 2024-09-12T05:21:36.253 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:36.274 INFO:teuthology.orchestra.run.smithi059.stdout:4102 punch from 0x86cdfcf to 0x86d2ae2, (0x4b13 bytes) 2024-09-12T05:21:36.275 INFO:teuthology.orchestra.run.smithi059.stdout:4103 read 0x34f3d7a thru 0x34ffda5 (0xc02c bytes) 2024-09-12T05:21:36.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:36.295+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:36.298 INFO:teuthology.orchestra.run.smithi059.stdout:4104 trunc from 0x874cb27 to 0x80b2b 2024-09-12T05:21:36.377 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:36.371+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:36.401 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:36.402 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:36.418 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:36.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:21:36.493 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:36.491+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:36.503 INFO:teuthology.orchestra.run.smithi059.stdout:4105 write 0xb94 thru 0xc7e0 (0xbc4d bytes) 2024-09-12T05:21:36.507 INFO:teuthology.orchestra.run.smithi059.stdout:4106 punch from 0x3f680 to 0x42ca2, (0x3622 bytes) 2024-09-12T05:21:36.507 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.520 INFO:teuthology.orchestra.run.smithi059.stdout:4110 write 0x4290e9b thru 0x4293e29 (0x2f8f bytes) 2024-09-12T05:21:36.531 INFO:teuthology.orchestra.run.smithi059.stdout:4112 write 0x4864006 thru 0x486fbd6 (0xbbd1 bytes) 2024-09-12T05:21:36.550 INFO:teuthology.orchestra.run.smithi059.stdout:4113 trunc from 0x486fbd7 to 0xc0c0152 2024-09-12T05:21:36.560 INFO:teuthology.orchestra.run.smithi059.stdout:4114 punch from 0x5b54b89 to 0x5b5f09a, (0xa511 bytes) 2024-09-12T05:21:36.560 INFO:teuthology.orchestra.run.smithi059.stdout:4115 write 0x6a4e591 thru 0x6a5503f (0x6aaf bytes) 2024-09-12T05:21:36.564 INFO:teuthology.orchestra.run.smithi059.stdout:4116 read 0x6774abb thru 0x6782cc9 (0xe20f bytes) 2024-09-12T05:21:36.565 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.565 INFO:teuthology.orchestra.run.smithi059.stdout:4120 writesame 0x9d10ea4 thru 0x9d1cf82 data_size 0x4f(0xc0df bytes) 2024-09-12T05:21:36.579 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:36.575+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:36.580 INFO:teuthology.orchestra.run.smithi059.stdout:4122 write 0xc42a535 thru 0xc438ad4 (0xe5a0 bytes) 2024-09-12T05:21:36.585 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:36.585 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:36.591 INFO:teuthology.orchestra.run.smithi059.stdout:4123 punch from 0x4d4edc7 to 0x4d5b056, (0xc28f bytes) 2024-09-12T05:21:36.591 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.591 INFO:teuthology.orchestra.run.smithi059.stdout:4125 read 0x8380148 thru 0x8380d31 (0xbea bytes) 2024-09-12T05:21:36.591 INFO:teuthology.orchestra.run.smithi059.stdout:4126 punch from 0xc2cbcb7 to 0xc2d5181, (0x94ca bytes) 2024-09-12T05:21:36.591 INFO:teuthology.orchestra.run.smithi059.stdout:4127 writesame 0x848423e thru 0x8485705 data_size 0x5(0x14c8 bytes) 2024-09-12T05:21:36.594 INFO:teuthology.orchestra.run.smithi059.stdout:4128 writesame 0x17bcb52 thru 0x17c8ad8 data_size 0x1(0xbf87 bytes) 2024-09-12T05:21:36.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:36.609 INFO:teuthology.orchestra.run.smithi059.stdout:4129 trunc from 0xc438ad5 to 0xe071c2a 2024-09-12T05:21:36.615 INFO:teuthology.orchestra.run.smithi059.stdout:4130 write 0xa4711cc thru 0xa4718fe (0x733 bytes) 2024-09-12T05:21:36.618 INFO:teuthology.orchestra.run.smithi059.stdout:4131 write 0x7f256bf thru 0x7f279ab (0x22ed bytes) 2024-09-12T05:21:36.620 INFO:teuthology.orchestra.run.smithi059.stdout:4132 write 0x4153c84 thru 0x4153f84 (0x301 bytes) 2024-09-12T05:21:36.623 INFO:teuthology.orchestra.run.smithi059.stdout:4134 write 0xbc764ac thru 0xbc82fca (0xcb1f bytes) 2024-09-12T05:21:36.633 INFO:teuthology.orchestra.run.smithi059.stdout:4135 write 0x56b3d6a thru 0x56bd8c9 (0x9b60 bytes) 2024-09-12T05:21:36.642 INFO:teuthology.orchestra.run.smithi059.stdout:4136 writesame 0xa727318 thru 0xa7325b1 data_size 0x1(0xb29a bytes) 2024-09-12T05:21:36.657 INFO:teuthology.orchestra.run.smithi059.stdout:4138 read 0x5c97a3 thru 0x5cbe7e (0x26dc bytes) 2024-09-12T05:21:36.657 INFO:teuthology.orchestra.run.smithi059.stdout:4139 punch from 0x5aa48bb to 0x5ab3134, (0xe879 bytes) 2024-09-12T05:21:36.658 INFO:teuthology.orchestra.run.smithi059.stdout:4140 writesame 0x691a833 thru 0x691f7ae data_size 0x2(0x4f7c bytes) 2024-09-12T05:21:36.665 INFO:teuthology.orchestra.run.smithi059.stdout:4141 read 0xd34a43c thru 0xd3529a5 (0x856a bytes) 2024-09-12T05:21:36.667 INFO:teuthology.orchestra.run.smithi059.stdout:4142 trunc from 0xe071c2a to 0xd0f9ac1 2024-09-12T05:21:36.682 INFO:teuthology.orchestra.run.smithi059.stdout:4143 write 0xa3556ca thru 0xa35c5dc (0x6f13 bytes) 2024-09-12T05:21:36.688 INFO:teuthology.orchestra.run.smithi059.stdout:4145 write 0x67a720d thru 0x67b010d (0x8f01 bytes) 2024-09-12T05:21:36.689 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:36.687+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:36.694 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.694 INFO:teuthology.orchestra.run.smithi059.stdout:4149 write 0x8f99eee thru 0x8fa4faa (0xb0bd bytes) 2024-09-12T05:21:36.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:36.702 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.702 INFO:teuthology.orchestra.run.smithi059.stdout:4151 writesame 0x3249652 thru 0x3256612 data_size 0xb(0xcfc1 bytes) 2024-09-12T05:21:36.707 INFO:teuthology.orchestra.run.smithi059.stdout:4152 read 0x6339d4 thru 0x639f8e (0x65bb bytes) 2024-09-12T05:21:36.707 INFO:teuthology.orchestra.run.smithi059.stdout:4153 writesame 0xaa5d06d thru 0xaa6678e data_size 0x6a(0x9722 bytes) 2024-09-12T05:21:36.711 INFO:teuthology.orchestra.run.smithi059.stdout:4154 write 0xa3a7edf thru 0xa3b6296 (0xe3b8 bytes) 2024-09-12T05:21:36.717 INFO:teuthology.orchestra.run.smithi059.stdout:4156 writesame 0xa21f306 thru 0xa21fc66 data_size 0x7(0x961 bytes) 2024-09-12T05:21:36.718 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.718 INFO:teuthology.orchestra.run.smithi059.stdout:4159 writesame 0x332d349 thru 0x333a364 data_size 0x26(0xd01c bytes) 2024-09-12T05:21:36.722 INFO:teuthology.orchestra.run.smithi059.stdout:4161 punch from 0x4019224 to 0x401e2c2, (0x509e bytes) 2024-09-12T05:21:36.722 INFO:teuthology.orchestra.run.smithi059.stdout:4162 read 0x42fc597 thru 0x42fd5d5 (0x103f bytes) 2024-09-12T05:21:36.722 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:36.730 INFO:teuthology.orchestra.run.smithi059.stdout:4164 trunc from 0xd0f9ac1 to 0x7b7e65c 2024-09-12T05:21:36.765 INFO:teuthology.orchestra.run.smithi059.stdout:4166 write 0xb7cb0a8 thru 0xb7d2faa (0x7f03 bytes) 2024-09-12T05:21:36.776 INFO:teuthology.orchestra.run.smithi059.stdout:4168 read 0x19cfa2b thru 0x19dc048 (0xc61e bytes) 2024-09-12T05:21:36.777 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:36.777 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:36.781 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:36.779+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:36.784 INFO:teuthology.orchestra.run.smithi059.stdout:4169 trunc from 0xb7d2fab to 0x5855526 2024-09-12T05:21:36.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:36.813 INFO:teuthology.orchestra.run.smithi059.stdout:4170 punch from 0x1edfeb6 to 0x1eee66c, (0xe7b6 bytes) 2024-09-12T05:21:36.835 INFO:teuthology.orchestra.run.smithi059.stdout:4171 writesame 0xe39b09e thru 0xe3a5ffa data_size 0x1(0xaf5d bytes) 2024-09-12T05:21:36.835 INFO:teuthology.orchestra.run.smithi059.stdout:4173 clone 34 order 24 su 2097152 sc 5 2024-09-12T05:21:36.866 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:36.867 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:21:36.882 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:36.879+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:36.889 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:36.889 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:36.914 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:36.914 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:36.923 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:36.923 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:36.923 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:36.923 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:36.934 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:36.934 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:36.935 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:36.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:36.957 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:36.980 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:36.983 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:36.979+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:37.000 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:37.001 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:37.004 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:37.005 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:37.007 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone33 2024-09-12T05:21:37.079 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:37.079 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:37.080 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:37.080 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:37.080 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:37.084 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:37.079+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:37.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:37.186 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:37.183+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:37.217 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-12T05:21:37.285 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.165482707999999, 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.286 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:37.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.294 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.834881637999999, 2024-09-12T05:21:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:21:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.295 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:21:37.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.299 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.7083212, 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.300 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:21:37.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707795675, 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:21:37.304 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:21:37.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:21:37.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707773126999999, 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.309 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:21:37.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707751337000001, 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.313 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:37.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:21:37.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:21:37.317 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707729971999999, 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.318 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:37.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:21:37.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:21:37.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:21:37.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707707426999999, 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:21:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:21:37.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:21:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:21:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707685192, 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.330 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707663608000001, 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:21:37.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707462208999999, 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:21:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:21:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.707436809000001, 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.344 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:21:37.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:21:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.700163532000001, 2024-09-12T05:21:37.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:37.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.700141142, 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.354 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.359 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.700118494000002, 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.360 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.700098005000001, 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:21:37.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:37.370 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.700071940000001, 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.700048722999998, 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.375 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:37.379 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.700026358999999, 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:37.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:21:37.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.383 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.223485983, 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:21:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:21:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:21:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:21:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:21:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:21:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:21:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.392 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.392 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:37.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:37.394 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:37.391+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:37.494 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:37.491+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:37.531 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:37.531 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:37.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:37.595 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:37.591+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:37.686 INFO:teuthology.orchestra.run.smithi059.stdout:4174 read 0x893fa9d thru 0x89499d4 (0x9f38 bytes) 2024-09-12T05:21:37.687 INFO:teuthology.orchestra.run.smithi059.stdout:4176 punch from 0x4976232 to 0x497ba63, (0x5831 bytes) 2024-09-12T05:21:37.696 INFO:teuthology.orchestra.run.smithi059.stdout:4177 write 0x3da82b2 thru 0x3db4db2 (0xcb01 bytes) 2024-09-12T05:21:37.696 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:37.691+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:37.715 INFO:teuthology.orchestra.run.smithi059.stdout:4179 writesame 0x1ca531d thru 0x1ca75bd data_size 0xf(0x22a1 bytes) 2024-09-12T05:21:37.731 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:37.732 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:37.732 INFO:teuthology.orchestra.run.smithi059.stdout:4180 punch from 0xaee1190 to 0xaeee608, (0xd478 bytes) 2024-09-12T05:21:37.732 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:37.732 INFO:teuthology.orchestra.run.smithi059.stdout:4182 read 0x5ff7d17 thru 0x60010dc (0x93c6 bytes) 2024-09-12T05:21:37.733 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:37.733 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:37.747 INFO:teuthology.orchestra.run.smithi059.stdout:4185 trunc from 0xe3a5ffb to 0x6541dd7 2024-09-12T05:21:37.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:37.805 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:37.803+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:37.811 INFO:teuthology.orchestra.run.smithi059.stdout:4186 write 0xdf28dee thru 0xdf3363f (0xa852 bytes) 2024-09-12T05:21:37.817 INFO:teuthology.orchestra.run.smithi059.stdout:4188 punch from 0x58eb20 to 0x598a77, (0x9f57 bytes) 2024-09-12T05:21:37.817 INFO:teuthology.orchestra.run.smithi059.stdout:4189 writesame 0x8a9b10e thru 0x8aa2a87 data_size 0x49(0x797a bytes) 2024-09-12T05:21:37.820 INFO:teuthology.orchestra.run.smithi059.stdout:4191 write 0x613ad55 thru 0x6143bae (0x8e5a bytes) 2024-09-12T05:21:37.823 INFO:teuthology.orchestra.run.smithi059.stdout:4192 write 0x1abb51c thru 0x1abc0df (0xbc4 bytes) 2024-09-12T05:21:37.838 INFO:teuthology.orchestra.run.smithi059.stdout:4193 write 0x16c94ad thru 0x16cfebd (0x6a11 bytes) 2024-09-12T05:21:37.856 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:37.856 INFO:teuthology.orchestra.run.smithi059.stdout:4195 writesame 0xb5223e3 thru 0xb52ce91 data_size 0xf(0xaaaf bytes) 2024-09-12T05:21:37.864 INFO:teuthology.orchestra.run.smithi059.stdout:4199 writesame 0x4c3acb6 thru 0x4c3d937 data_size 0x1b(0x2c82 bytes) 2024-09-12T05:21:37.866 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:37.867 INFO:teuthology.orchestra.run.smithi059.stdout:4203 read 0x7ead429 thru 0x7eb5442 (0x801a bytes) 2024-09-12T05:21:37.867 INFO:teuthology.orchestra.run.smithi059.stdout:4204 read 0x6dbe218 thru 0x6dcce5f (0xec48 bytes) 2024-09-12T05:21:37.868 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:37.868 INFO:teuthology.orchestra.run.smithi059.stdout:4206 write 0xb1e6fb1 thru 0xb1f3521 (0xc571 bytes) 2024-09-12T05:21:37.875 INFO:teuthology.orchestra.run.smithi059.stdout:4208 read 0xb60c2ed thru 0xb618112 (0xbe26 bytes) 2024-09-12T05:21:37.876 INFO:teuthology.orchestra.run.smithi059.stdout:4209 writesame 0x8c4ed35 thru 0x8c50bc3 data_size 0x1(0x1e8f bytes) 2024-09-12T05:21:37.886 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:37.886 INFO:teuthology.orchestra.run.smithi059.stdout:4211 punch from 0x7d75045 to 0x7d7f01f, (0x9fda bytes) 2024-09-12T05:21:37.886 INFO:teuthology.orchestra.run.smithi059.stdout:4214 write 0x1fd6ca thru 0x20ab27 (0xd45e bytes) 2024-09-12T05:21:37.890 INFO:teuthology.orchestra.run.smithi059.stdout:4215 punch from 0x505595 to 0x50a387, (0x4df2 bytes) 2024-09-12T05:21:37.890 INFO:teuthology.orchestra.run.smithi059.stdout:4216 write 0x7541dbc thru 0x7546c39 (0x4e7e bytes) 2024-09-12T05:21:37.893 INFO:teuthology.orchestra.run.smithi059.stdout:4217 writesame 0x2c9d02f thru 0x2ca4fad data_size 0x1(0x7f7f bytes) 2024-09-12T05:21:37.898 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:37.895+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:37.933 INFO:teuthology.orchestra.run.smithi059.stdout:4219 write 0x9d9660 thru 0x9e7ad6 (0xe477 bytes) 2024-09-12T05:21:37.937 INFO:teuthology.orchestra.run.smithi059.stdout:4221 read 0xbca2754 thru 0xbcad550 (0xadfd bytes) 2024-09-12T05:21:37.937 INFO:teuthology.orchestra.run.smithi059.stdout:4222 write 0x8263662 thru 0x8271cc0 (0xe65f bytes) 2024-09-12T05:21:37.940 INFO:teuthology.orchestra.run.smithi059.stdout:4223 read 0x3d0475c thru 0x3d0ecc1 (0xa566 bytes) 2024-09-12T05:21:37.941 INFO:teuthology.orchestra.run.smithi059.stdout:4224 read 0x17e0918 thru 0x17ef6f5 (0xedde bytes) 2024-09-12T05:21:37.943 INFO:teuthology.orchestra.run.smithi059.stdout:4226 punch from 0xa593846 to 0xa5a18ed, (0xe0a7 bytes) 2024-09-12T05:21:37.943 INFO:teuthology.orchestra.run.smithi059.stdout:4227 writesame 0x42a24a3 thru 0x42a3e43 data_size 0x3(0x19a1 bytes) 2024-09-12T05:21:37.946 INFO:teuthology.orchestra.run.smithi059.stdout:4228 read 0x7ac0184 thru 0x7acde66 (0xdce3 bytes) 2024-09-12T05:21:37.947 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.526751256000001, 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:21:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.515303047, 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:21:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:21:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:21:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:21:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:21:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427688142000001, 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:21:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427645038000001, 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:21:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:21:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:21:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427617789999999, 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:21:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427591509999999, 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:21:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427568899000001, 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:21:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.42754107, 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:21:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427518651, 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:21:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427497518999999, 2024-09-12T05:21:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:21:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427408884999998, 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427377951, 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:21:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:21:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427351788999999, 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427329615000001, 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:21:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427308500999999, 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:21:38.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427286863999999, 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:21:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78378 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427178428000001, 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059385249000000001, 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78378 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519236+0000", 2024-09-12T05:21:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3900000000000004e-07 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519240+0000", 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3759999999999999e-06 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519249+0000", 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519256+0000", 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578613+0000", 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059356679000000002 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578621+0000", 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5020000000000003e-06 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427121949, 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:21:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.427094232999998, 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.341566337, 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:21:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:21:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.042 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:38.043 INFO:teuthology.orchestra.run.smithi059.stdout:4230 read 0x6f29db0 thru 0x6f34bf1 (0xae42 bytes) 2024-09-12T05:21:38.043 INFO:teuthology.orchestra.run.smithi059.stdout:4231 punch from 0xc6bb461 to 0xc6c0837, (0x53d6 bytes) 2024-09-12T05:21:38.043 INFO:teuthology.orchestra.run.smithi059.stdout:4232 trunc from 0xdf33640 to 0x92d788c 2024-09-12T05:21:38.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:38.044 INFO:teuthology.orchestra.run.smithi059.stdout:4233 punch from 0x3befc7b to 0x3bfa80d, (0xab92 bytes) 2024-09-12T05:21:38.044 INFO:teuthology.orchestra.run.smithi059.stdout:4234 trunc from 0x92d788c to 0x25d9851 2024-09-12T05:21:38.046 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:38.043+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:38.055 INFO:teuthology.orchestra.run.smithi059.stdout:4237 write 0x7233828 thru 0x7241f68 (0xe741 bytes) 2024-09-12T05:21:38.063 INFO:teuthology.orchestra.run.smithi059.stdout:4239 read 0x6d8e00b thru 0x6d9552e (0x7524 bytes) 2024-09-12T05:21:38.063 INFO:teuthology.orchestra.run.smithi059.stdout:4240 punch from 0x18d6bbf to 0x18e18ca, (0xad0b bytes) 2024-09-12T05:21:38.063 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.063 INFO:teuthology.orchestra.run.smithi059.stdout:4243 punch from 0x271251e to 0x271b3fe, (0x8ee0 bytes) 2024-09-12T05:21:38.063 INFO:teuthology.orchestra.run.smithi059.stdout:4244 read 0x428b4d2 thru 0x42985c3 (0xd0f2 bytes) 2024-09-12T05:21:38.065 INFO:teuthology.orchestra.run.smithi059.stdout:4248 trunc from 0x7241f69 to 0x6a812c0 2024-09-12T05:21:38.083 INFO:teuthology.orchestra.run.smithi059.stdout:4249 read 0x53d3e62 thru 0x53d996d (0x5b0c bytes) 2024-09-12T05:21:38.083 INFO:teuthology.orchestra.run.smithi059.stdout:4250 read 0x4db9aee thru 0x4dbdc74 (0x4187 bytes) 2024-09-12T05:21:38.084 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.084 INFO:teuthology.orchestra.run.smithi059.stdout:4253 write 0x21f01b3 thru 0x21f3181 (0x2fcf bytes) 2024-09-12T05:21:38.088 INFO:teuthology.orchestra.run.smithi059.stdout:4254 writesame 0x3ced91f thru 0x3cfd199 data_size 0x1(0xf87b bytes) 2024-09-12T05:21:38.138 INFO:teuthology.orchestra.run.smithi059.stdout:4256 punch from 0x44ddbd3 to 0x44ec37c, (0xe7a9 bytes) 2024-09-12T05:21:38.146 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:38.143+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:38.158 INFO:teuthology.orchestra.run.smithi059.stdout:4257 writesame 0x9373150 thru 0x937db56 data_size 0xb(0xaa07 bytes) 2024-09-12T05:21:38.158 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.158 INFO:teuthology.orchestra.run.smithi059.stdout:4259 write 0x42f52d2 thru 0x43004c1 (0xb1f0 bytes) 2024-09-12T05:21:38.161 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.161 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.166 INFO:teuthology.orchestra.run.smithi059.stdout:4263 trunc from 0x937db57 to 0x66c194e 2024-09-12T05:21:38.193 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:38.194 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:38.198 INFO:teuthology.orchestra.run.smithi059.stdout:4264 trunc from 0x66c194e to 0x10f1e2 2024-09-12T05:21:38.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:38.257 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:38.255+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:38.267 INFO:teuthology.orchestra.run.smithi059.stdout:4265 trunc from 0x10f1e2 to 0xc363939 2024-09-12T05:21:38.282 INFO:teuthology.orchestra.run.smithi059.stdout:4268 read 0xbe16304 thru 0xbe17a5b (0x1758 bytes) 2024-09-12T05:21:38.282 INFO:teuthology.orchestra.run.smithi059.stdout:4269 write 0x70f1e05 thru 0x70fb052 (0x924e bytes) 2024-09-12T05:21:38.288 INFO:teuthology.orchestra.run.smithi059.stdout:4270 writesame 0x511a89e thru 0x51257bd data_size 0x10(0xaf20 bytes) 2024-09-12T05:21:38.297 INFO:teuthology.orchestra.run.smithi059.stdout:4271 read 0x9c0320e thru 0x9c11f47 (0xed3a bytes) 2024-09-12T05:21:38.297 INFO:teuthology.orchestra.run.smithi059.stdout:4272 write 0x1bf885b thru 0x1bff6b2 (0x6e58 bytes) 2024-09-12T05:21:38.302 INFO:teuthology.orchestra.run.smithi059.stdout:4273 write 0x29f36da thru 0x29fda72 (0xa399 bytes) 2024-09-12T05:21:38.305 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.306 INFO:teuthology.orchestra.run.smithi059.stdout:4275 write 0x6be5006 thru 0x6be96b0 (0x46ab bytes) 2024-09-12T05:21:38.312 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.328 INFO:teuthology.orchestra.run.smithi059.stdout:4278 write 0xd32e795 thru 0xd3305d5 (0x1e41 bytes) 2024-09-12T05:21:38.334 INFO:teuthology.orchestra.run.smithi059.stdout:4279 write 0xb5c53dc thru 0xb5c7bd5 (0x27fa bytes) 2024-09-12T05:21:38.347 INFO:teuthology.orchestra.run.smithi059.stdout:4280 trunc from 0xd3305d6 to 0x7f82e17 2024-09-12T05:21:38.349 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:38.343+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:38.374 INFO:teuthology.orchestra.run.smithi059.stdout:4282 read 0x40405d9 thru 0x4049b03 (0x952b bytes) 2024-09-12T05:21:38.374 INFO:teuthology.orchestra.run.smithi059.stdout:4283 punch from 0x1b724ba to 0x1b7bd1d, (0x9863 bytes) 2024-09-12T05:21:38.383 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:38.384 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:38.396 INFO:teuthology.orchestra.run.smithi059.stdout:4287 writesame 0xb1ff477 thru 0xb207ee5 data_size 0x1(0x8a6f bytes) 2024-09-12T05:21:38.396 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.396 INFO:teuthology.orchestra.run.smithi059.stdout:4290 read 0x89ccccf thru 0x89db62f (0xe961 bytes) 2024-09-12T05:21:38.396 INFO:teuthology.orchestra.run.smithi059.stdout:4291 read 0x3953dc5 thru 0x3958d46 (0x4f82 bytes) 2024-09-12T05:21:38.397 INFO:teuthology.orchestra.run.smithi059.stdout:4292 writesame 0x6cf3c1f thru 0x6d023f2 data_size 0x4a(0xe7d4 bytes) 2024-09-12T05:21:38.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:38.404 INFO:teuthology.orchestra.run.smithi059.stdout:4294 punch from 0x9df5fe2 to 0x9dfaf7a, (0x4f98 bytes) 2024-09-12T05:21:38.420 INFO:teuthology.orchestra.run.smithi059.stdout:4297 write 0xd8adddd thru 0xd8b68db (0x8aff bytes) 2024-09-12T05:21:38.429 INFO:teuthology.orchestra.run.smithi059.stdout:4298 trunc from 0xd8b68dc to 0xc2a27ef 2024-09-12T05:21:38.445 INFO:teuthology.orchestra.run.smithi059.stdout:4299 read 0xbe9d6bf thru 0xbea8ae4 (0xb426 bytes) 2024-09-12T05:21:38.446 INFO:teuthology.orchestra.run.smithi059.stdout:4303 write 0xc008c24 thru 0xc00b2c3 (0x26a0 bytes) 2024-09-12T05:21:38.449 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:38.447+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:38.451 INFO:teuthology.orchestra.run.smithi059.stdout:4304 punch from 0x94de556 to 0x94e83ea, (0x9e94 bytes) 2024-09-12T05:21:38.451 INFO:teuthology.orchestra.run.smithi059.stdout:4305 write 0x258ca61 thru 0x25962c9 (0x9869 bytes) 2024-09-12T05:21:38.453 INFO:teuthology.orchestra.run.smithi059.stdout:4309 writesame 0x4b81409 thru 0x4b8a04c data_size 0x5e(0x8c44 bytes) 2024-09-12T05:21:38.458 INFO:teuthology.orchestra.run.smithi059.stdout:4310 write 0xbeaf819 thru 0xbeb4026 (0x480e bytes) 2024-09-12T05:21:38.467 INFO:teuthology.orchestra.run.smithi059.stdout:4311 writesame 0x65db460 thru 0x65e36a8 data_size 0x1(0x8249 bytes) 2024-09-12T05:21:38.478 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6] out_osds: [2] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:21:38.478 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:38.478 INFO:tasks.thrashosds.thrasher:Adding osd 2 2024-09-12T05:21:38.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 2 2024-09-12T05:21:38.503 INFO:teuthology.orchestra.run.smithi059.stdout:4312 punch from 0x791632 to 0x79c6a8, (0xb076 bytes) 2024-09-12T05:21:38.504 INFO:teuthology.orchestra.run.smithi059.stdout:4313 flatten 2024-09-12T05:21:38.526 INFO:teuthology.orchestra.run.smithi059.stdout:4316 trunc from 0xc2a27ef to 0x5ca9734 2024-09-12T05:21:38.529 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 77.550905576000005, 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:21:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.639273259000007, 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:21:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:21:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:21:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.256572774999995, 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:21:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.022529128000002, 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:21:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:21:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.992404797000006, 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:21:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.430317016000004, 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:21:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.428362797999995, 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:21:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.487054063999999, 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:21:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.470457471000003, 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:21:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:21:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 61.300118030999997, 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:21:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:21:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.421663778999999, 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:21:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:21:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.421618684999999, 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:21:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.413057123999998, 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:21:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:21:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.611018965, 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.096895527000001, 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:21:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.088809435000002, 2024-09-12T05:21:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.186623187999999, 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:21:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:21:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.209223266999999, 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.457076287, 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:21:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:21:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.097826556000001, 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:21:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:21:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:21:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:21:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:38.620 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:38.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:38.625 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.625 INFO:teuthology.orchestra.run.smithi059.stdout:4318 punch from 0x49729a9 to 0x4973877, (0xece bytes) 2024-09-12T05:21:38.625 INFO:teuthology.orchestra.run.smithi059.stdout:4319 trunc from 0x5ca9734 to 0x84e975a 2024-09-12T05:21:38.625 INFO:teuthology.orchestra.run.smithi059.stdout:4320 read 0x389f682 thru 0x38ac9c7 (0xd346 bytes) 2024-09-12T05:21:38.625 INFO:teuthology.orchestra.run.smithi059.stdout:4321 read 0x39ae7a3 thru 0x39be555 (0xfdb3 bytes) 2024-09-12T05:21:38.625 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.626 INFO:teuthology.orchestra.run.smithi059.stdout:4323 write 0x1e8d35b thru 0x1e9967c (0xc322 bytes) 2024-09-12T05:21:38.626 INFO:teuthology.orchestra.run.smithi059.stdout:4324 writesame 0x33cc334 thru 0x33d1e52 data_size 0x1(0x5b1f bytes) 2024-09-12T05:21:38.626 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.626 INFO:teuthology.orchestra.run.smithi059.stdout:4327 trunc from 0x84e975a to 0xec1e6a6 2024-09-12T05:21:38.626 INFO:teuthology.orchestra.run.smithi059.stdout:4328 write 0x9d98e0f thru 0x9da414a (0xb33c bytes) 2024-09-12T05:21:38.626 INFO:teuthology.orchestra.run.smithi059.stdout:4329 read 0x61a5917 thru 0x61ac610 (0x6cfa bytes) 2024-09-12T05:21:38.626 INFO:teuthology.orchestra.run.smithi059.stdout:4330 writesame 0xb6f82e7 thru 0xb706a63 data_size 0x1(0xe77d bytes) 2024-09-12T05:21:38.626 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:38.619+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:38.646 INFO:teuthology.orchestra.run.smithi059.stdout:4332 writesame 0xac29334 thru 0xac32d2a data_size 0x1(0x99f7 bytes) 2024-09-12T05:21:38.659 INFO:teuthology.orchestra.run.smithi059.stdout:4333 writesame 0xe24f585 thru 0xe25de25 data_size 0x27(0xe8a1 bytes) 2024-09-12T05:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout:4336 read 0xa9de406 thru 0xa9e450d (0x6108 bytes) 2024-09-12T05:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout:4337 writesame 0x496967e thru 0x496b572 data_size 0x5(0x1ef5 bytes) 2024-09-12T05:21:38.674 INFO:teuthology.orchestra.run.smithi059.stdout:4338 read 0x1d9b171 thru 0x1d9b827 (0x6b7 bytes) 2024-09-12T05:21:38.674 INFO:teuthology.orchestra.run.smithi059.stdout:4342 write 0x5eacd93 thru 0x5eae253 (0x14c1 bytes) 2024-09-12T05:21:38.680 INFO:teuthology.orchestra.run.smithi059.stdout:4344 write 0x88e00f1 thru 0x88e244e (0x235e bytes) 2024-09-12T05:21:38.701 INFO:teuthology.orchestra.run.smithi059.stdout:4345 trunc from 0xec1e6a6 to 0x2489f20 2024-09-12T05:21:38.722 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:38.719+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:38.726 INFO:teuthology.orchestra.run.smithi059.stdout:4346 write 0xb6d28d thru 0xb728d0 (0x5644 bytes) 2024-09-12T05:21:38.729 INFO:teuthology.orchestra.run.smithi059.stdout:4348 read 0x1ee3868 thru 0x1ee771d (0x3eb6 bytes) 2024-09-12T05:21:38.730 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.753 INFO:teuthology.orchestra.run.smithi059.stdout:4351 write 0x9738ec1 thru 0x9747a79 (0xebb9 bytes) 2024-09-12T05:21:38.760 INFO:teuthology.orchestra.run.smithi059.stdout:4352 write 0x168dc82 thru 0x169d3b8 (0xf737 bytes) 2024-09-12T05:21:38.763 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.763 INFO:teuthology.orchestra.run.smithi059.stdout:4356 read 0x2bf88a2 thru 0x2c04e0c (0xc56b bytes) 2024-09-12T05:21:38.773 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:38.773 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:38.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:38.790 INFO:teuthology.orchestra.run.smithi059.stdout:4357 writesame 0xe650efd thru 0xe65fcd1 data_size 0x63(0xedd5 bytes) 2024-09-12T05:21:38.790 INFO:teuthology.orchestra.run.smithi059.stdout:4358 punch from 0x2939626 to 0x29443c2, (0xad9c bytes) 2024-09-12T05:21:38.790 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.790 INFO:teuthology.orchestra.run.smithi059.stdout:4360 read 0x65efa65 thru 0x65fc82d (0xcdc9 bytes) 2024-09-12T05:21:38.791 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.791 INFO:teuthology.orchestra.run.smithi059.stdout:4362 writesame 0x1e8184c thru 0x1e8a8ca data_size 0x1(0x907f bytes) 2024-09-12T05:21:38.828 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.829 INFO:teuthology.orchestra.run.smithi059.stdout:4364 write 0x6371b96 thru 0x637734a (0x57b5 bytes) 2024-09-12T05:21:38.829 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:38.823+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:38.829 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-12T05:21:38.827+0000 7f6402832640 -1 mon.a@0(leader).osd e86 definitely_dead 0 2024-09-12T05:21:38.833 INFO:teuthology.orchestra.run.smithi059.stdout:4365 write 0x5bdd2be thru 0x5be5b43 (0x8886 bytes) 2024-09-12T05:21:38.836 INFO:teuthology.orchestra.run.smithi059.stdout:4366 writesame 0xfe49da thru 0xfe65cc data_size 0x1b(0x1bf3 bytes) 2024-09-12T05:21:38.838 INFO:teuthology.orchestra.run.smithi059.stdout:4367 punch from 0xb6446ae to 0xb64c194, (0x7ae6 bytes) 2024-09-12T05:21:38.851 INFO:teuthology.orchestra.run.smithi059.stdout:4368 trunc from 0xe65fcd2 to 0x652ea4a 2024-09-12T05:21:38.870 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.870 INFO:teuthology.orchestra.run.smithi059.stdout:4373 write 0x25f4280 thru 0x25fe8e3 (0xa664 bytes) 2024-09-12T05:21:38.872 INFO:teuthology.orchestra.run.smithi059.stdout:4374 read 0x237ebfc thru 0x23831ae (0x45b3 bytes) 2024-09-12T05:21:38.873 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.873 INFO:teuthology.orchestra.run.smithi059.stdout:4376 writesame 0x2813f8d thru 0x281ff56 data_size 0x62(0xbfca bytes) 2024-09-12T05:21:38.881 INFO:teuthology.orchestra.run.smithi059.stdout:4377 trunc from 0x652ea4a to 0x2f61cc9 2024-09-12T05:21:38.891 INFO:teuthology.orchestra.run.smithi059.stderr:marked in osd.2. 2024-09-12T05:21:38.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:21:38.919 INFO:tasks.thrashosds.thrasher:Added osd 2 2024-09-12T05:21:38.921 INFO:teuthology.orchestra.run.smithi059.stdout:4379 write 0x2f23f80 thru 0x2f2d0c9 (0x914a bytes) 2024-09-12T05:21:38.922 INFO:teuthology.orchestra.run.smithi059.stdout:4380 read 0x161de6d thru 0x1622937 (0x4acb bytes) 2024-09-12T05:21:38.923 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:38.919+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:38.924 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.926 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:38.926 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:38.927 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:38.927 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:38.937 INFO:teuthology.orchestra.run.smithi059.stdout:4383 trunc from 0x2f61cc9 to 0xbea940f 2024-09-12T05:21:38.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:38.951 INFO:teuthology.orchestra.run.smithi059.stdout:4384 punch from 0x9c7fb20 to 0x9c85c96, (0x6176 bytes) 2024-09-12T05:21:38.951 INFO:teuthology.orchestra.run.smithi059.stdout:4385 write 0x4804813 thru 0x4812249 (0xda37 bytes) 2024-09-12T05:21:38.955 INFO:teuthology.orchestra.run.smithi059.stdout:4387 write 0xa7727b1 thru 0xa77933c (0x6b8c bytes) 2024-09-12T05:21:38.963 INFO:teuthology.orchestra.run.smithi059.stdout:4388 write 0x43fd789 thru 0x4402ca5 (0x551d bytes) 2024-09-12T05:21:38.982 INFO:teuthology.orchestra.run.smithi059.stdout:4391 write 0xbed9f2e thru 0xbedc0e6 (0x21b9 bytes) 2024-09-12T05:21:38.989 INFO:teuthology.orchestra.run.smithi059.stdout:4392 read 0x2a6e6c thru 0x2a7ea2 (0x1037 bytes) 2024-09-12T05:21:38.989 INFO:teuthology.orchestra.run.smithi059.stdout:4393 read 0x1ce3760 thru 0x1cea18a (0x6a2b bytes) 2024-09-12T05:21:38.990 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:38.990 INFO:teuthology.orchestra.run.smithi059.stdout:4396 read 0x32a08c0 thru 0x32a2978 (0x20b9 bytes) 2024-09-12T05:21:38.991 INFO:teuthology.orchestra.run.smithi059.stdout:4397 write 0x3f0a062 thru 0x3f10965 (0x6904 bytes) 2024-09-12T05:21:38.994 INFO:teuthology.orchestra.run.smithi059.stdout:4398 clone 35 order 18 su 131072 sc 15 2024-09-12T05:21:39.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:39.024 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:39.019+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:39.075 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:39.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80148 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6594560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.362659518000001, 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047081795000000003, 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80148 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712493+0000", 2024-09-12T05:21:39.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8299999999999997e-07 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712495+0000", 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3099999999999999e-06 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712504+0000", 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5290000000000008e-06 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712509+0000", 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4480000000000002e-06 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759399+0000", 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046889693000000003 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759478+0000", 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9040000000000002e-05 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759574+0000", 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6292000000000006e-05 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80149 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7028736~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.362613843999998, 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047236827000000002, 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.081 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80149 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712539+0000", 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712542+0000", 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9639999999999999e-06 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712550+0000", 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7709999999999995e-06 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712556+0000", 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6380000000000001e-06 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759608+0000", 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047051754000000001 2024-09-12T05:21:39.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759684+0000", 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6784000000000002e-05 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759775+0000", 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000001e-05 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80150 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6701056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.362586607000001, 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047422082999999997, 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.086 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80150 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713023+0000", 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00045808399999999999 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713028+0000", 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7849999999999999e-06 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713039+0000", 2024-09-12T05:21:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0530000000000001e-05 2024-09-12T05:21:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713046+0000", 2024-09-12T05:21:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2710000000000003e-06 2024-09-12T05:21:39.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759807+0000", 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046761182999999998 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759887+0000", 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9709999999999994e-05 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759987+0000", 2024-09-12T05:21:39.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010052000000000001 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80151 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7036928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.362092234999999, 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047137710999999999, 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.091 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80151 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:39.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713063+0000", 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7460000000000001e-06 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713071+0000", 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6159999999999996e-06 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713077+0000", 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760020+0000", 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046943358999999997 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760098+0000", 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7519000000000001e-05 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760197+0000", 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9778000000000006e-05 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.095 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80152 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6709248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:39.096 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.362066283000001, 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047326518999999997, 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80152 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713245+0000", 2024-09-12T05:21:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015924600000000001 2024-09-12T05:21:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713249+0000", 2024-09-12T05:21:39.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3379999999999998e-06 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713265+0000", 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6184e-05 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713271+0000", 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6670000000000001e-06 2024-09-12T05:21:39.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760231+0000", 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046960285999999997 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760311+0000", 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9643999999999998e-05 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760412+0000", 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101154 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80153 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6799360~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.361871117, 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047341640999999997, 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.102 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80153 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713474+0000", 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192898 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713477+0000", 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3890000000000001e-06 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713487+0000", 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713494+0000", 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4540000000000001e-06 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760444+0000", 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046949957 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760526+0000", 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1361999999999998e-05 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760622+0000", 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6587000000000002e-05 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80154 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8413184~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:39.107 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.361645118999999, 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047319877000000003, 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80154 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713977+0000", 2024-09-12T05:21:39.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00047076399999999998 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713985+0000", 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8790000000000003e-06 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713996+0000", 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.113e-05 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714003+0000", 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8979999999999999e-06 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760655+0000", 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046651821000000003 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760734+0000", 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9208999999999993e-05 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760827+0000", 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2176000000000007e-05 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80156 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8503296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.361110602, 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047199342999999998, 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80156 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:39.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719243+0000", 2024-09-12T05:21:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052018419999999999 2024-09-12T05:21:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719248+0000", 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1760000000000001e-06 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719261+0000", 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3045e-05 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719269+0000", 2024-09-12T05:21:39.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1130000000000001e-06 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761068+0000", 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041798096999999999 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761148+0000", 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0301000000000002e-05 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761241+0000", 2024-09-12T05:21:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769000000000006e-05 2024-09-12T05:21:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80227 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4956160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.355093229000001, 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047195107, 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80227 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.118 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4900000000000001e-07 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720061+0000", 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0980000000000001e-06 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720068+0000", 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.007e-06 2024-09-12T05:21:39.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720074+0000", 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767070+0000", 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046996653999999999 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767150+0000", 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9919000000000005e-05 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767254+0000", 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103639 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80228 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 5718016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.355071379000002, 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047313252, 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80228 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720081+0000", 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8599999999999999e-07 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720083+0000", 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720089+0000", 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:39.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720094+0000", 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7929999999999997e-06 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767286+0000", 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047191666 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767338+0000", 2024-09-12T05:21:39.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2441000000000002e-05 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767394+0000", 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5526000000000003e-05 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80229 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4628480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.355051371999998, 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047505240999999997, 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80229 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727276+0000", 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071757619999999996 2024-09-12T05:21:39.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727282+0000", 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7019999999999998e-06 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727293+0000", 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0778000000000001e-05 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727300+0000", 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5769999999999996e-06 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767428+0000", 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040128193 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767510+0000", 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1203000000000002e-05 2024-09-12T05:21:39.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767606+0000", 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6026000000000005e-05 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80275 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7069696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.347034149999999, 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047223138999999997, 2024-09-12T05:21:39.132 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80275 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9399999999999995e-07 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728120+0000", 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2879999999999999e-06 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728127+0000", 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8669999999999996e-06 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728133+0000", 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775161+0000", 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047027843 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775243+0000", 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2126999999999995e-05 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775341+0000", 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8189000000000005e-05 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80276 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6742016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.347011897000002, 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047322971999999998, 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80276 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728506+0000", 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036576600000000001 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728510+0000", 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5689999999999998e-06 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728519+0000", 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7190000000000007e-06 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728525+0000", 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775371+0000", 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046846023000000001 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775410+0000", 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8584000000000002e-05 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775463+0000", 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2964999999999999e-05 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80277 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6758400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.141 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.346610894000001, 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047131702999999997, 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80277 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:39.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728770+0000", 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228586 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728774+0000", 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728784+0000", 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5249999999999994e-06 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728790+0000", 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6139999999999997e-06 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775498+0000", 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046708040999999999 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775577+0000", 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8553999999999994e-05 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775673+0000", 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5644999999999997e-05 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.145 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80279 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6856704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.346323140999999, 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047172124000000003, 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.146 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80279 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729026+0000", 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019762800000000001 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729030+0000", 2024-09-12T05:21:39.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729039+0000", 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1209999999999996e-06 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729046+0000", 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3450000000000002e-06 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775825+0000", 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046779646000000001 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775906+0000", 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0337e-05 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776001+0000", 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5047e-05 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80281 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6635520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.346059337, 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047239476000000002, 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.151 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80281 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729204+0000", 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111247 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729209+0000", 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2979999999999999e-06 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729220+0000", 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1032e-05 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729228+0000", 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.571e-06 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776155+0000", 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046927340999999997 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776236+0000", 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0551999999999997e-05 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776332+0000", 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6434999999999994e-05 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.155 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80282 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6971392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.34591035, 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047211569000000002, 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80282 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729654+0000", 2024-09-12T05:21:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000412118 2024-09-12T05:21:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729662+0000", 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8200000000000003e-06 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729675+0000", 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2996000000000001e-05 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729684+0000", 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1629999999999996e-06 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776362+0000", 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046678450000000003 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776403+0000", 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0627999999999998e-05 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776453+0000", 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0393999999999999e-05 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80285 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 3104768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.345328640999998, 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047179632999999999, 2024-09-12T05:21:39.161 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80285 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730008+0000", 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018459999999999999 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730012+0000", 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6090000000000003e-06 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730024+0000", 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1853e-05 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730033+0000", 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776826+0000", 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046792907000000002 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776908+0000", 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1981e-05 2024-09-12T05:21:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777003+0000", 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4712999999999999e-05 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80287 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2777088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.344911735, 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047092717999999999, 2024-09-12T05:21:39.166 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80287 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730400+0000", 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000159684 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730404+0000", 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2780000000000004e-06 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730412+0000", 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4669999999999998e-06 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730416+0000", 2024-09-12T05:21:39.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6609999999999999e-06 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777158+0000", 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046741956000000001 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777236+0000", 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7960999999999994e-05 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777333+0000", 2024-09-12T05:21:39.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6711000000000003e-05 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:102631 3.7 3:e1f14bfd:::rbd_data.11181f89f1e6.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.983719805, 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048849113999999999, 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 102631 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:39.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091434+0000", 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.429e-06 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091445+0000", 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0932e-05 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091471+0000", 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-05 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091486+0000", 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5506999999999999e-05 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091583+0000", 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6407e-05 2024-09-12T05:21:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091661+0000", 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8046999999999993e-05 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 7", 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.098845+0000", 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071841509999999997 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:39.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140140+0000", 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041295239999999997 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140190+0000", 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9629999999999997e-05 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140240+0000", 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0353999999999999e-05 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:39.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140281+0000", 2024-09-12T05:21:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1007000000000002e-05 2024-09-12T05:21:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:39.179 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:39.179 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:39.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:39.181 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:39.182 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:39.182 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:39.175+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:39.182 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:39.183 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:39.199 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:39.200 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:39.200 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:39.217 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:39.218 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:39.236 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:39.237 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:39.255 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:39.255 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:39.258 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:39.259 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:39.301 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:39.299+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:39.314 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:39.314 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:39.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:39.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:39.379+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:39.449 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:39.450 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:39.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:39.482 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:39.483+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:39.583 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:39.583+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:39.626 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:39.626 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:39.640 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:39.684 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:39.683+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:39.737 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:21:39.763 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:39.763 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:39.777 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:39.821 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:39.819+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:39.885 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:39.883+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:39.897 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:39.897 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:39.912 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:40.005 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:40.003+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:40.079 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:40.080 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:40.088 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:40.083+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:40.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:40.189 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:40.187+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:40.260 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:40.260 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:40.274 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:40.290 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:40.291+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:40.391 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:40.387+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:40.391 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:40.392 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:40.407 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:40.491 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:40.487+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:40.575 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:40.575 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:40.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:40.591 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:40.587+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:40.693 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:40.687+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:40.726 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:40.726 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:40.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:40.794 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:40.791+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:40.884 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:40.884 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:40.895 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:40.891+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:40.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:40.995 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:40.991+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:41.057 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:41.057 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:41.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:41.092 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-12T05:21:41.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:41.091+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:41.197 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:41.195+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:41.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:41.261 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:41.261 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:41.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:41.298 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:41.299+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:41.399 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:41.395+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:41.413 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:41.415 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:41.430 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:41.431 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:41.448 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:41.461 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:41.461 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:41.461 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:41.461 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:41.461 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:41.465 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:41.465 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:41.465 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:41.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:41.489 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:41.489 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:41.499 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:41.495+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:41.508 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:41.508 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:41.529 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:41.531 INFO:teuthology.orchestra.run.smithi059.stdout:4399 writesame 0x436e9d1 thru 0x4373f26 data_size 0xb(0x5556 bytes) 2024-09-12T05:21:41.532 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:41.533 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:41.546 INFO:teuthology.orchestra.run.smithi059.stdout:4400 write 0x348a557 thru 0x348fc50 (0x56fa bytes) 2024-09-12T05:21:41.553 INFO:teuthology.orchestra.run.smithi059.stdout:4402 write 0x4b8142f thru 0x4b835c2 (0x2194 bytes) 2024-09-12T05:21:41.559 INFO:teuthology.orchestra.run.smithi059.stdout:4406 writesame 0x9aab469 thru 0x9ab158c data_size 0x2(0x6124 bytes) 2024-09-12T05:21:41.584 INFO:teuthology.orchestra.run.smithi059.stdout:4408 write 0x8261638 thru 0x826d653 (0xc01c bytes) 2024-09-12T05:21:41.590 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:41.590 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:41.590 INFO:teuthology.orchestra.run.smithi059.stdout:4411 read 0x2d724d1 thru 0x2d7e557 (0xc087 bytes) 2024-09-12T05:21:41.591 INFO:teuthology.orchestra.run.smithi059.stdout:4413 write 0x97aeb09 thru 0x97b8106 (0x95fe bytes) 2024-09-12T05:21:41.598 INFO:teuthology.orchestra.run.smithi059.stdout:4414 read 0x9754011 thru 0x9758044 (0x4034 bytes) 2024-09-12T05:21:41.598 INFO:teuthology.orchestra.run.smithi059.stdout:4421 write 0xa6fe640 thru 0xa6fef49 (0x90a bytes) 2024-09-12T05:21:41.601 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:41.595+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:41.601 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:41.601 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:41.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:41.601 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:41.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.182532611999999, 2024-09-12T05:21:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:21:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:21:41.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:21:41.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:21:41.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:41.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.607 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.171084402999998, 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:21:41.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083469497999999, 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.612 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:21:41.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083426394, 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:21:41.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.620 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083399146000001, 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:21:41.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083372866000001, 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:21:41.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083350254999999, 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:21:41.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083322425999999, 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.634 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:41.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083300006999998, 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:21:41.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:21:41.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083278875000001, 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:21:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:21:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083190241, 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:21:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083159306999999, 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:21:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083133145000001, 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.658 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083110971, 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:21:41.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.662 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083089857000001, 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.663 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.083068220000001, 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:21:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:21:41.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:21:41.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78378 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.082959784, 2024-09-12T05:21:41.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059385249000000001, 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78378 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519235+0000", 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519236+0000", 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3900000000000004e-07 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519240+0000", 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3759999999999999e-06 2024-09-12T05:21:41.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519249+0000", 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519256+0000", 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578613+0000", 2024-09-12T05:21:41.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059356679000000002 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578621+0000", 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5020000000000003e-06 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.082903304999999, 2024-09-12T05:21:41.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:21:41.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.082875589, 2024-09-12T05:21:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:41.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:41.683 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.997347693000002, 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:41.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:21:41.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:21:41.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:41.689 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:41.692 INFO:teuthology.orchestra.run.smithi059.stdout:4423 writesame 0x22dd12 thru 0x23d61c data_size 0x29(0xf90b bytes) 2024-09-12T05:21:41.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:41.695 INFO:teuthology.orchestra.run.smithi059.stdout:4424 read 0x6cbafc0 thru 0x6cbb0c6 (0x107 bytes) 2024-09-12T05:21:41.695 INFO:teuthology.orchestra.run.smithi059.stdout:4425 read 0x14f9bdd thru 0x15072db (0xd6ff bytes) 2024-09-12T05:21:41.695 INFO:teuthology.orchestra.run.smithi059.stdout:4426 read 0x2612b9c thru 0x261d96d (0xadd2 bytes) 2024-09-12T05:21:41.695 INFO:teuthology.orchestra.run.smithi059.stdout:4427 punch from 0x2a8f2db to 0x2a9776d, (0x8492 bytes) 2024-09-12T05:21:41.695 INFO:teuthology.orchestra.run.smithi059.stdout:4428 trunc from 0xbedc0e7 to 0xad26b50 2024-09-12T05:21:41.695 INFO:teuthology.orchestra.run.smithi059.stdout:4431 punch from 0xff6b13 to 0x1003617, (0xcb04 bytes) 2024-09-12T05:21:41.695 INFO:teuthology.orchestra.run.smithi059.stdout:4432 read 0x6bcb335 thru 0x6bd3044 (0x7d10 bytes) 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4433 punch from 0xa6e281c to 0xa6e58d4, (0x30b8 bytes) 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4435 write 0x715be1 thru 0x71660d (0xa2d bytes) 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4437 punch from 0x548d884 to 0x5491f43, (0x46bf bytes) 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4439 punch from 0x9452437 to 0x9461b7b, (0xf744 bytes) 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4440 read 0x6ecee4d thru 0x6ed3b08 (0x4cbc bytes) 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4441 read 0x896355b thru 0x896e2d6 (0xad7c bytes) 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4442 read 0xcc3f66 thru 0xcc8a96 (0x4b31 bytes) 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4443 trunc from 0xad26b50 to 0xd448658 2024-09-12T05:21:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:4444 writesame 0x38355a2 thru 0x3843437 data_size 0x3(0xde96 bytes) 2024-09-12T05:21:41.701 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:41.699+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:41.707 INFO:teuthology.orchestra.run.smithi059.stdout:4445 writesame 0x8881c94 thru 0x88854bd data_size 0x1a(0x382a bytes) 2024-09-12T05:21:41.715 INFO:teuthology.orchestra.run.smithi059.stdout:4447 write 0x7b71307 thru 0x7b7d907 (0xc601 bytes) 2024-09-12T05:21:41.724 INFO:teuthology.orchestra.run.smithi059.stdout:4448 write 0xa080f17 thru 0xa08e2a5 (0xd38f bytes) 2024-09-12T05:21:41.750 INFO:teuthology.orchestra.run.smithi059.stdout:4449 trunc from 0xd448658 to 0x58c1914 2024-09-12T05:21:41.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:21:41.807 INFO:teuthology.orchestra.run.smithi059.stdout:4450 punch from 0x409cd16 to 0x40a2fc0, (0x62aa bytes) 2024-09-12T05:21:41.808 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:41.803+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:41.824 INFO:teuthology.orchestra.run.smithi059.stdout:4451 writesame 0x88c1236 thru 0x88c2d72 data_size 0x1(0x1b3d bytes) 2024-09-12T05:21:41.841 INFO:teuthology.orchestra.run.smithi059.stdout:4453 write 0xa14369b thru 0xa14fbdf (0xc545 bytes) 2024-09-12T05:21:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:4456 punch from 0x796c35e to 0x796ecaa, (0x294c bytes) 2024-09-12T05:21:41.849 INFO:teuthology.orchestra.run.smithi059.stdout:4457 punch from 0x47837b1 to 0x478a0a4, (0x68f3 bytes) 2024-09-12T05:21:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:4458 read 0x2349cda thru 0x23559bc (0xbce3 bytes) 2024-09-12T05:21:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:41.850 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:41.850 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:41.850 INFO:teuthology.orchestra.run.smithi059.stdout:4462 write 0x363430b thru 0x3637d72 (0x3a68 bytes) 2024-09-12T05:21:41.861 INFO:teuthology.orchestra.run.smithi059.stdout:4463 read 0xdff5d0 thru 0xe09b76 (0xa5a7 bytes) 2024-09-12T05:21:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:4464 read 0x73cafba thru 0x73d095f (0x59a6 bytes) 2024-09-12T05:21:41.862 INFO:teuthology.orchestra.run.smithi059.stdout:4468 writesame 0x8e2d7da thru 0x8e3717d data_size 0x2(0x99a4 bytes) 2024-09-12T05:21:41.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:41.879 INFO:teuthology.orchestra.run.smithi059.stdout:4469 trunc from 0xa14fbe0 to 0x914a6da 2024-09-12T05:21:41.903 INFO:teuthology.orchestra.run.smithi059.stdout:4470 write 0x62e2a6a thru 0x62e3c29 (0x11c0 bytes) 2024-09-12T05:21:41.904 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:41.899+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:4471 read 0x739c4a9 thru 0x73a440e (0x7f66 bytes) 2024-09-12T05:21:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:4472 writesame 0xed69236 thru 0xed6d187 data_size 0x5(0x3f52 bytes) 2024-09-12T05:21:41.934 INFO:teuthology.orchestra.run.smithi059.stdout:4473 writesame 0x1bbc4d6 thru 0x1bc3770 data_size 0x1(0x729b bytes) 2024-09-12T05:21:41.958 INFO:teuthology.orchestra.run.smithi059.stdout:4474 punch from 0x1a6f36d to 0x1a7dd0f, (0xe9a2 bytes) 2024-09-12T05:21:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:4475 writesame 0x8305629 thru 0x83064ce data_size 0x19(0xea6 bytes) 2024-09-12T05:21:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:41.965 INFO:teuthology.orchestra.run.smithi059.stdout:4480 write 0x38fe7fa thru 0x390d256 (0xea5d bytes) 2024-09-12T05:21:42.004 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:41.999+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:42.010 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:42.010 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:42.010 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:42.010 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:42.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:42.113 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:42.111+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 81.214796062000005, 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:42.199 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 76.303163745000006, 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:21:42.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:21:42.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 75.920463260999995, 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.204 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:21:42.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:21:42.208 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 75.686419614000002, 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.212 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 75.656295283000006, 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:42.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 75.094207502000003, 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.217 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:21:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:21:42.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 75.092253283999995, 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.222 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:21:42.226 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 66.150944550000006, 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.230 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 66.134347957000003, 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:42.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 64.964008516999996, 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.239 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 57.085554264999999, 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:21:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 57.085509170999998, 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:21:42.248 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 57.076947609999998, 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.252 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.274909450999999, 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.760786013000001, 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.257 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:21:42.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:21:42.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:21:42.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:42.262 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.752699921000001, 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.850513673999998, 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.267 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:21:42.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.272 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.873113752999998, 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:21:42.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.120966772999999, 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:21:42.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:21:42.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.761717042000001, 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:21:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.286 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.287 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:42.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:42.288 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:42.283+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:42.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:42.387+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:42.458 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:42.458 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:42.459 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:42.459 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:42.473 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:42.517 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:42.515+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:42.591 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:42.587+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:42.601 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:42.601 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:42.601 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:42.601 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:42.601 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:42.616 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:42.691 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:42.691+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80148 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6594560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.078441140999999, 2024-09-12T05:21:42.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047081795000000003, 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80148 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712493+0000", 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8299999999999997e-07 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712495+0000", 2024-09-12T05:21:42.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3099999999999999e-06 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712504+0000", 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5290000000000008e-06 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712509+0000", 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4480000000000002e-06 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759399+0000", 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046889693000000003 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759478+0000", 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9040000000000002e-05 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759574+0000", 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6292000000000006e-05 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.796 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80149 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7028736~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.078395467, 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047236827000000002, 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.797 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80149 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712539+0000", 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712542+0000", 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9639999999999999e-06 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712550+0000", 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7709999999999995e-06 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712556+0000", 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6380000000000001e-06 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759608+0000", 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047051754000000001 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759684+0000", 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6784000000000002e-05 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759775+0000", 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000001e-05 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80150 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6701056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.078368229999999, 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047422082999999997, 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.801 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80150 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713023+0000", 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00045808399999999999 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713028+0000", 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7849999999999999e-06 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713039+0000", 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0530000000000001e-05 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713046+0000", 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2710000000000003e-06 2024-09-12T05:21:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759807+0000", 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046761182999999998 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759887+0000", 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9709999999999994e-05 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759987+0000", 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010052000000000001 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80151 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7036928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.077873858, 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047137710999999999, 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.806 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80151 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713063+0000", 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7460000000000001e-06 2024-09-12T05:21:42.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713071+0000", 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6159999999999996e-06 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713077+0000", 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760020+0000", 2024-09-12T05:21:42.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046943358999999997 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760098+0000", 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7519000000000001e-05 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760197+0000", 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9778000000000006e-05 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80152 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6709248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.077847905999999, 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047326518999999997, 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80152 2024-09-12T05:21:42.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713245+0000", 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015924600000000001 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713249+0000", 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3379999999999998e-06 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713265+0000", 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6184e-05 2024-09-12T05:21:42.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713271+0000", 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6670000000000001e-06 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760231+0000", 2024-09-12T05:21:42.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046960285999999997 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760311+0000", 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9643999999999998e-05 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760412+0000", 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101154 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80153 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6799360~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.077652740000001, 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047341640999999997, 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80153 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713474+0000", 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192898 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713477+0000", 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3890000000000001e-06 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713487+0000", 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713494+0000", 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4540000000000001e-06 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760444+0000", 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046949957 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760526+0000", 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1361999999999998e-05 2024-09-12T05:21:42.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760622+0000", 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6587000000000002e-05 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80154 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8413184~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.077426742, 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047319877000000003, 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80154 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713977+0000", 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00047076399999999998 2024-09-12T05:21:42.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713985+0000", 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8790000000000003e-06 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713996+0000", 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.113e-05 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714003+0000", 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8979999999999999e-06 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760655+0000", 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046651821000000003 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760734+0000", 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9208999999999993e-05 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760827+0000", 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2176000000000007e-05 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80156 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8503296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.076892225000002, 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047199342999999998, 2024-09-12T05:21:42.825 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80156 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719243+0000", 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052018419999999999 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719248+0000", 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1760000000000001e-06 2024-09-12T05:21:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719261+0000", 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3045e-05 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719269+0000", 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1130000000000001e-06 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761068+0000", 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041798096999999999 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761148+0000", 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0301000000000002e-05 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761241+0000", 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769000000000006e-05 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80227 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4956160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.070874851999999, 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047195107, 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80227 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4900000000000001e-07 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720061+0000", 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0980000000000001e-06 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720068+0000", 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.007e-06 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720074+0000", 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767070+0000", 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046996653999999999 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767150+0000", 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9919000000000005e-05 2024-09-12T05:21:42.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767254+0000", 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103639 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80228 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 5718016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:42.834 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.070853002, 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047313252, 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80228 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720081+0000", 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8599999999999999e-07 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720083+0000", 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720089+0000", 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720094+0000", 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7929999999999997e-06 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767286+0000", 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047191666 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767338+0000", 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2441000000000002e-05 2024-09-12T05:21:42.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767394+0000", 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5526000000000003e-05 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80229 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4628480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.070832995, 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047505240999999997, 2024-09-12T05:21:42.839 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80229 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727276+0000", 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071757619999999996 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727282+0000", 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7019999999999998e-06 2024-09-12T05:21:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727293+0000", 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0778000000000001e-05 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727300+0000", 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5769999999999996e-06 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767428+0000", 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040128193 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767510+0000", 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1203000000000002e-05 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767606+0000", 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6026000000000005e-05 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.843 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80275 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7069696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.062815773000001, 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047223138999999997, 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80275 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.845 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9399999999999995e-07 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728120+0000", 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2879999999999999e-06 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728127+0000", 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8669999999999996e-06 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728133+0000", 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775161+0000", 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047027843 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775243+0000", 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2126999999999995e-05 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775341+0000", 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8189000000000005e-05 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80276 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6742016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.06279352, 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047322971999999998, 2024-09-12T05:21:42.849 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80276 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:42.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:42.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728506+0000", 2024-09-12T05:21:42.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036576600000000001 2024-09-12T05:21:42.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728510+0000", 2024-09-12T05:21:42.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5689999999999998e-06 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728519+0000", 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7190000000000007e-06 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728525+0000", 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775371+0000", 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046846023000000001 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775410+0000", 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8584000000000002e-05 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775463+0000", 2024-09-12T05:21:42.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2964999999999999e-05 2024-09-12T05:21:42.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.855 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.855 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80277 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6758400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.062392516999999, 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047131702999999997, 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.856 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80277 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728770+0000", 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228586 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728774+0000", 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:21:42.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728784+0000", 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5249999999999994e-06 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728790+0000", 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6139999999999997e-06 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775498+0000", 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046708040999999999 2024-09-12T05:21:42.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775577+0000", 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8553999999999994e-05 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775673+0000", 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5644999999999997e-05 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80279 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6856704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.062104764000001, 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047172124000000003, 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80279 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.861 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729026+0000", 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019762800000000001 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729030+0000", 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2024-09-12T05:21:42.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729039+0000", 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1209999999999996e-06 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729046+0000", 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3450000000000002e-06 2024-09-12T05:21:42.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775825+0000", 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046779646000000001 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775906+0000", 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0337e-05 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776001+0000", 2024-09-12T05:21:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5047e-05 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80281 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6635520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.061840960000001, 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047239476000000002, 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80281 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729204+0000", 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111247 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729209+0000", 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2979999999999999e-06 2024-09-12T05:21:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729220+0000", 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1032e-05 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729228+0000", 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.571e-06 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776155+0000", 2024-09-12T05:21:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046927340999999997 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776236+0000", 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0551999999999997e-05 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776332+0000", 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6434999999999994e-05 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80282 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6971392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.061691972999999, 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047211569000000002, 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80282 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729654+0000", 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000412118 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729662+0000", 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8200000000000003e-06 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729675+0000", 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2996000000000001e-05 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729684+0000", 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1629999999999996e-06 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776362+0000", 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046678450000000003 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776403+0000", 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0627999999999998e-05 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776453+0000", 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0393999999999999e-05 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80285 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 3104768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.061110264, 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047179632999999999, 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80285 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730008+0000", 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018459999999999999 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730012+0000", 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6090000000000003e-06 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730024+0000", 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1853e-05 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730033+0000", 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776826+0000", 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046792907000000002 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776908+0000", 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1981e-05 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777003+0000", 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4712999999999999e-05 2024-09-12T05:21:42.879 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80287 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2777088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.060693358000002, 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047092717999999999, 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.880 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80287 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730400+0000", 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000159684 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730404+0000", 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2780000000000004e-06 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730412+0000", 2024-09-12T05:21:42.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4669999999999998e-06 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730416+0000", 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6609999999999999e-06 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777158+0000", 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046741956000000001 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777236+0000", 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7960999999999994e-05 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777333+0000", 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6711000000000003e-05 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.884 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:102631 3.7 3:e1f14bfd:::rbd_data.11181f89f1e6.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.6995014279999996, 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048849113999999999, 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 102631 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:42.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091434+0000", 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.429e-06 2024-09-12T05:21:42.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091445+0000", 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0932e-05 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091471+0000", 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-05 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091486+0000", 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5506999999999999e-05 2024-09-12T05:21:42.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091583+0000", 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6407e-05 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091661+0000", 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8046999999999993e-05 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 7", 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.098845+0000", 2024-09-12T05:21:42.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071841509999999997 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140140+0000", 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041295239999999997 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140190+0000", 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9629999999999997e-05 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140240+0000", 2024-09-12T05:21:42.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0353999999999999e-05 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140281+0000", 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1007000000000002e-05 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:42.890 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:42.891 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:42.787+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:42.892 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:42.893 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:42.891+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:42.920 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:21:42.942 INFO:teuthology.orchestra.run.smithi059.stdout:4482 trunc from 0xed6d188 to 0x60953fd 2024-09-12T05:21:42.964 INFO:teuthology.orchestra.run.smithi059.stdout:4483 write 0x100ba7c thru 0x101565e (0x9be3 bytes) 2024-09-12T05:21:42.970 INFO:teuthology.orchestra.run.smithi059.stdout:4484 read 0x2c8be3c thru 0x2c9837c (0xc541 bytes) 2024-09-12T05:21:42.971 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:42.978 INFO:teuthology.orchestra.run.smithi059.stdout:4487 trunc from 0x60953fd to 0x1a51a32 2024-09-12T05:21:42.994 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:42.991+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:43.037 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:43.037 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:43.037 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:43.037 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:43.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:43.056 INFO:teuthology.orchestra.run.smithi059.stdout:4488 write 0xc749adb thru 0xc74cf38 (0x345e bytes) 2024-09-12T05:21:43.063 INFO:teuthology.orchestra.run.smithi059.stdout:4490 punch from 0x94e803c to 0x94f7833, (0xf7f7 bytes) 2024-09-12T05:21:43.063 INFO:teuthology.orchestra.run.smithi059.stdout:4491 punch from 0x2e7b4b5 to 0x2e84b97, (0x96e2 bytes) 2024-09-12T05:21:43.063 INFO:teuthology.orchestra.run.smithi059.stdout:4492 writesame 0x6777c0a thru 0x6783be8 data_size 0x7(0xbfdf bytes) 2024-09-12T05:21:43.073 INFO:teuthology.orchestra.run.smithi059.stdout:4493 read 0xc10f5d thru 0xc19697 (0x873b bytes) 2024-09-12T05:21:43.074 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:43.095 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:43.091+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:43.100 INFO:teuthology.orchestra.run.smithi059.stdout:4495 trunc from 0xc74cf39 to 0x1d2eea8 2024-09-12T05:21:43.121 INFO:teuthology.orchestra.run.smithi059.stdout:4497 read 0x1294658 thru 0x129b331 (0x6cda bytes) 2024-09-12T05:21:43.122 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:43.122 INFO:teuthology.orchestra.run.smithi059.stdout:4501 read 0x18d94a1 thru 0x18dac36 (0x1796 bytes) 2024-09-12T05:21:43.159 INFO:teuthology.orchestra.run.smithi059.stdout:4502 write 0xae36ca9 thru 0xae3a488 (0x37e0 bytes) 2024-09-12T05:21:43.166 INFO:teuthology.orchestra.run.smithi059.stdout:4503 read 0x7717369 thru 0x7726507 (0xf19f bytes) 2024-09-12T05:21:43.166 INFO:teuthology.orchestra.run.smithi059.stdout:4505 read 0x7c944c7 thru 0x7c9a225 (0x5d5f bytes) 2024-09-12T05:21:43.166 INFO:teuthology.orchestra.run.smithi059.stdout:4506 punch from 0x2546d7a to 0x254b0a1, (0x4327 bytes) 2024-09-12T05:21:43.177 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:43.178 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:43.178 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:43.178 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:43.178 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:43.188 INFO:teuthology.orchestra.run.smithi059.stdout:4507 write 0xe60804b thru 0xe608f37 (0xeed bytes) 2024-09-12T05:21:43.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:43.195 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:43.191+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:43.205 INFO:teuthology.orchestra.run.smithi059.stdout:4508 trunc from 0xe608f38 to 0xac2c08f 2024-09-12T05:21:43.238 INFO:teuthology.orchestra.run.smithi059.stdout:4509 trunc from 0xac2c08f to 0x695622e 2024-09-12T05:21:43.265 INFO:teuthology.orchestra.run.smithi059.stdout:4513 writesame 0x83a8ed3 thru 0x83ad39f data_size 0x39(0x44cd bytes) 2024-09-12T05:21:43.265 INFO:teuthology.orchestra.run.smithi059.stdout:4514 punch from 0x56c09fc to 0x56c8021, (0x7625 bytes) 2024-09-12T05:21:43.275 INFO:teuthology.orchestra.run.smithi059.stdout:4515 write 0x8594f79 thru 0x859a652 (0x56da bytes) 2024-09-12T05:21:43.282 INFO:teuthology.orchestra.run.smithi059.stdout:4516 read 0x2529341 thru 0x2536250 (0xcf10 bytes) 2024-09-12T05:21:43.282 INFO:teuthology.orchestra.run.smithi059.stdout:4517 punch from 0x4afe3a7 to 0x4b043c7, (0x6020 bytes) 2024-09-12T05:21:43.296 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:43.291+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:43.301 INFO:teuthology.orchestra.run.smithi059.stdout:4521 write 0xa967da7 thru 0xa96fcd0 (0x7f2a bytes) 2024-09-12T05:21:43.307 INFO:teuthology.orchestra.run.smithi059.stdout:4522 punch from 0x9bb45d1 to 0x9bbd272, (0x8ca1 bytes) 2024-09-12T05:21:43.307 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:43.307 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:43.308 INFO:teuthology.orchestra.run.smithi059.stdout:4526 flatten 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8226264380000003, 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.326 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.327 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.327 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.327 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.327 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.327 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:21:43.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.327 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:21:43.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:21:43.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:21:43.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:21:43.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.822594789, 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:21:43.333 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:21:43.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8225586460000001, 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.338 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:21:43.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:21:43.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:21:43.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.343 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8225278359999999, 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:21:43.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:21:43.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:21:43.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:21:43.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:21:43.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8224972770000001, 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8224673810000001, 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.354 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:21:43.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8207104379999999, 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:21:43.358 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:21:43.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8206668690000001, 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.363 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:21:43.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:21:43.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8204349789999998, 2024-09-12T05:21:43.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:43.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:21:43.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8203140680000001, 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.373 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.373 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:21:43.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.373 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:43.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.376 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8201970300000001, 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.378 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:21:43.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.378 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:43.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:43.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:21:43.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.382 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8200774219999998, 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:21:43.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101774 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4833280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8171314680000004, 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090801491999999998, 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101774 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507679+0000", 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2399999999999996e-07 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507682+0000", 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507691+0000", 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3230000000000004e-06 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507698+0000", 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1400000000000002e-06 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598168+0000", 2024-09-12T05:21:43.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090470153999999997 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598305+0000", 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136935 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598479+0000", 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0001738 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8170986950000003, 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:21:43.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8170643890000004, 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.396 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:21:43.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.400 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8170322130000001, 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.401 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:21:43.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:21:43.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8169705970000001, 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:21:43.405 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8169152410000002, 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:21:43.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:21:43.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8168604349999997, 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:21:43.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8167007609999999, 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:43.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:43.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:43.423 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:43.424 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:43.425 INFO:teuthology.orchestra.run.smithi059.stdout:4529 punch from 0x3ba020b to 0x3bacc5f, (0xca54 bytes) 2024-09-12T05:21:43.425 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:43.425 INFO:teuthology.orchestra.run.smithi059.stdout:4531 trunc from 0xa96fcd1 to 0x44936f6 2024-09-12T05:21:43.425 INFO:teuthology.orchestra.run.smithi059.stdout:4533 write 0x4a3e9ee thru 0x4a3f43c (0xa4f bytes) 2024-09-12T05:21:43.425 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:43.426 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:43.419+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:43.438 INFO:teuthology.orchestra.run.smithi059.stdout:4534 writesame 0x64bb830 thru 0x64bc0ae data_size 0x19(0x87f bytes) 2024-09-12T05:21:43.438 INFO:teuthology.orchestra.run.smithi059.stdout:4536 writesame 0x4fd9a33 thru 0x4fe5a9b data_size 0xd(0xc069 bytes) 2024-09-12T05:21:43.451 INFO:teuthology.orchestra.run.smithi059.stdout:4538 write 0x316f762 thru 0x3171d37 (0x25d6 bytes) 2024-09-12T05:21:43.461 INFO:teuthology.orchestra.run.smithi059.stdout:4539 read 0x109d1bb thru 0x10acccb (0xfb11 bytes) 2024-09-12T05:21:43.462 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:43.462 INFO:teuthology.orchestra.run.smithi059.stdout:4543 read 0x61e2e9 thru 0x62c3c2 (0xe0da bytes) 2024-09-12T05:21:43.462 INFO:teuthology.orchestra.run.smithi059.stdout:4544 writesame 0x1c7e0ac thru 0x1c86aea data_size 0x3(0x8a3f bytes) 2024-09-12T05:21:43.480 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:43.481 INFO:teuthology.orchestra.run.smithi059.stdout:4547 write 0x2ba2930 thru 0x2ba9b14 (0x71e5 bytes) 2024-09-12T05:21:43.497 INFO:teuthology.orchestra.run.smithi059.stdout:4549 trunc from 0x64bc0af to 0x3279df2 2024-09-12T05:21:43.525 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:43.523+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:43.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:43.557 INFO:teuthology.orchestra.run.smithi059.stdout:4550 write 0xb1f8bfc thru 0xb1faece (0x22d3 bytes) 2024-09-12T05:21:43.577 INFO:teuthology.orchestra.run.smithi059.stdout:4552 writesame 0xd31f2f7 thru 0xd326c3f data_size 0x1(0x7949 bytes) 2024-09-12T05:21:43.577 INFO:teuthology.orchestra.run.smithi059.stdout:4553 write 0x37e572 thru 0x38839d (0x9e2c bytes) 2024-09-12T05:21:43.585 INFO:teuthology.orchestra.run.smithi059.stdout:4554 read 0xbbe9dcc thru 0xbbf284b (0x8a80 bytes) 2024-09-12T05:21:43.585 INFO:teuthology.orchestra.run.smithi059.stdout:4558 writesame 0x377b24b thru 0x3781075 data_size 0x1(0x5e2b bytes) 2024-09-12T05:21:43.601 INFO:teuthology.orchestra.run.smithi059.stdout:4559 read 0x1be4311 thru 0x1be66d2 (0x23c2 bytes) 2024-09-12T05:21:43.601 INFO:teuthology.orchestra.run.smithi059.stdout:4561 writesame 0x44ecca2 thru 0x44f9422 data_size 0x1(0xc781 bytes) 2024-09-12T05:21:43.614 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:43.614 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:43.626 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:43.623+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:43.628 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:43.648 INFO:teuthology.orchestra.run.smithi059.stdout:4562 write 0xd771d8 thru 0xd82eae (0xbcd7 bytes) 2024-09-12T05:21:43.655 INFO:teuthology.orchestra.run.smithi059.stdout:4563 write 0x195093e thru 0x195602b (0x56ee bytes) 2024-09-12T05:21:43.660 INFO:teuthology.orchestra.run.smithi059.stdout:4565 clone 36 order 22 su 524288 sc 12 2024-09-12T05:21:43.706 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:43.706 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:43.723 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:43.723 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:43.727 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:43.723+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:43.741 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:43.758 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:43.778 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:43.792 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:43.793 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:43.799 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:43.800 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:43.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:43.825 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:43.830 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:43.831 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:43.849 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:43.847+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:43.920 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6, 2] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:21:43.920 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:43.921 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T05:21:43.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:21:43.929 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:43.927+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:43.978 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:43.978 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:43.993 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:44.030 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:44.027+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:44.131 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:44.127+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:44.155 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:44.156 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:44.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:44.210 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-12T05:21:44.232 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:44.227+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 92, 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:21:43.920603+0000", 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:21:02.127583+0000", 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:21:38.885631+0000", 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5799936, 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:21:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 5, 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "luminous", 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:21:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:21:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:21:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:21:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 2, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 2, 2024-09-12T05:21:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.75, 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.5, 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.5, 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:21:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:21:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "92", 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 38, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 92, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.9900000095367432, 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.9900000095367432, 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:21:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 0.80352783203125, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:21:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 90, 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:21:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:21:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:21:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:21:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:21:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 88, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:21:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 74, 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:21:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 0, 2024-09-12T05:21:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 60, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:21:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/2467380900", 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/2467380900", 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/2467380900", 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/2467380900", 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "exists" 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 87, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:21:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 84, 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.317 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.318 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:21:44.319 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.320 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 87, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.322 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.323 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:21:44.325 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:21:44.326 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.327 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:44.328 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 60 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:44.331 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [ 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.1", 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 6 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.332 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.4", 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 0, 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 4 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.15", 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:21:44.333 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [ 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.4", 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: 0 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.9", 2024-09-12T05:21:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: 2, 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: 7 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:21:44.335 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:21:44.336 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:21:44.337 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:44.337 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:44.339 INFO:tasks.thrashosds.thrasher:j is {'epoch': 92, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:21:43.920603+0000', 'last_up_change': '2024-09-12T05:21:02.127583+0000', 'last_in_change': '2024-09-12T05:21:38.885631+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 38, 'snap_epoch': 92, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.80352783203125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 88, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 60, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 2467380900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 2467380900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 2467380900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 2467380900}]}, 'public_addr': '172.21.15.194:6825/2467380900', 'cluster_addr': '172.21.15.194:6827/2467380900', 'heartbeat_back_addr': '172.21.15.194:6831/2467380900', 'heartbeat_front_addr': '172.21.15.194:6829/2467380900', 'state': ['exists']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 60}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.1', 'mappings': [{'from': 3, 'to': 6}]}, {'pgid': '2.4', 'mappings': [{'from': 0, 'to': 4}]}, {'pgid': '3.15', 'mappings': [{'from': 3, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '2.4', 'osds': [1, 0]}, {'pgid': '3.9', 'osds': [2, 7]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:21:44.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:21:44.339 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:44.335+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:44.341 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:44.341 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:44.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:44.439 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:44.435+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:44.478 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:44.478 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:44.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:44.540 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:44.535+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:44.543 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.544 INFO:teuthology.orchestra.run.smithi059.stdout:4567 trunc from 0xd326c40 to 0xce9d58f 2024-09-12T05:21:44.573 INFO:teuthology.orchestra.run.smithi059.stdout:4568 read 0x359567 thru 0x366f5f (0xd9f9 bytes) 2024-09-12T05:21:44.574 INFO:teuthology.orchestra.run.smithi059.stdout:4569 write 0x13aa435 thru 0x13b0c71 (0x683d bytes) 2024-09-12T05:21:44.583 INFO:teuthology.orchestra.run.smithi059.stdout:4571 write 0x6ee749f thru 0x6eeafec (0x3b4e bytes) 2024-09-12T05:21:44.596 INFO:teuthology.orchestra.run.smithi059.stdout:4572 trunc from 0xce9d58f to 0x73cb18e 2024-09-12T05:21:44.641 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:44.639+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:44.643 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:44.643 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:44.650 INFO:teuthology.orchestra.run.smithi059.stdout:4573 write 0xe73875e thru 0xe741ca5 (0x9548 bytes) 2024-09-12T05:21:44.655 INFO:teuthology.orchestra.run.smithi059.stdout:4574 writesame 0x86683a3 thru 0x8671ba6 data_size 0x8d(0x9804 bytes) 2024-09-12T05:21:44.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:4575 trunc from 0xe741ca6 to 0x99c5e26 2024-09-12T05:21:44.685 INFO:teuthology.orchestra.run.smithi059.stdout:4576 punch from 0x96f48c9 to 0x96fdd80, (0x94b7 bytes) 2024-09-12T05:21:44.685 INFO:teuthology.orchestra.run.smithi059.stdout:4577 punch from 0x77c5a9a to 0x77d0925, (0xae8b bytes) 2024-09-12T05:21:44.685 INFO:teuthology.orchestra.run.smithi059.stdout:4578 write 0x4e6b5ed thru 0x4e6cf48 (0x195c bytes) 2024-09-12T05:21:44.690 INFO:teuthology.orchestra.run.smithi059.stdout:4579 punch from 0x1c458a2 to 0x1c49fc7, (0x4725 bytes) 2024-09-12T05:21:44.690 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.690 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.690 INFO:teuthology.orchestra.run.smithi059.stdout:4583 writesame 0x5a29cde thru 0x5a30506 data_size 0x1(0x6829 bytes) 2024-09-12T05:21:44.707 INFO:teuthology.orchestra.run.smithi059.stdout:4584 read 0x387ccdc thru 0x38864d5 (0x97fa bytes) 2024-09-12T05:21:44.708 INFO:teuthology.orchestra.run.smithi059.stdout:4586 read 0x6c3651a thru 0x6c3bda7 (0x588e bytes) 2024-09-12T05:21:44.708 INFO:teuthology.orchestra.run.smithi059.stdout:4587 read 0x82ebc2b thru 0x82f529d (0x9673 bytes) 2024-09-12T05:21:44.709 INFO:teuthology.orchestra.run.smithi059.stdout:4589 punch from 0x66bbfaa to 0x66c24aa, (0x6500 bytes) 2024-09-12T05:21:44.709 INFO:teuthology.orchestra.run.smithi059.stdout:4590 read 0x200de04 thru 0x2013dc3 (0x5fc0 bytes) 2024-09-12T05:21:44.709 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.709 INFO:teuthology.orchestra.run.smithi059.stdout:4592 read 0x6220b85 thru 0x6225010 (0x448c bytes) 2024-09-12T05:21:44.711 INFO:teuthology.orchestra.run.smithi059.stdout:4593 punch from 0x55dbe3a to 0x55eb52d, (0xf6f3 bytes) 2024-09-12T05:21:44.711 INFO:teuthology.orchestra.run.smithi059.stdout:4594 read 0x70917f thru 0x70d582 (0x4404 bytes) 2024-09-12T05:21:44.711 INFO:teuthology.orchestra.run.smithi059.stdout:4595 write 0x503151b thru 0x5035e0c (0x48f2 bytes) 2024-09-12T05:21:44.717 INFO:teuthology.orchestra.run.smithi059.stdout:4596 punch from 0x957a1e5 to 0x9581eb4, (0x7ccf bytes) 2024-09-12T05:21:44.718 INFO:teuthology.orchestra.run.smithi059.stdout:4597 trunc from 0x99c5e26 to 0x9b73b4e 2024-09-12T05:21:44.725 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.725 INFO:teuthology.orchestra.run.smithi059.stdout:4600 writesame 0x1546b2f thru 0x154b1dd data_size 0x37(0x46af bytes) 2024-09-12T05:21:44.731 INFO:teuthology.orchestra.run.smithi059.stdout:4601 read 0x2e19d4d thru 0x2e228f7 (0x8bab bytes) 2024-09-12T05:21:44.732 INFO:teuthology.orchestra.run.smithi059.stdout:4602 read 0x884dbe7 thru 0x884f215 (0x162f bytes) 2024-09-12T05:21:44.732 INFO:teuthology.orchestra.run.smithi059.stdout:4603 read 0xa33bf7 thru 0xa3fc0d (0xc017 bytes) 2024-09-12T05:21:44.734 INFO:teuthology.orchestra.run.smithi059.stdout:4604 trunc from 0x9b73b4e to 0x8b92154 2024-09-12T05:21:44.741 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:44.739+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:44.748 INFO:teuthology.orchestra.run.smithi059.stdout:4606 write 0x30b342d thru 0x30bc137 (0x8d0b bytes) 2024-09-12T05:21:44.750 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:21:44.750 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:21:44.755 INFO:teuthology.orchestra.run.smithi059.stdout:4607 read 0x45a8f51 thru 0x45aa6cc (0x177c bytes) 2024-09-12T05:21:44.764 INFO:teuthology.orchestra.run.smithi059.stdout:4608 trunc from 0x8b92154 to 0xd49f497 2024-09-12T05:21:44.771 INFO:teuthology.orchestra.run.smithi059.stdout:4610 read 0x11d49f8 thru 0x11dc66d (0x7c76 bytes) 2024-09-12T05:21:44.771 INFO:teuthology.orchestra.run.smithi059.stdout:4611 write 0x178d530 thru 0x178d6af (0x180 bytes) 2024-09-12T05:21:44.780 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-12T05:21:43.929589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1302914376,"num_objects":2179,"num_object_clones":362,"num_object_copies":4358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":837,"num_objects_misplaced":77,"num_objects_unfound":0,"num_objects_dirty":2179,"num_whiteouts":1206,"num_read":130939,"num_read_kb":764863,"num_write":18064,"num_write_kb":415908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":629,"num_bytes_recovered":38057650,"num_keys_recovered":50,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15008,"ondisk_log_size":15008,"up":68,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":847808,"kb_used_data":553876,"kb_used_omap":12,"kb_used_meta":293747,"kb_avail":754126912,"statfs":{"total":773094113280,"available":772225957888,"internally_reserved":0,"allocated":567169024,"data_stored":723253522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":300797488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,19,31,66,66],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":74791103,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":4853,"num_read_kb":38965,"num_write":473,"num_write_kb":3258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":21237640,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.188773"},"pg_stats":[{"pgid":"3.1f","version":"89'324","reported_seq":8150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.939223+0000","last_change":"2024-09-12T05:20:11.762958+0000","last_active":"2024-09-12T05:21:41.939223+0000","last_peered":"2024-09-12T05:21:41.939223+0000","last_clean":"2024-09-12T05:21:41.939223+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:21:41.939223+0000","last_undegraded":"2024-09-12T05:21:41.939223+0000","last_fullsized":"2024-09-12T05:21:41.939223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:00.346564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036800549999999998,"stat_sum":{"num_bytes":23452136,"num_objects":79,"num_object_clones":16,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":42,"num_read":8402,"num_read_kb":32489,"num_write":319,"num_write_kb":7700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"89'285","reported_seq":6998,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.916002+0000","last_change":"2024-09-12T05:20:34.070752+0000","last_active":"2024-09-12T05:21:41.916002+0000","last_peered":"2024-09-12T05:21:41.916002+0000","last_clean":"2024-09-12T05:21:41.916002+0000","last_became_active":"2024-09-12T05:20:33.940420+0000","last_became_peered":"2024-09-12T05:20:33.940420+0000","last_unstale":"2024-09-12T05:21:41.916002+0000","last_undegraded":"2024-09-12T05:21:41.916002+0000","last_fullsized":"2024-09-12T05:21:41.916002+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:40.695389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015371499999999999,"stat_sum":{"num_bytes":72461876,"num_objects":63,"num_object_clones":12,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":36,"num_read":6602,"num_read_kb":73322,"num_write":305,"num_write_kb":11012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"89'440","reported_seq":2813,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.918916+0000","last_change":"2024-09-12T05:21:03.152999+0000","last_active":"2024-09-12T05:21:41.918916+0000","last_peered":"2024-09-12T05:21:41.918916+0000","last_clean":"2024-09-12T05:21:01.134623+0000","last_became_active":"2024-09-12T05:21:03.152999+0000","last_became_peered":"2024-09-12T05:21:03.152999+0000","last_unstale":"2024-09-12T05:21:41.918916+0000","last_undegraded":"2024-09-12T05:21:03.151855+0000","last_fullsized":"2024-09-12T05:21:03.151583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:16.179184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098006399999999989,"stat_sum":{"num_bytes":23477593,"num_objects":67,"num_object_clones":11,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":67,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":35,"num_read":3334,"num_read_kb":6326,"num_write":468,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":67}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"90'411","reported_seq":3792,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.918996+0000","last_change":"2024-09-12T05:21:03.156068+0000","last_active":"2024-09-12T05:21:41.918996+0000","last_peered":"2024-09-12T05:21:41.918996+0000","last_clean":"2024-09-12T05:21:01.134412+0000","last_became_active":"2024-09-12T05:21:03.156068+0000","last_became_peered":"2024-09-12T05:21:03.156068+0000","last_unstale":"2024-09-12T05:21:41.918996+0000","last_undegraded":"2024-09-12T05:21:03.151787+0000","last_fullsized":"2024-09-12T05:21:03.151493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:42.503908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087905899999999996,"stat_sum":{"num_bytes":31682750,"num_objects":70,"num_object_clones":13,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":70,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":41,"num_read":4147,"num_read_kb":30080,"num_write":435,"num_write_kb":6239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":70}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"89'314","reported_seq":2172,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.939448+0000","last_change":"2024-09-12T05:21:03.160720+0000","last_active":"2024-09-12T05:21:41.939448+0000","last_peered":"2024-09-12T05:21:41.939448+0000","last_clean":"2024-09-12T05:21:01.133569+0000","last_became_active":"2024-09-12T05:21:03.160720+0000","last_became_peered":"2024-09-12T05:21:03.160720+0000","last_unstale":"2024-09-12T05:21:41.939448+0000","last_undegraded":"2024-09-12T05:21:03.156540+0000","last_fullsized":"2024-09-12T05:21:03.156423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:41.488123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040909680000000004,"stat_sum":{"num_bytes":38978281,"num_objects":76,"num_object_clones":12,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":76,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":44,"num_read":2216,"num_read_kb":31671,"num_write":287,"num_write_kb":25863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":76}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"89'328","reported_seq":4323,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.917587+0000","last_change":"2024-09-12T05:21:03.156899+0000","last_active":"2024-09-12T05:21:41.917587+0000","last_peered":"2024-09-12T05:21:41.917587+0000","last_clean":"2024-09-12T05:20:53.806542+0000","last_became_active":"2024-09-12T05:21:03.156899+0000","last_became_peered":"2024-09-12T05:21:03.156899+0000","last_unstale":"2024-09-12T05:21:41.917587+0000","last_undegraded":"2024-09-12T05:21:03.155951+0000","last_fullsized":"2024-09-12T05:21:03.155860+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:05:16.784137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014130220000000001,"stat_sum":{"num_bytes":32913379,"num_objects":61,"num_object_clones":10,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":61,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":39,"num_read":4967,"num_read_kb":29883,"num_write":298,"num_write_kb":17998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":61}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"89'354","reported_seq":3293,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.917481+0000","last_change":"2024-09-12T05:20:11.741831+0000","last_active":"2024-09-12T05:21:41.917481+0000","last_peered":"2024-09-12T05:21:41.917481+0000","last_clean":"2024-09-12T05:21:41.917481+0000","last_became_active":"2024-09-12T05:20:09.736422+0000","last_became_peered":"2024-09-12T05:20:09.736422+0000","last_unstale":"2024-09-12T05:21:41.917481+0000","last_undegraded":"2024-09-12T05:21:41.917481+0000","last_fullsized":"2024-09-12T05:21:41.917481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:30.496442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001296167,"stat_sum":{"num_bytes":33621613,"num_objects":69,"num_object_clones":6,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":38,"num_read":3450,"num_read_kb":28755,"num_write":328,"num_write_kb":4764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"89'466","reported_seq":2617,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.915781+0000","last_change":"2024-09-12T05:20:11.786941+0000","last_active":"2024-09-12T05:21:41.915781+0000","last_peered":"2024-09-12T05:21:41.915781+0000","last_clean":"2024-09-12T05:21:41.915781+0000","last_became_active":"2024-09-12T05:20:09.740953+0000","last_became_peered":"2024-09-12T05:20:09.740953+0000","last_unstale":"2024-09-12T05:21:41.915781+0000","last_undegraded":"2024-09-12T05:21:41.915781+0000","last_fullsized":"2024-09-12T05:21:41.915781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:23.691916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085336099999999996,"stat_sum":{"num_bytes":29035647,"num_objects":68,"num_object_clones":13,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":37,"num_read":3985,"num_read_kb":18144,"num_write":450,"num_write_kb":10644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"85'451","reported_seq":1521,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.939412+0000","last_change":"2024-09-12T05:20:11.763561+0000","last_active":"2024-09-12T05:21:41.939412+0000","last_peered":"2024-09-12T05:21:41.939412+0000","last_clean":"2024-09-12T05:21:41.939412+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:21:41.939412+0000","last_undegraded":"2024-09-12T05:21:41.939412+0000","last_fullsized":"2024-09-12T05:21:41.939412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:16:40.159466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041487850000000003,"stat_sum":{"num_bytes":25543895,"num_objects":56,"num_object_clones":9,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":35,"num_read":2392,"num_read_kb":6634,"num_write":530,"num_write_kb":3923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"89'422","reported_seq":5639,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.919360+0000","last_change":"2024-09-12T05:20:11.737024+0000","last_active":"2024-09-12T05:21:41.919360+0000","last_peered":"2024-09-12T05:21:41.919360+0000","last_clean":"2024-09-12T05:21:41.919360+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:21:41.919360+0000","last_undegraded":"2024-09-12T05:21:41.919360+0000","last_fullsized":"2024-09-12T05:21:41.919360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:43.657748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015614439999999999,"stat_sum":{"num_bytes":85895588,"num_objects":75,"num_object_clones":13,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":41,"num_read":5958,"num_read_kb":68090,"num_write":430,"num_write_kb":12811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'269","reported_seq":1360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.928738+0000","last_change":"2024-09-12T05:20:49.043311+0000","last_active":"2024-09-12T05:21:41.928738+0000","last_peered":"2024-09-12T05:21:41.928738+0000","last_clean":"2024-09-12T05:21:41.928738+0000","last_became_active":"2024-09-12T05:20:49.041294+0000","last_became_peered":"2024-09-12T05:20:49.041294+0000","last_unstale":"2024-09-12T05:21:41.928738+0000","last_undegraded":"2024-09-12T05:21:41.928738+0000","last_fullsized":"2024-09-12T05:21:41.928738+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:43:27.395569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000920377,"stat_sum":{"num_bytes":33598868,"num_objects":62,"num_object_clones":13,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":30,"num_read":886,"num_read_kb":11509,"num_write":326,"num_write_kb":9957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"87'1087","reported_seq":4227,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.928459+0000","last_change":"2024-09-12T05:21:03.163718+0000","last_active":"2024-09-12T05:21:41.928459+0000","last_peered":"2024-09-12T05:21:41.928459+0000","last_clean":"2024-09-12T05:20:58.183844+0000","last_became_active":"2024-09-12T05:21:03.163718+0000","last_became_peered":"2024-09-12T05:21:03.163718+0000","last_unstale":"2024-09-12T05:21:41.928459+0000","last_undegraded":"2024-09-12T05:21:03.161795+0000","last_fullsized":"2024-09-12T05:21:03.161569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:48.760985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013351109999999999,"stat_sum":{"num_bytes":55778032,"num_objects":74,"num_object_clones":8,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":74,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":38,"num_read":7828,"num_read_kb":35134,"num_write":1676,"num_write_kb":24644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":74}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.922664+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:21:41.922664+0000","last_peered":"2024-09-12T05:21:41.922664+0000","last_clean":"2024-09-12T05:21:41.922664+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:21:41.922664+0000","last_undegraded":"2024-09-12T05:21:41.922664+0000","last_fullsized":"2024-09-12T05:21:41.922664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"89'609","reported_seq":1797,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.939311+0000","last_change":"2024-09-12T05:20:11.760826+0000","last_active":"2024-09-12T05:21:41.939311+0000","last_peered":"2024-09-12T05:21:41.939311+0000","last_clean":"2024-09-12T05:21:41.939311+0000","last_became_active":"2024-09-12T05:20:09.741300+0000","last_became_peered":"2024-09-12T05:20:09.741300+0000","last_unstale":"2024-09-12T05:21:41.939311+0000","last_undegraded":"2024-09-12T05:21:41.939311+0000","last_fullsized":"2024-09-12T05:21:41.939311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:08.277457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015825539999999999,"stat_sum":{"num_bytes":28637785,"num_objects":82,"num_object_clones":11,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":51,"num_read":2366,"num_read_kb":11380,"num_write":732,"num_write_kb":21481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":167,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.917631+0000","last_change":"2024-09-12T05:20:33.943660+0000","last_active":"2024-09-12T05:21:41.917631+0000","last_peered":"2024-09-12T05:21:41.917631+0000","last_clean":"2024-09-12T05:21:41.917631+0000","last_became_active":"2024-09-12T05:20:33.943030+0000","last_became_peered":"2024-09-12T05:20:33.943030+0000","last_unstale":"2024-09-12T05:21:41.917631+0000","last_undegraded":"2024-09-12T05:21:41.917631+0000","last_fullsized":"2024-09-12T05:21:41.917631+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:11.076201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"90'310","reported_seq":2679,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.915920+0000","last_change":"2024-09-12T05:20:11.787746+0000","last_active":"2024-09-12T05:21:41.915920+0000","last_peered":"2024-09-12T05:21:41.915920+0000","last_clean":"2024-09-12T05:21:41.915920+0000","last_became_active":"2024-09-12T05:20:09.747558+0000","last_became_peered":"2024-09-12T05:20:09.747558+0000","last_unstale":"2024-09-12T05:21:41.915920+0000","last_undegraded":"2024-09-12T05:21:41.915920+0000","last_fullsized":"2024-09-12T05:21:41.915920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:18.605493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001514325,"stat_sum":{"num_bytes":55858993,"num_objects":66,"num_object_clones":11,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":32,"num_read":2330,"num_read_kb":42348,"num_write":316,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.928945+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:21:41.928945+0000","last_peered":"2024-09-12T05:21:41.928945+0000","last_clean":"2024-09-12T05:21:41.928945+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:21:41.928945+0000","last_undegraded":"2024-09-12T05:21:41.928945+0000","last_fullsized":"2024-09-12T05:21:41.928945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"89'479","reported_seq":2383,"reported_epoch":89,"state":"peering","last_fresh":"2024-09-12T05:21:41.217363+0000","last_change":"2024-09-12T05:21:41.919166+0000","last_active":"2024-09-12T05:21:41.919166+0000","last_peered":"2024-09-12T05:21:41.217363+0000","last_clean":"2024-09-12T05:21:37.902214+0000","last_became_active":"2024-09-12T05:21:40.763727+0000","last_became_peered":"2024-09-12T05:21:40.763727+0000","last_unstale":"2024-09-12T05:21:41.217363+0000","last_undegraded":"2024-09-12T05:21:41.217363+0000","last_fullsized":"2024-09-12T05:21:40.749142+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109662,"stat_sum":{"num_bytes":35218861,"num_objects":64,"num_object_clones":10,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":36,"num_read":2827,"num_read_kb":16888,"num_write":571,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":11476389,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":90,"state":"active+clean+remapped","last_fresh":"2024-09-12T05:21:41.919514+0000","last_change":"2024-09-12T05:21:17.330061+0000","last_active":"2024-09-12T05:21:41.919514+0000","last_peered":"2024-09-12T05:21:41.919514+0000","last_clean":"2024-09-12T05:21:41.919514+0000","last_became_active":"2024-09-12T05:21:17.329019+0000","last_became_peered":"2024-09-12T05:21:17.329019+0000","last_unstale":"2024-09-12T05:21:41.919514+0000","last_undegraded":"2024-09-12T05:21:41.919514+0000","last_fullsized":"2024-09-12T05:21:41.919514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:21.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"90'298","reported_seq":1858,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.972455+0000","last_change":"2024-09-12T05:20:11.737386+0000","last_active":"2024-09-12T05:21:41.972455+0000","last_peered":"2024-09-12T05:21:41.972455+0000","last_clean":"2024-09-12T05:21:41.972455+0000","last_became_active":"2024-09-12T05:20:09.734285+0000","last_became_peered":"2024-09-12T05:20:09.734285+0000","last_unstale":"2024-09-12T05:21:41.972455+0000","last_undegraded":"2024-09-12T05:21:41.972455+0000","last_fullsized":"2024-09-12T05:21:41.972455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:20:05.701823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093432200000000002,"stat_sum":{"num_bytes":23975923,"num_objects":45,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":25,"num_read":1855,"num_read_kb":11131,"num_write":359,"num_write_kb":6662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'423","reported_seq":4067,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.967604+0000","last_change":"2024-09-12T05:21:03.157170+0000","last_active":"2024-09-12T05:21:41.967604+0000","last_peered":"2024-09-12T05:21:41.967604+0000","last_clean":"2024-09-12T05:21:00.585064+0000","last_became_active":"2024-09-12T05:21:03.157170+0000","last_became_peered":"2024-09-12T05:21:03.157170+0000","last_unstale":"2024-09-12T05:21:41.967604+0000","last_undegraded":"2024-09-12T05:21:03.156358+0000","last_fullsized":"2024-09-12T05:21:03.156283+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:35.814532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011274589999999999,"stat_sum":{"num_bytes":46206117,"num_objects":80,"num_object_clones":12,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":80,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":47,"num_read":4436,"num_read_kb":17119,"num_write":407,"num_write_kb":25469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":80}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.918396+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:21:41.918396+0000","last_peered":"2024-09-12T05:21:41.918396+0000","last_clean":"2024-09-12T05:21:41.918396+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:21:41.918396+0000","last_undegraded":"2024-09-12T05:21:41.918396+0000","last_fullsized":"2024-09-12T05:21:41.918396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"89'694","reported_seq":9057,"reported_epoch":89,"state":"peering","last_fresh":"2024-09-12T05:21:41.784004+0000","last_change":"2024-09-12T05:21:41.918064+0000","last_active":"2024-09-12T05:21:41.918064+0000","last_peered":"2024-09-12T05:21:41.784004+0000","last_clean":"2024-09-12T05:21:37.333152+0000","last_became_active":"2024-09-12T05:21:40.770790+0000","last_became_peered":"2024-09-12T05:21:40.770790+0000","last_unstale":"2024-09-12T05:21:41.784004+0000","last_undegraded":"2024-09-12T05:21:41.784004+0000","last_fullsized":"2024-09-12T05:21:40.749290+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011707810000000001,"stat_sum":{"num_bytes":66297676,"num_objects":71,"num_object_clones":14,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":40,"num_read":9929,"num_read_kb":50704,"num_write":1020,"num_write_kb":21109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":13855336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.913528+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:21:41.913528+0000","last_peered":"2024-09-12T05:21:41.913528+0000","last_clean":"2024-09-12T05:21:41.913528+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:21:41.913528+0000","last_undegraded":"2024-09-12T05:21:41.913528+0000","last_fullsized":"2024-09-12T05:21:41.913528+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"86'407","reported_seq":1601,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.939118+0000","last_change":"2024-09-12T05:21:03.157382+0000","last_active":"2024-09-12T05:21:41.939118+0000","last_peered":"2024-09-12T05:21:41.939118+0000","last_clean":"2024-09-12T05:21:01.133301+0000","last_became_active":"2024-09-12T05:21:03.157382+0000","last_became_peered":"2024-09-12T05:21:03.157382+0000","last_unstale":"2024-09-12T05:21:41.939118+0000","last_undegraded":"2024-09-12T05:21:03.156161+0000","last_fullsized":"2024-09-12T05:21:03.155969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:46:44.383074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002046291,"stat_sum":{"num_bytes":30825161,"num_objects":61,"num_object_clones":8,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":61,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":39,"num_read":1889,"num_read_kb":10093,"num_write":486,"num_write_kb":4664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":61}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.928255+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:21:41.928255+0000","last_peered":"2024-09-12T05:21:41.928255+0000","last_clean":"2024-09-12T05:21:41.928255+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:21:41.928255+0000","last_undegraded":"2024-09-12T05:21:41.928255+0000","last_fullsized":"2024-09-12T05:21:41.928255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"89'270","reported_seq":2819,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.915890+0000","last_change":"2024-09-12T05:20:11.787268+0000","last_active":"2024-09-12T05:21:41.915890+0000","last_peered":"2024-09-12T05:21:41.915890+0000","last_clean":"2024-09-12T05:21:41.915890+0000","last_became_active":"2024-09-12T05:20:09.747825+0000","last_became_peered":"2024-09-12T05:20:09.747825+0000","last_unstale":"2024-09-12T05:21:41.915890+0000","last_undegraded":"2024-09-12T05:21:41.915890+0000","last_fullsized":"2024-09-12T05:21:41.915890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:20.741045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010361979999999999,"stat_sum":{"num_bytes":85913414,"num_objects":69,"num_object_clones":13,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":38,"num_read":2465,"num_read_kb":39215,"num_write":275,"num_write_kb":30993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":177,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.918361+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:21:41.918361+0000","last_peered":"2024-09-12T05:21:41.918361+0000","last_clean":"2024-09-12T05:21:41.918361+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:21:41.918361+0000","last_undegraded":"2024-09-12T05:21:41.918361+0000","last_fullsized":"2024-09-12T05:21:41.918361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":245,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.928303+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:21:41.928303+0000","last_peered":"2024-09-12T05:21:41.928303+0000","last_clean":"2024-09-12T05:21:41.928303+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:21:41.928303+0000","last_undegraded":"2024-09-12T05:21:41.928303+0000","last_fullsized":"2024-09-12T05:21:41.928303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"89'534","reported_seq":4300,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.915781+0000","last_change":"2024-09-12T05:20:11.786966+0000","last_active":"2024-09-12T05:21:41.915781+0000","last_peered":"2024-09-12T05:21:41.915781+0000","last_clean":"2024-09-12T05:21:41.915781+0000","last_became_active":"2024-09-12T05:20:09.735109+0000","last_became_peered":"2024-09-12T05:20:09.735109+0000","last_unstale":"2024-09-12T05:21:41.915781+0000","last_undegraded":"2024-09-12T05:21:41.915781+0000","last_fullsized":"2024-09-12T05:21:41.915781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:50.992062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088249400000000005,"stat_sum":{"num_bytes":27286265,"num_objects":72,"num_object_clones":13,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":39,"num_read":6379,"num_read_kb":34319,"num_write":547,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"89'464","reported_seq":2042,"reported_epoch":90,"state":"active+clean+remapped","last_fresh":"2024-09-12T05:21:41.913488+0000","last_change":"2024-09-12T05:21:40.752657+0000","last_active":"2024-09-12T05:21:41.913488+0000","last_peered":"2024-09-12T05:21:41.913488+0000","last_clean":"2024-09-12T05:21:41.913488+0000","last_became_active":"2024-09-12T05:21:40.751385+0000","last_became_peered":"2024-09-12T05:21:40.751385+0000","last_unstale":"2024-09-12T05:21:41.913488+0000","last_undegraded":"2024-09-12T05:21:41.913488+0000","last_fullsized":"2024-09-12T05:21:41.913488+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:36.134989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083728800000000005,"stat_sum":{"num_bytes":22507749,"num_objects":77,"num_object_clones":12,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":77,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":47,"num_read":2693,"num_read_kb":3895,"num_write":531,"num_write_kb":1769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":739494,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[{"shards":"2,7","objects":77}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"90'678","reported_seq":2179,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.922235+0000","last_change":"2024-09-12T05:21:03.161538+0000","last_active":"2024-09-12T05:21:41.922235+0000","last_peered":"2024-09-12T05:21:41.922235+0000","last_clean":"2024-09-12T05:21:02.486182+0000","last_became_active":"2024-09-12T05:21:03.161538+0000","last_became_peered":"2024-09-12T05:21:03.161538+0000","last_unstale":"2024-09-12T05:21:41.922235+0000","last_undegraded":"2024-09-12T05:21:03.158960+0000","last_fullsized":"2024-09-12T05:21:03.158767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:01:09.200665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001140198,"stat_sum":{"num_bytes":46117026,"num_objects":69,"num_object_clones":14,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":69,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":36,"num_read":4101,"num_read_kb":9323,"num_write":858,"num_write_kb":4817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1146302,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":69}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"89'316","reported_seq":4300,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.915862+0000","last_change":"2024-09-12T05:20:11.787356+0000","last_active":"2024-09-12T05:21:41.915862+0000","last_peered":"2024-09-12T05:21:41.915862+0000","last_clean":"2024-09-12T05:21:41.915862+0000","last_became_active":"2024-09-12T05:20:09.741117+0000","last_became_peered":"2024-09-12T05:20:09.741117+0000","last_unstale":"2024-09-12T05:21:41.915862+0000","last_undegraded":"2024-09-12T05:21:41.915862+0000","last_fullsized":"2024-09-12T05:21:41.915862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:43.504249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011192330000000001,"stat_sum":{"num_bytes":22859197,"num_objects":65,"num_object_clones":10,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":35,"num_read":4629,"num_read_kb":14132,"num_write":288,"num_write_kb":6992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"85'1711","reported_seq":4007,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.919260+0000","last_change":"2024-09-12T05:20:11.736226+0000","last_active":"2024-09-12T05:21:41.919260+0000","last_peered":"2024-09-12T05:21:41.919260+0000","last_clean":"2024-09-12T05:21:41.919260+0000","last_became_active":"2024-09-12T05:20:09.734742+0000","last_became_peered":"2024-09-12T05:20:09.734742+0000","last_unstale":"2024-09-12T05:21:41.919260+0000","last_undegraded":"2024-09-12T05:21:41.919260+0000","last_fullsized":"2024-09-12T05:21:41.919260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:49.186228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085690600000000005,"stat_sum":{"num_bytes":5627268,"num_objects":57,"num_object_clones":6,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":36,"num_read":10117,"num_read_kb":11663,"num_write":2952,"num_write_kb":5135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"89'453","reported_seq":4897,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.928932+0000","last_change":"2024-09-12T05:20:11.785456+0000","last_active":"2024-09-12T05:21:41.928932+0000","last_peered":"2024-09-12T05:21:41.928932+0000","last_clean":"2024-09-12T05:21:41.928932+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:21:41.928932+0000","last_undegraded":"2024-09-12T05:21:41.928932+0000","last_fullsized":"2024-09-12T05:21:41.928932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:34.749743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011734079999999999,"stat_sum":{"num_bytes":16446534,"num_objects":73,"num_object_clones":15,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":40,"num_read":5566,"num_read_kb":10687,"num_write":525,"num_write_kb":4603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"89'408","reported_seq":1448,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.928793+0000","last_change":"2024-09-12T05:21:03.166584+0000","last_active":"2024-09-12T05:21:41.928793+0000","last_peered":"2024-09-12T05:21:41.928793+0000","last_clean":"2024-09-12T05:21:02.482903+0000","last_became_active":"2024-09-12T05:21:03.166584+0000","last_became_peered":"2024-09-12T05:21:03.166584+0000","last_unstale":"2024-09-12T05:21:41.928793+0000","last_undegraded":"2024-09-12T05:21:03.162462+0000","last_fullsized":"2024-09-12T05:21:03.162245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:16.110569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010563930000000001,"stat_sum":{"num_bytes":41950713,"num_objects":65,"num_object_clones":10,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":65,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":2001,"num_read_kb":5950,"num_write":466,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":65}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"89'270","reported_seq":2685,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.967709+0000","last_change":"2024-09-12T05:21:03.166642+0000","last_active":"2024-09-12T05:21:41.967709+0000","last_peered":"2024-09-12T05:21:41.967709+0000","last_clean":"2024-09-12T05:21:02.483134+0000","last_became_active":"2024-09-12T05:21:03.166642+0000","last_became_peered":"2024-09-12T05:21:03.166642+0000","last_unstale":"2024-09-12T05:21:41.967709+0000","last_undegraded":"2024-09-12T05:21:03.162452+0000","last_fullsized":"2024-09-12T05:21:03.162237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:34.174318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072867899999999998,"stat_sum":{"num_bytes":36769067,"num_objects":67,"num_object_clones":13,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":67,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":28,"num_read":2693,"num_read_kb":7839,"num_write":243,"num_write_kb":6821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":67}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"89'396","reported_seq":2736,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.922811+0000","last_change":"2024-09-12T05:20:34.018441+0000","last_active":"2024-09-12T05:21:41.922811+0000","last_peered":"2024-09-12T05:21:41.922811+0000","last_clean":"2024-09-12T05:21:41.922811+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:21:41.922811+0000","last_undegraded":"2024-09-12T05:21:41.922811+0000","last_fullsized":"2024-09-12T05:21:41.922811+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:40.617085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387196,"stat_sum":{"num_bytes":70541375,"num_objects":65,"num_object_clones":10,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":32,"num_read":3075,"num_read_kb":15643,"num_write":460,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"89'366","reported_seq":2326,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.928367+0000","last_change":"2024-09-12T05:21:03.164248+0000","last_active":"2024-09-12T05:21:41.928367+0000","last_peered":"2024-09-12T05:21:41.928367+0000","last_clean":"2024-09-12T05:21:02.482711+0000","last_became_active":"2024-09-12T05:21:03.164248+0000","last_became_peered":"2024-09-12T05:21:03.164248+0000","last_unstale":"2024-09-12T05:21:41.928367+0000","last_undegraded":"2024-09-12T05:21:03.161673+0000","last_fullsized":"2024-09-12T05:21:03.161442+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:25.515669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074458300000000005,"stat_sum":{"num_bytes":70774498,"num_objects":71,"num_object_clones":11,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":71,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":38,"num_read":2666,"num_read_kb":38654,"num_write":383,"num_write_kb":21004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":71}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"86'312","reported_seq":1501,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-12T05:21:41.928382+0000","last_change":"2024-09-12T05:20:57.096516+0000","last_active":"2024-09-12T05:21:41.928382+0000","last_peered":"2024-09-12T05:21:41.928382+0000","last_clean":"2024-09-12T05:21:41.928382+0000","last_became_active":"2024-09-12T05:20:57.095147+0000","last_became_peered":"2024-09-12T05:20:57.095147+0000","last_unstale":"2024-09-12T05:21:41.928382+0000","last_undegraded":"2024-09-12T05:21:41.928382+0000","last_fullsized":"2024-09-12T05:21:41.928382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.349679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347827,"stat_sum":{"num_bytes":56307744,"num_objects":60,"num_object_clones":11,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":34,"num_read":1697,"num_read_kb":33966,"num_write":351,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"90'384","reported_seq":2656,"reported_epoch":90,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:41.935103+0000","last_change":"2024-09-12T05:21:03.163550+0000","last_active":"2024-09-12T05:21:41.935103+0000","last_peered":"2024-09-12T05:21:41.935103+0000","last_clean":"2024-09-12T05:21:02.482791+0000","last_became_active":"2024-09-12T05:21:03.163550+0000","last_became_peered":"2024-09-12T05:21:03.163550+0000","last_unstale":"2024-09-12T05:21:41.935103+0000","last_undegraded":"2024-09-12T05:21:03.161537+0000","last_fullsized":"2024-09-12T05:21:03.161412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:33.729414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076674600000000001,"stat_sum":{"num_bytes":25762965,"num_objects":76,"num_object_clones":17,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":76,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":41,"num_read":2992,"num_read_kb":7822,"num_write":339,"num_write_kb":2499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":76}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1302323989,"num_objects":2175,"num_object_clones":362,"num_object_copies":4350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":837,"num_objects_misplaced":77,"num_objects_unfound":0,"num_objects_dirty":2175,"num_whiteouts":1206,"num_read":130873,"num_read_kb":764808,"num_write":17961,"num_write_kb":414278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":627,"num_bytes_recovered":38057650,"num_keys_recovered":50,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569556992,"data_stored":729866154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14933,"ondisk_log_size":14933,"up":51,"acting":52,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130816,"kb_used_data":103780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94241024,"statfs":{"total":96636764160,"available":96502808576,"internally_reserved":0,"allocated":106270720,"data_stored":144059849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62872,"kb_used_data":27524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94308968,"statfs":{"total":96636764160,"available":96572383232,"internally_reserved":0,"allocated":28184576,"data_stored":30986329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122324,"kb_used_data":77252,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94249516,"statfs":{"total":96636764160,"available":96511504384,"internally_reserved":0,"allocated":79106048,"data_stored":87693463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,18,31,66,66],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78564,"kb_used_data":39052,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94293276,"statfs":{"total":96636764160,"available":96556314624,"internally_reserved":0,"allocated":39989248,"data_stored":49268210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151944,"kb_used_data":106864,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94219896,"statfs":{"total":96636764160,"available":96481173504,"internally_reserved":0,"allocated":109428736,"data_stored":141722195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47180,"kb_used_data":11836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324660,"statfs":{"total":96636764160,"available":96588451840,"internally_reserved":0,"allocated":12120064,"data_stored":12439305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127096,"kb_used_data":87584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94244744,"statfs":{"total":96636764160,"available":96506617856,"internally_reserved":0,"allocated":89686016,"data_stored":107183761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127012,"kb_used_data":99984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94244828,"statfs":{"total":96636764160,"available":96506703872,"internally_reserved":0,"allocated":102383616,"data_stored":149900410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":100728832,"data_stored":148821068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88612864,"data_stored":106674346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22241280,"data_stored":23042200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":108560384,"data_stored":141399835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39358464,"data_stored":48993160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":78315520,"data_stored":87457683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27123712,"data_stored":30497355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":104615936,"data_stored":142980507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:21:44.783 INFO:tasks.thrashosds.thrasher:Setting 3.f to [2, 6, 4, 1] 2024-09-12T05:21:44.783 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.f', '2', '6', '4', '1'] 2024-09-12T05:21:44.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.f 2 6 4 1 2024-09-12T05:21:44.790 INFO:teuthology.orchestra.run.smithi059.stdout:4613 trunc from 0xd49f497 to 0x58e517d 2024-09-12T05:21:44.797 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:44.797 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:44.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:4616 read 0x484079c thru 0x4849046 (0x88ab bytes) 2024-09-12T05:21:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:4622 read 0x30cc778 thru 0x30d466e (0x7ef7 bytes) 2024-09-12T05:21:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:4625 trunc from 0x58e517d to 0x7e94969 2024-09-12T05:21:44.842 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:44.839+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:44.843 INFO:teuthology.orchestra.run.smithi059.stdout:4626 writesame 0x272c4c1 thru 0x2732597 data_size 0x1(0x60d7 bytes) 2024-09-12T05:21:44.862 INFO:teuthology.orchestra.run.smithi059.stdout:4627 trunc from 0x7e94969 to 0xe156e64 2024-09-12T05:21:44.870 INFO:teuthology.orchestra.run.smithi059.stdout:4631 read 0x864448d thru 0x864c846 (0x83ba bytes) 2024-09-12T05:21:44.870 INFO:teuthology.orchestra.run.smithi059.stdout:4632 read 0xd9198b6 thru 0xd923973 (0xa0be bytes) 2024-09-12T05:21:44.870 INFO:teuthology.orchestra.run.smithi059.stdout:4633 write 0x7eb8de4 thru 0x7ebc347 (0x3564 bytes) 2024-09-12T05:21:44.876 INFO:teuthology.orchestra.run.smithi059.stdout:4634 read 0x90836f3 thru 0x90921fd (0xeb0b bytes) 2024-09-12T05:21:44.876 INFO:teuthology.orchestra.run.smithi059.stdout:4637 read 0x4842a20 thru 0x48488a1 (0x5e82 bytes) 2024-09-12T05:21:44.876 INFO:teuthology.orchestra.run.smithi059.stdout:4638 write 0xcd32263 thru 0xcd3e183 (0xbf21 bytes) 2024-09-12T05:21:44.882 INFO:teuthology.orchestra.run.smithi059.stdout:4639 writesame 0xc4d2816 thru 0xc4dec63 data_size 0x1(0xc44e bytes) 2024-09-12T05:21:44.920 INFO:teuthology.orchestra.run.smithi059.stdout:4640 punch from 0xdc018a0 to 0xdc0de09, (0xc569 bytes) 2024-09-12T05:21:44.920 INFO:teuthology.orchestra.run.smithi059.stdout:4641 writesame 0x4fc9023 thru 0x4fc92fd data_size 0x1(0x2db bytes) 2024-09-12T05:21:44.922 INFO:teuthology.orchestra.run.smithi059.stdout:4642 write 0x5a7fe22 thru 0x5a8d68c (0xd86b bytes) 2024-09-12T05:21:44.926 INFO:teuthology.orchestra.run.smithi059.stdout:4643 punch from 0xcdfba54 to 0xcdfd2e5, (0x1891 bytes) 2024-09-12T05:21:44.926 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:44.926 INFO:teuthology.orchestra.run.smithi059.stdout:4645 write 0x63492d thru 0x635b68 (0x123c bytes) 2024-09-12T05:21:44.943 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:44.939+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:44.946 INFO:teuthology.orchestra.run.smithi059.stdout:4647 write 0xeccd306 thru 0xecd407a (0x6d75 bytes) 2024-09-12T05:21:44.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:21:44.953 INFO:teuthology.orchestra.run.smithi059.stdout:4649 clone 37 order 23 su 32768 sc 9 2024-09-12T05:21:44.962 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:44.962 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:44.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:45.045 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:45.043+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:45.139 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:45.139 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:45.145 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:45.143+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:45.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:45.247 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:45.243+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:45.274 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:45.274 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:45.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:45.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:45.347+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:45.449 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:45.447+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:45.462 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:45.462 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:45.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:45.550 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:45.551+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:45.650 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:45.650 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:45.651 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:45.647+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:45.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:45.753 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:45.751+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:45.829 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:45.829 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:45.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:45.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:45.852 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:45.847+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:21:45.938 INFO:teuthology.orchestra.run.smithi059.stderr:set 3.f pg_upmap_items mapping to [2->6,4->1] 2024-09-12T05:21:45.953 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:45.951+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:45.992 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:46.013 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:46.028 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:46.028 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:46.031 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone36 from 0xecd407b (overlap 0x58e517d) to 0x8e3b59 2024-09-12T05:21:46.033 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:46.033 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:46.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:46.058 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:46.059 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:46.055+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:46.059 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:46.085 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:46.108 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:46.129 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:46.133 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:46.133 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:46.143 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-12T05:21:46.154 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:46.151+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:46.187 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:46.187 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:46.187 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:46.187 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:46.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:46.297 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:46.295+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:46.356 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:46.351+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:46.365 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:46.365 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:46.365 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:46.366 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:46.366 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:46.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:46.469 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:46.467+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:46.551 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:46.551 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:46.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:46.551 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:46.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80148 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6594560~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.837733491999998, 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047081795000000003, 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80148 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.552 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712492+0000", 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712493+0000", 2024-09-12T05:21:46.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8299999999999997e-07 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712495+0000", 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3099999999999999e-06 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712504+0000", 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5290000000000008e-06 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712509+0000", 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4480000000000002e-06 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759399+0000", 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046889693000000003 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759478+0000", 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9040000000000002e-05 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759574+0000", 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6292000000000006e-05 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80149 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7028736~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.837687817999999, 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047236827000000002, 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80149 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712539+0000", 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712542+0000", 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9639999999999999e-06 2024-09-12T05:21:46.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712550+0000", 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7709999999999995e-06 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712556+0000", 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6380000000000001e-06 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759608+0000", 2024-09-12T05:21:46.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047051754000000001 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759684+0000", 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6784000000000002e-05 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759775+0000", 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000001e-05 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80150 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6701056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.837660581000002, 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047422082999999997, 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80150 2024-09-12T05:21:46.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713023+0000", 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00045808399999999999 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713028+0000", 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7849999999999999e-06 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713039+0000", 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0530000000000001e-05 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713046+0000", 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2710000000000003e-06 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759807+0000", 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046761182999999998 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759887+0000", 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9709999999999994e-05 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759987+0000", 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010052000000000001 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80151 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7036928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.837166209000003, 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047137710999999999, 2024-09-12T05:21:46.565 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80151 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713063+0000", 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7460000000000001e-06 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713071+0000", 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6159999999999996e-06 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713077+0000", 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760020+0000", 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046943358999999997 2024-09-12T05:21:46.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760098+0000", 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7519000000000001e-05 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760197+0000", 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9778000000000006e-05 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80152 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6709248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.837140257000001, 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047326518999999997, 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80152 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713245+0000", 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015924600000000001 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713249+0000", 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3379999999999998e-06 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713265+0000", 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6184e-05 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713271+0000", 2024-09-12T05:21:46.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6670000000000001e-06 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760231+0000", 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046960285999999997 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760311+0000", 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9643999999999998e-05 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760412+0000", 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101154 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80153 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6799360~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.836945090999997, 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047341640999999997, 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.574 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80153 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713474+0000", 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192898 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713477+0000", 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3890000000000001e-06 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713487+0000", 2024-09-12T05:21:46.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713494+0000", 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4540000000000001e-06 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760444+0000", 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046949957 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760526+0000", 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1361999999999998e-05 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760622+0000", 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6587000000000002e-05 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80154 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8413184~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:46.578 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.836719092999999, 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047319877000000003, 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80154 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713977+0000", 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00047076399999999998 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713985+0000", 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8790000000000003e-06 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713996+0000", 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.113e-05 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714003+0000", 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8979999999999999e-06 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760655+0000", 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046651821000000003 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760734+0000", 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9208999999999993e-05 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760827+0000", 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2176000000000007e-05 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80156 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8503296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.836184576000001, 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047199342999999998, 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80156 2024-09-12T05:21:46.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719243+0000", 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052018419999999999 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719248+0000", 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1760000000000001e-06 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719261+0000", 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3045e-05 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719269+0000", 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1130000000000001e-06 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761068+0000", 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041798096999999999 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761148+0000", 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0301000000000002e-05 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761241+0000", 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769000000000006e-05 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80227 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4956160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.830167203000002, 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047195107, 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80227 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4900000000000001e-07 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720061+0000", 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0980000000000001e-06 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720068+0000", 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.007e-06 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720074+0000", 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767070+0000", 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046996653999999999 2024-09-12T05:21:46.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767150+0000", 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9919000000000005e-05 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767254+0000", 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103639 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.591 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80228 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 5718016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.830145352999999, 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047313252, 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80228 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720081+0000", 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8599999999999999e-07 2024-09-12T05:21:46.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720083+0000", 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720089+0000", 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720094+0000", 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7929999999999997e-06 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767286+0000", 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047191666 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767338+0000", 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2441000000000002e-05 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767394+0000", 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5526000000000003e-05 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80229 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4628480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.830125346000003, 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047505240999999997, 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80229 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727276+0000", 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071757619999999996 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727282+0000", 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7019999999999998e-06 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727293+0000", 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0778000000000001e-05 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727300+0000", 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5769999999999996e-06 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767428+0000", 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040128193 2024-09-12T05:21:46.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767510+0000", 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1203000000000002e-05 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767606+0000", 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6026000000000005e-05 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80275 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7069696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.822108124000003, 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047223138999999997, 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80275 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9399999999999995e-07 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728120+0000", 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2879999999999999e-06 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728127+0000", 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8669999999999996e-06 2024-09-12T05:21:46.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728133+0000", 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775161+0000", 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047027843 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775243+0000", 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2126999999999995e-05 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775341+0000", 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8189000000000005e-05 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80276 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6742016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.822085870999999, 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047322971999999998, 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80276 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728506+0000", 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036576600000000001 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728510+0000", 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5689999999999998e-06 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728519+0000", 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7190000000000007e-06 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728525+0000", 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-09-12T05:21:46.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775371+0000", 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046846023000000001 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775410+0000", 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8584000000000002e-05 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775463+0000", 2024-09-12T05:21:46.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2964999999999999e-05 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80277 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6758400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.821684867999998, 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047131702999999997, 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80277 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728770+0000", 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228586 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728774+0000", 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728784+0000", 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5249999999999994e-06 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728790+0000", 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6139999999999997e-06 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775498+0000", 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046708040999999999 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775577+0000", 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8553999999999994e-05 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775673+0000", 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5644999999999997e-05 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80279 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6856704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.614 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.821397115000003, 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047172124000000003, 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80279 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729026+0000", 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019762800000000001 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729030+0000", 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729039+0000", 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1209999999999996e-06 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729046+0000", 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3450000000000002e-06 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775825+0000", 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046779646000000001 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775906+0000", 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0337e-05 2024-09-12T05:21:46.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776001+0000", 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5047e-05 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80281 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6635520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.821133310999997, 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047239476000000002, 2024-09-12T05:21:46.619 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80281 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729204+0000", 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111247 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729209+0000", 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2979999999999999e-06 2024-09-12T05:21:46.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729220+0000", 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1032e-05 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729228+0000", 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.571e-06 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776155+0000", 2024-09-12T05:21:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046927340999999997 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776236+0000", 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0551999999999997e-05 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776332+0000", 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6434999999999994e-05 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80282 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6971392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.820984324000001, 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047211569000000002, 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80282 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.624 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729654+0000", 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000412118 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729662+0000", 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8200000000000003e-06 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729675+0000", 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2996000000000001e-05 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729684+0000", 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1629999999999996e-06 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776362+0000", 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046678450000000003 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776403+0000", 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0627999999999998e-05 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776453+0000", 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0393999999999999e-05 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80285 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 3104768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.820402614999999, 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047179632999999999, 2024-09-12T05:21:46.628 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80285 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730008+0000", 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018459999999999999 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730012+0000", 2024-09-12T05:21:46.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6090000000000003e-06 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730024+0000", 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1853e-05 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730033+0000", 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776826+0000", 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046792907000000002 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776908+0000", 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1981e-05 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777003+0000", 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4712999999999999e-05 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.632 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80287 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2777088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.819985709000001, 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047092717999999999, 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.633 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80287 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730400+0000", 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000159684 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730404+0000", 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2780000000000004e-06 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730412+0000", 2024-09-12T05:21:46.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4669999999999998e-06 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730416+0000", 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6609999999999999e-06 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777158+0000", 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046741956000000001 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777236+0000", 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7960999999999994e-05 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777333+0000", 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6711000000000003e-05 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:102631 3.7 3:e1f14bfd:::rbd_data.11181f89f1e6.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:46.637 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.4587937790000005, 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048849113999999999, 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 102631 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:46.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091434+0000", 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.429e-06 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:46.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091445+0000", 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0932e-05 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091471+0000", 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-05 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091486+0000", 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5506999999999999e-05 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091583+0000", 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6407e-05 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091661+0000", 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8046999999999993e-05 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 7", 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.098845+0000", 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071841509999999997 2024-09-12T05:21:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140140+0000", 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041295239999999997 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140190+0000", 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9629999999999997e-05 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140240+0000", 2024-09-12T05:21:46.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0353999999999999e-05 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140281+0000", 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1007000000000002e-05 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:46.643 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:46.645 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:46.645 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:46.643+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:46.746 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:46.747+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:46.776 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:46.777 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:46.777 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:46.777 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:46.791 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:46.847 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:46.847+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:46.908 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:46.908 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:46.908 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:46.908 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:46.908 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:46.922 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:46.948 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:46.947+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:47.042 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:47.042 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5409578400000008, 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.044 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:21:47.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.044 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:21:47.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:47.048 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5409261910000005, 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:21:47.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:47.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5408900479999996, 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:21:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:21:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:21:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:21:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:21:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5408592379999995, 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:21:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5408286790000005, 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:21:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:21:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:21:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5407987829999996, 2024-09-12T05:21:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:21:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5390418399999994, 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:21:47.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:21:47.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:21:47.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.079 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.080 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:47.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5389982710000005, 2024-09-12T05:21:47.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:21:47.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.080 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:21:47.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:21:47.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5387663810000003, 2024-09-12T05:21:47.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:21:47.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:21:47.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5386454700000005, 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:47.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5385284319999997, 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.096 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:21:47.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5384088239999993, 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:21:47.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:21:47.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:21:47.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101774 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4833280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5354628699999999, 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090801491999999998, 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101774 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:47.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507679+0000", 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2399999999999996e-07 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507682+0000", 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507691+0000", 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3230000000000004e-06 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507698+0000", 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1400000000000002e-06 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598168+0000", 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090470153999999997 2024-09-12T05:21:47.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598305+0000", 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136935 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598479+0000", 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0001738 2024-09-12T05:21:47.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.111 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:47.111 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5354300970000008, 2024-09-12T05:21:47.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:21:47.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:21:47.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:21:47.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:21:47.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5353957909999991, 2024-09-12T05:21:47.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:21:47.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5353636149999996, 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.122 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:21:47.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5353019989999996, 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:21:47.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5352466430000007, 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:47.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5351918369999993, 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:21:47.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5350321630000003, 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.140 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:47.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:21:47.144 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.145 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.145 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:47.146 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:47.147 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:47.147+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:47.248 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:47.243+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:47.273 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:47.274 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:47.289 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:47.349 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:47.347+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:47.450 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:47.447+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:47.457 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:47.457 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:47.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:47.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:47.555+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:47.635 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.462893270999999, 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:21:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:21:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:21:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:21:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:21:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.462191751000006, 2024-09-12T05:21:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:21:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:21:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:21:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:21:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:21:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:21:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:21:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:21:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:21:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:21:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.462069017000005, 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:21:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:21:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.462006803999998, 2024-09-12T05:21:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:21:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:21:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:21:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:21:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461939986999994, 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:21:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461879953999997, 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:21:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:21:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:21:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:21:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:21:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:21:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:21:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:21:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:21:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:21:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:21:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:21:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461800018000005, 2024-09-12T05:21:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:21:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.679 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:21:47.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.679 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:47.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:47.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:21:47.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:47.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:21:47.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:47.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:21:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:21:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:21:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:21:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461740457000005, 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.686 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:47.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.691 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461665667999995, 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:21:47.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:21:47.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461528267999995, 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:21:47.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:21:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:47.702 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461376533000006, 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:21:47.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:21:47.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:21:47.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:21:47.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:21:47.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:21:47.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:21:47.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:21:47.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:21:47.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:21:47.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:21:47.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.709 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.710 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.710 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:47.710 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461313559000004, 2024-09-12T05:21:47.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:21:47.710 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.711 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.711 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.712 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:21:47.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.713 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:47.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:47.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:21:47.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:21:47.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:21:47.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461177667000001, 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:21:47.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461113706999996, 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.725 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:21:47.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:21:47.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.461029453999998, 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:21:47.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.460970094000004, 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:47.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:21:47.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:47.738 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.460909826999995, 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:47.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.460846833999994, 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:21:47.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 67.460686226000007, 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.747 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:21:47.751 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.017454512, 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:47.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:47.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.756 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.756 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.756 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:47.757 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:47.758 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:47.759+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:47.858 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:47.859+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:47.934 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104981 3.f 3.d0b0c84f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257335+0000", 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.674178658, 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6742209319999999, 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104981 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257335+0000", 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257335+0000", 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257336+0000", 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257342+0000", 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257363+0000", 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.016e-05 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257378+0000", 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5947000000000002e-05 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257509+0000", 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013029200000000001 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257527+0000", 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8096000000000001e-05 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993237+0000", 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.735709948 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993241+0000", 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2379999999999999e-06 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3.e5a9988f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.690489707, 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.69065613, 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:21:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:21:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:21:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:21:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:21:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3.bd429c6f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6739428759999999, 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.674215794, 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:21:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104994 3.f 3.377f984f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257875+0000", 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6736391749999999, 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6740180119999999, 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104994 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257875+0000", 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257875+0000", 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257876+0000", 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.513e-06 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257882+0000", 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.874e-06 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257900+0000", 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8009999999999999e-05 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257916+0000", 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5423000000000001e-05 2024-09-12T05:21:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258041+0000", 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000125215 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258061+0000", 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0049999999999999e-05 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993312+0000", 2024-09-12T05:21:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73525137399999996 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993317+0000", 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3460000000000004e-06 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3.6399ff6f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6793028169999999, 2024-09-12T05:21:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6797845169999999, 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:21:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:21:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105256 3.f 3.2d93eaf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.265659+0000", 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.66585491, 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.66643987, 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105256 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265659+0000", 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265659+0000", 2024-09-12T05:21:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265661+0000", 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265667+0000", 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1700000000000002e-06 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265688+0000", 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0642999999999999e-05 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265703+0000", 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5622999999999999e-05 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265833+0000", 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013032199999999999 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265846+0000", 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2823000000000001e-05 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993690+0000", 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72784346300000002 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993694+0000", 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4070000000000003e-06 2024-09-12T05:21:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3.b013f4cf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6875048640000001, 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688195176, 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:21:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105011 3.f 3.e1a44d0f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.258156+0000", 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6733581069999999, 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.674151121, 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105011 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258156+0000", 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258156+0000", 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258158+0000", 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0329999999999998e-06 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258163+0000", 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3900000000000001e-06 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258182+0000", 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.84e-05 2024-09-12T05:21:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258199+0000", 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7543000000000001e-05 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258312+0000", 2024-09-12T05:21:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011313499999999999 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258331+0000", 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8406999999999998e-05 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993352+0000", 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73502166300000005 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993360+0000", 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7610000000000007e-06 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3.e32e61ef (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6872635389999999, 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6881587219999998, 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105012 3.f 3.65156f0f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.258354+0000", 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.673159579, 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.674157662, 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105012 2024-09-12T05:21:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258354+0000", 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258354+0000", 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258356+0000", 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4169999999999999e-06 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258362+0000", 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258381+0000", 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8864000000000001e-05 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258402+0000", 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0806e-05 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258966+0000", 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000563942 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.258988+0000", 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2717e-05 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993389+0000", 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73440046999999997 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993393+0000", 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2289999999999997e-06 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105258 3.f 3.53d9880f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.265814+0000", 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6656998189999999, 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666799648, 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105258 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265814+0000", 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265814+0000", 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265816+0000", 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265821+0000", 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8139999999999997e-06 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265842+0000", 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0103e-05 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265863+0000", 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1302999999999999e-05 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265977+0000", 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011405599999999999 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.265996+0000", 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8603000000000001e-05 2024-09-12T05:21:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993726+0000", 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72773070799999995 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993733+0000", 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2509999999999997e-06 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3.a985304f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6865153290000001, 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.687717224, 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:21:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:21:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3.50a6616f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.686203568, 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.687512785, 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3.1c830bcf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6758633039999999, 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677274143, 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:21:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:21:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3.bd59154f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.69219729, 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.693709642, 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:21:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3.79e649af (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6854806070000001, 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.687094388, 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:21:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3.e5e5dc4f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6722947430000001, 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6740097940000001, 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:21:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:21:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105140 3.f 3.b5da442f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.261837+0000", 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.669677437, 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6714934930000001, 2024-09-12T05:21:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105140 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.261837+0000", 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.261837+0000", 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.261838+0000", 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.457e-06 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.261860+0000", 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1793e-05 2024-09-12T05:21:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.261879+0000", 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9167000000000001e-05 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.261894+0000", 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.486e-05 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.262053+0000", 2024-09-12T05:21:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015915800000000001 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.262073+0000", 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0392999999999999e-05 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993540+0000", 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73146673399999995 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993544+0000", 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1030000000000004e-06 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105275 3.f 3.bd12c62f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.266267+0000", 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.665246789, 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6671641240000001, 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105275 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.266267+0000", 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.266267+0000", 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.266269+0000", 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8500000000000001e-06 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.266275+0000", 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8270000000000003e-06 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.266294+0000", 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936e-05 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.266309+0000", 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5183e-05 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.266429+0000", 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000120196 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.266450+0000", 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0429999999999999e-05 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993752+0000", 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72730242599999995 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993756+0000", 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.284e-06 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105029 3.f 3.f3a771cf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259403+0000", 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6721106569999999, 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.674129368, 2024-09-12T05:21:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105029 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259403+0000", 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259403+0000", 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2899999999999999e-06 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259411+0000", 2024-09-12T05:21:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4559999999999997e-06 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259432+0000", 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0696999999999999e-05 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259450+0000", 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8573e-05 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259596+0000", 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014572899999999999 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259615+0000", 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8879999999999999e-05 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993465+0000", 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73384957900000003 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993469+0000", 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2729999999999996e-06 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3.5f33cbcf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.684181688, 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6863013520000001, 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:21:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:21:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105151 3.f 3.e2d99aef (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.263140+0000", 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.668374094, 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6705958869999999, 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105151 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263140+0000", 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263140+0000", 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263142+0000", 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.75e-06 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263149+0000", 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8269999999999998e-06 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263172+0000", 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2940000000000001e-05 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263190+0000", 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7249e-05 2024-09-12T05:21:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263323+0000", 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013348599999999999 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263344+0000", 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1192999999999999e-05 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993576+0000", 2024-09-12T05:21:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73023144100000004 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993584+0000", 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8560000000000007e-06 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105049 3.f 3.e8f9ce2f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.260002+0000", 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.671512162, 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6738353109999999, 2024-09-12T05:21:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105049 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.260002+0000", 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.260002+0000", 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.260003+0000", 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.260008+0000", 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1529999999999996e-06 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.260026+0000", 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7439999999999999e-05 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.260041+0000", 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.260155+0000", 2024-09-12T05:21:48.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113392 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.260173+0000", 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8649999999999999e-05 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993502+0000", 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73332889099999998 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993510+0000", 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6129999999999998e-06 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3.156ace8f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.681629934, 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.684054022, 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.054 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3.781b4bcf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6779002009999999, 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6804359880000002, 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:21:48.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105189 3.f 3.fcd4e5af (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.059 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.263866+0000", 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.667648416, 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.670285955, 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105189 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263866+0000", 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263866+0000", 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263867+0000", 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.593e-06 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263886+0000", 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8406999999999998e-05 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263906+0000", 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0503e-05 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263922+0000", 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5923e-05 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.264241+0000", 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031936099999999999 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.264264+0000", 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2650000000000002e-05 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993613+0000", 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72934890299999999 2024-09-12T05:21:48.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993617+0000", 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.318e-06 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3.3ab0b04f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.680851444, 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6835907730000002, 2024-09-12T05:21:48.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:21:48.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3.67ea46ef (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.674786659, 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677639034, 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.069 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:21:48.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105196 3.f 3.4aef826f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.263958+0000", 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6675555010000001, 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.670547521, 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105196 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263958+0000", 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263958+0000", 2024-09-12T05:21:48.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263960+0000", 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6169999999999999e-06 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263966+0000", 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5400000000000003e-06 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.263986+0000", 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.073e-05 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.264002+0000", 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5906999999999999e-05 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.264340+0000", 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000337967 2024-09-12T05:21:48.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.264355+0000", 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569999999999999e-05 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993653+0000", 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72929836999999997 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993660+0000", 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8469999999999998e-06 2024-09-12T05:21:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3.3895134f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.691183568, 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6942781739999999, 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:21:48.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:21:48.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3.dccf28f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6805791029999999, 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6837784220000001, 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:21:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3.bc99b6f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.674563915, 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6778683129999998, 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:21:48.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:21:48.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3.c3d488cf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:48.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6771847, 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.680589927, 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:48.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:48.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 33 2024-09-12T05:21:48.098 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:48.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:21:48.100 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:48.095+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:48.100 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:48.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:48.200 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:48.195+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:48.238 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:48.238 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:48.238 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:48.238 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:48.238 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:48.254 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:48.308 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:48.308 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:48.326 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:48.326 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:48.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:48.339+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:48.343 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:48.343 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:48.361 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:48.383 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:48.402 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:48.402 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:48.402 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:48.403+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:48.405 INFO:teuthology.orchestra.run.smithi059.stdout:4650 punch from 0x6c2fa21 to 0x6c3d0f5, (0xd6d4 bytes) 2024-09-12T05:21:48.410 INFO:teuthology.orchestra.run.smithi059.stdout:4651 punch from 0xd3fa1eb to 0xd40178f, (0x75a4 bytes) 2024-09-12T05:21:48.425 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:48.425 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:48.425 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:48.426 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:48.427 INFO:teuthology.orchestra.run.smithi059.stdout:4652 trunc from 0xecd407b to 0x29c9fb5 2024-09-12T05:21:48.428 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:48.428 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:48.443 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:48.503 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:48.499+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:48.584 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:48.590 INFO:teuthology.orchestra.run.smithi059.stdout:4654 write 0x2a50406 thru 0x2a5e029 (0xdc24 bytes) 2024-09-12T05:21:48.604 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:48.603+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:48.609 INFO:teuthology.orchestra.run.smithi059.stdout:4655 write 0xba0717d thru 0xba0d8b4 (0x6738 bytes) 2024-09-12T05:21:48.618 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:48.618 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:48.621 INFO:teuthology.orchestra.run.smithi059.stdout:4657 writesame 0xc34423b thru 0xc3470c5 data_size 0x1(0x2e8b bytes) 2024-09-12T05:21:48.621 INFO:teuthology.orchestra.run.smithi059.stdout:4658 writesame 0x16060a2 thru 0x160ce6e data_size 0x1(0x6dcd bytes) 2024-09-12T05:21:48.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:48.633 INFO:teuthology.orchestra.run.smithi059.stdout:4659 write 0x83e661e thru 0x83f3736 (0xd119 bytes) 2024-09-12T05:21:48.642 INFO:teuthology.orchestra.run.smithi059.stdout:4660 read 0x16fbe66 thru 0x1706cbd (0xae58 bytes) 2024-09-12T05:21:48.643 INFO:teuthology.orchestra.run.smithi059.stdout:4661 write 0x97285aa thru 0x9734013 (0xba6a bytes) 2024-09-12T05:21:48.648 INFO:teuthology.orchestra.run.smithi059.stdout:4662 read 0xc02b776 thru 0xc0303af (0x4c3a bytes) 2024-09-12T05:21:48.649 INFO:teuthology.orchestra.run.smithi059.stdout:4663 read 0xb5da09d thru 0xb5e5eef (0xbe53 bytes) 2024-09-12T05:21:48.657 INFO:teuthology.orchestra.run.smithi059.stdout:4665 writesame 0xc8ab246 thru 0xc8b0869 data_size 0x4a(0x5624 bytes) 2024-09-12T05:21:48.667 INFO:teuthology.orchestra.run.smithi059.stdout:4666 write 0xea730de thru 0xea7bb02 (0x8a25 bytes) 2024-09-12T05:21:48.674 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:48.675 INFO:teuthology.orchestra.run.smithi059.stdout:4670 writesame 0x559b369 thru 0x55a5696 data_size 0x1(0xa32e bytes) 2024-09-12T05:21:48.702 INFO:teuthology.orchestra.run.smithi059.stdout:4671 punch from 0x66b50f7 to 0x66bac1f, (0x5b28 bytes) 2024-09-12T05:21:48.702 INFO:teuthology.orchestra.run.smithi059.stdout:4672 write 0xe78debd thru 0xe7979e5 (0x9b29 bytes) 2024-09-12T05:21:48.705 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:48.707+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:48.709 INFO:teuthology.orchestra.run.smithi059.stdout:4673 read 0xdcd35a thru 0xdd487d (0x7524 bytes) 2024-09-12T05:21:48.710 INFO:teuthology.orchestra.run.smithi059.stdout:4674 read 0xd051763 thru 0xd05ed7c (0xd61a bytes) 2024-09-12T05:21:48.710 INFO:teuthology.orchestra.run.smithi059.stdout:4676 read 0x560855d thru 0x561710a (0xebae bytes) 2024-09-12T05:21:48.711 INFO:teuthology.orchestra.run.smithi059.stdout:4677 read 0x1cc6b4 thru 0x1cd66a (0xfb7 bytes) 2024-09-12T05:21:48.712 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:48.712 INFO:teuthology.orchestra.run.smithi059.stdout:4680 write 0xf8a6e thru 0x107e5c (0xf3ef bytes) 2024-09-12T05:21:48.717 INFO:teuthology.orchestra.run.smithi059.stdout:4681 write 0x2ce8c80 thru 0x2ceac5d (0x1fde bytes) 2024-09-12T05:21:48.720 INFO:teuthology.orchestra.run.smithi059.stdout:4682 writesame 0x1f2ddf0 thru 0x1f3aa63 data_size 0xa(0xcc74 bytes) 2024-09-12T05:21:48.728 INFO:teuthology.orchestra.run.smithi059.stdout:4683 writesame 0x8fb9d26 thru 0x8fc32e4 data_size 0x11(0x95bf bytes) 2024-09-12T05:21:48.733 INFO:teuthology.orchestra.run.smithi059.stdout:4684 read 0x869341 thru 0x86dfad (0x4c6d bytes) 2024-09-12T05:21:48.734 INFO:teuthology.orchestra.run.smithi059.stdout:4685 write 0xa204002 thru 0xa20a2cf (0x62ce bytes) 2024-09-12T05:21:48.744 INFO:teuthology.orchestra.run.smithi059.stdout:4686 writesame 0xbd185aa thru 0xbd272e7 data_size 0x1(0xed3e bytes) 2024-09-12T05:21:48.751 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:48.751 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:48.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:48.778 INFO:teuthology.orchestra.run.smithi059.stdout:4688 punch from 0x389bbec to 0x38a2917, (0x6d2b bytes) 2024-09-12T05:21:48.778 INFO:teuthology.orchestra.run.smithi059.stdout:4689 write 0x58d703e thru 0x58deb3b (0x7afe bytes) 2024-09-12T05:21:48.784 INFO:teuthology.orchestra.run.smithi059.stdout:4690 read 0xe4eb869 thru 0xe4f6a89 (0xb221 bytes) 2024-09-12T05:21:48.784 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:48.785 INFO:teuthology.orchestra.run.smithi059.stdout:4695 read 0x6f8c632 thru 0x6f916b5 (0x5084 bytes) 2024-09-12T05:21:48.785 INFO:teuthology.orchestra.run.smithi059.stdout:4697 writesame 0x8eb9e47 thru 0x8ec0911 data_size 0xd(0x6acb bytes) 2024-09-12T05:21:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:4698 punch from 0x28d7559 to 0x28e33ac, (0xbe53 bytes) 2024-09-12T05:21:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:4703 writesame 0x89b19c9 thru 0x89b2dbf data_size 0x1(0x13f7 bytes) 2024-09-12T05:21:48.806 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:48.803+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:48.823 INFO:teuthology.orchestra.run.smithi059.stdout:4705 trunc from 0xea7bb03 to 0x265ba00 2024-09-12T05:21:48.871 INFO:teuthology.orchestra.run.smithi059.stdout:4706 write 0x3efd008 thru 0x3f04f31 (0x7f2a bytes) 2024-09-12T05:21:48.887 INFO:teuthology.orchestra.run.smithi059.stdout:4707 write 0x4d7f710 thru 0x4d85fa5 (0x6896 bytes) 2024-09-12T05:21:48.907 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:48.907 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:48.907 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:48.903+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:48.911 INFO:teuthology.orchestra.run.smithi059.stdout:4708 writesame 0x5afd996 thru 0x5b05187 data_size 0xd(0x77f2 bytes) 2024-09-12T05:21:48.913 INFO:teuthology.orchestra.run.smithi059.stdout:4709 read 0x3df3c1f thru 0x3df7969 (0x3d4b bytes) 2024-09-12T05:21:48.922 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:48.928 INFO:teuthology.orchestra.run.smithi059.stdout:4710 trunc from 0x5b05188 to 0xc8ee32b 2024-09-12T05:21:48.955 INFO:teuthology.orchestra.run.smithi059.stdout:4711 trunc from 0xc8ee32b to 0x3ac9301 2024-09-12T05:21:48.985 INFO:teuthology.orchestra.run.smithi059.stdout:4712 write 0x140cacd thru 0x14123a6 (0x58da bytes) 2024-09-12T05:21:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:21:49.007 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:49.003+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:49.013 INFO:teuthology.orchestra.run.smithi059.stdout:4713 write 0x9ca8c9d thru 0x9cb80b6 (0xf41a bytes) 2024-09-12T05:21:49.024 INFO:teuthology.orchestra.run.smithi059.stdout:4714 read 0x9324f94 thru 0x9326d3e (0x1dab bytes) 2024-09-12T05:21:49.024 INFO:teuthology.orchestra.run.smithi059.stdout:4715 read 0x4926b0a thru 0x492db6d (0x7064 bytes) 2024-09-12T05:21:49.024 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:49.025 INFO:teuthology.orchestra.run.smithi059.stdout:4717 write 0x594c2a1 thru 0x5954340 (0x80a0 bytes) 2024-09-12T05:21:49.032 INFO:teuthology.orchestra.run.smithi059.stdout:4718 read 0x1c59944 thru 0x1c641a0 (0xa85d bytes) 2024-09-12T05:21:49.033 INFO:teuthology.orchestra.run.smithi059.stdout:4719 write 0x5194edd thru 0x51a3fed (0xf111 bytes) 2024-09-12T05:21:49.064 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:49.064 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:49.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:49.121 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:49.123+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:49.209 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:49.211+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:49.238 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:49.239 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:49.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:49.310 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:49.307+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:49.411 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:49.411+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:49.421 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:49.422 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:49.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:49.521 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:49.523+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:49.604 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:49.605 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:49.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:49.611+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:49.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:49.714 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:49.715+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:49.789 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:49.789 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:49.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:49.815 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:49.815+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:49.916 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:49.915+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:49.932 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:49.932 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:49.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:50.019 INFO:teuthology.orchestra.run.smithi059.stdout:4720 writesame 0x95a0be6 thru 0x95a6df5 data_size 0x18(0x6210 bytes) 2024-09-12T05:21:50.020 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:50.019+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:50.025 INFO:teuthology.orchestra.run.smithi059.stdout:4721 punch from 0x869eaba to 0x86a027d, (0x17c3 bytes) 2024-09-12T05:21:50.025 INFO:teuthology.orchestra.run.smithi059.stdout:4722 read 0x3105e76 thru 0x3111bed (0xbd78 bytes) 2024-09-12T05:21:50.030 INFO:teuthology.orchestra.run.smithi059.stdout:4724 read 0x305f60c thru 0x306c6ac (0xd0a1 bytes) 2024-09-12T05:21:50.031 INFO:teuthology.orchestra.run.smithi059.stdout:4725 punch from 0x9d3fba to 0x9e2afb, (0xeb41 bytes) 2024-09-12T05:21:50.031 INFO:teuthology.orchestra.run.smithi059.stdout:4726 read 0x76b724e thru 0x76bb278 (0x402b bytes) 2024-09-12T05:21:50.032 INFO:teuthology.orchestra.run.smithi059.stdout:4729 punch from 0x322a6e2 to 0x322f1ac, (0x4aca bytes) 2024-09-12T05:21:50.032 INFO:teuthology.orchestra.run.smithi059.stdout:4731 writesame 0x6dd3dfe thru 0x6dd73c3 data_size 0x1(0x35c6 bytes) 2024-09-12T05:21:50.047 INFO:teuthology.orchestra.run.smithi059.stdout:4732 write 0x8a5b02f thru 0x8a5f8e2 (0x48b4 bytes) 2024-09-12T05:21:50.053 INFO:teuthology.orchestra.run.smithi059.stdout:4733 read 0xa6ce61 thru 0xa6db70 (0xd10 bytes) 2024-09-12T05:21:50.054 INFO:teuthology.orchestra.run.smithi059.stdout:4734 read 0x67813ed thru 0x67832b2 (0x1ec6 bytes) 2024-09-12T05:21:50.054 INFO:teuthology.orchestra.run.smithi059.stdout:4736 read 0x9ef62f thru 0x9f6d52 (0x7724 bytes) 2024-09-12T05:21:50.056 INFO:teuthology.orchestra.run.smithi059.stdout:4737 writesame 0x731db20 thru 0x732a17d data_size 0x1(0xc65e bytes) 2024-09-12T05:21:50.106 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.106 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.106 INFO:teuthology.orchestra.run.smithi059.stdout:4741 write 0x6f3f4bc thru 0x6f4822b (0x8d70 bytes) 2024-09-12T05:21:50.118 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:50.115+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:50.131 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:50.131 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:50.134 INFO:teuthology.orchestra.run.smithi059.stdout:4742 write 0xe398f42 thru 0xe3a7e60 (0xef1f bytes) 2024-09-12T05:21:50.155 INFO:teuthology.orchestra.run.smithi059.stdout:4743 trunc from 0xe3a7e61 to 0x509439c 2024-09-12T05:21:50.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:50.186 INFO:teuthology.orchestra.run.smithi059.stdout:4746 writesame 0x3e6da25 thru 0x3e7c544 data_size 0x42(0xeb20 bytes) 2024-09-12T05:21:50.190 INFO:teuthology.orchestra.run.smithi059.stdout:4750 write 0x2fb1f6 thru 0x302e8c (0x7c97 bytes) 2024-09-12T05:21:50.219 INFO:teuthology.orchestra.run.smithi059.stdout:4751 write 0xe2de80a thru 0xe2e6958 (0x814f bytes) 2024-09-12T05:21:50.219 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:50.219+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:50.228 INFO:teuthology.orchestra.run.smithi059.stdout:truncating to largest ever: 0xee1f939 2024-09-12T05:21:50.229 INFO:teuthology.orchestra.run.smithi059.stdout:4752 trunc from 0xe2e6959 to 0xee1f939 2024-09-12T05:21:50.237 INFO:teuthology.orchestra.run.smithi059.stdout:4753 read 0xc329405 thru 0xc32e72e (0x532a bytes) 2024-09-12T05:21:50.237 INFO:teuthology.orchestra.run.smithi059.stdout:4755 read 0xbd0d921 thru 0xbd0ec74 (0x1354 bytes) 2024-09-12T05:21:50.238 INFO:teuthology.orchestra.run.smithi059.stdout:4757 punch from 0xdf68cbb to 0xdf77ad9, (0xee1e bytes) 2024-09-12T05:21:50.238 INFO:teuthology.orchestra.run.smithi059.stdout:4758 write 0x254363f thru 0x25456a4 (0x2066 bytes) 2024-09-12T05:21:50.241 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.242 INFO:teuthology.orchestra.run.smithi059.stdout:4761 read 0xcaae205 thru 0xcab8aac (0xa8a8 bytes) 2024-09-12T05:21:50.242 INFO:teuthology.orchestra.run.smithi059.stdout:4762 write 0x65c262d thru 0x65c5d6b (0x373f bytes) 2024-09-12T05:21:50.247 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.247 INFO:teuthology.orchestra.run.smithi059.stdout:4764 read 0x92cd66c thru 0x92d1199 (0x3b2e bytes) 2024-09-12T05:21:50.247 INFO:teuthology.orchestra.run.smithi059.stdout:4765 write 0x454c8cf thru 0x4552e04 (0x6536 bytes) 2024-09-12T05:21:50.251 INFO:teuthology.orchestra.run.smithi059.stdout:4766 write 0x3253480 thru 0x3254a96 (0x1617 bytes) 2024-09-12T05:21:50.254 INFO:teuthology.orchestra.run.smithi059.stdout:4767 read 0xc4e91e4 thru 0xc4f793e (0xe75b bytes) 2024-09-12T05:21:50.254 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.254 INFO:teuthology.orchestra.run.smithi059.stdout:4769 writesame 0x1983d7f thru 0x198a0aa data_size 0x16(0x632c bytes) 2024-09-12T05:21:50.259 INFO:teuthology.orchestra.run.smithi059.stdout:4770 read 0x162fe5d thru 0x163420f (0x43b3 bytes) 2024-09-12T05:21:50.260 INFO:teuthology.orchestra.run.smithi059.stdout:4772 writesame 0x18e5292 thru 0x18e5310 data_size 0x1(0x7f bytes) 2024-09-12T05:21:50.263 INFO:teuthology.orchestra.run.smithi059.stdout:4773 read 0xe849330 thru 0xe84fab5 (0x6786 bytes) 2024-09-12T05:21:50.264 INFO:teuthology.orchestra.run.smithi059.stdout:4774 write 0x3edb255 thru 0x3ede210 (0x2fbc bytes) 2024-09-12T05:21:50.266 INFO:teuthology.orchestra.run.smithi059.stdout:4775 write 0xd3ea4a9 thru 0xd3fa186 (0xfcde bytes) 2024-09-12T05:21:50.277 INFO:teuthology.orchestra.run.smithi059.stdout:4776 read 0x6a22b33 thru 0x6a274cb (0x4999 bytes) 2024-09-12T05:21:50.278 INFO:teuthology.orchestra.run.smithi059.stdout:4778 read 0x4f852e8 thru 0x4f8faee (0xa807 bytes) 2024-09-12T05:21:50.297 INFO:teuthology.orchestra.run.smithi059.stdout:4779 trunc from 0xee1f939 to 0x4c2e02d 2024-09-12T05:21:50.319 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:50.319+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:50.323 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:50.324 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:50.347 INFO:teuthology.orchestra.run.smithi059.stdout:4780 write 0xda2dbcf thru 0xda3c4bf (0xe8f1 bytes) 2024-09-12T05:21:50.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:50.361 INFO:teuthology.orchestra.run.smithi059.stdout:4782 punch from 0x3aa01fd to 0x3aa510c, (0x4f0f bytes) 2024-09-12T05:21:50.361 INFO:teuthology.orchestra.run.smithi059.stdout:4783 writesame 0x1c47b0b thru 0x1c4d4c7 data_size 0x1(0x59bd bytes) 2024-09-12T05:21:50.384 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.384 INFO:teuthology.orchestra.run.smithi059.stdout:4787 write 0x2e61abf thru 0x2e67d28 (0x626a bytes) 2024-09-12T05:21:50.387 INFO:teuthology.orchestra.run.smithi059.stdout:4788 read 0xabeba3d thru 0xabf9e31 (0xe3f5 bytes) 2024-09-12T05:21:50.387 INFO:teuthology.orchestra.run.smithi059.stdout:4789 read 0x7e6c5b thru 0x7ec033 (0x53d9 bytes) 2024-09-12T05:21:50.389 INFO:teuthology.orchestra.run.smithi059.stdout:4790 punch from 0x307aa8b to 0x3083b0d, (0x9082 bytes) 2024-09-12T05:21:50.389 INFO:teuthology.orchestra.run.smithi059.stdout:4791 punch from 0x27de725 to 0x27e981e, (0xb0f9 bytes) 2024-09-12T05:21:50.399 INFO:teuthology.orchestra.run.smithi059.stdout:4792 write 0xe901a86 thru 0xe90835f (0x68da bytes) 2024-09-12T05:21:50.408 INFO:teuthology.orchestra.run.smithi059.stdout:4795 read 0x928198 thru 0x9301f9 (0x8062 bytes) 2024-09-12T05:21:50.409 INFO:teuthology.orchestra.run.smithi059.stdout:4796 write 0x6c26033 thru 0x6c261d8 (0x1a6 bytes) 2024-09-12T05:21:50.412 INFO:teuthology.orchestra.run.smithi059.stdout:4798 writesame 0xbe01a33 thru 0xbe0c5f4 data_size 0x5(0xabc2 bytes) 2024-09-12T05:21:50.420 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:50.419+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:50.423 INFO:teuthology.orchestra.run.smithi059.stdout:4799 write 0x24d26ac thru 0x24dd2ac (0xac01 bytes) 2024-09-12T05:21:50.428 INFO:teuthology.orchestra.run.smithi059.stdout:4800 write 0x2f097e2 thru 0x2f12cfa (0x9519 bytes) 2024-09-12T05:21:50.429 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:50.433 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.433 INFO:teuthology.orchestra.run.smithi059.stdout:4802 read 0xcde1b1 thru 0xcecc66 (0xeab6 bytes) 2024-09-12T05:21:50.433 INFO:teuthology.orchestra.run.smithi059.stdout:4803 read 0x4d1bde6 thru 0x4d21d54 (0x5f6f bytes) 2024-09-12T05:21:50.434 INFO:teuthology.orchestra.run.smithi059.stdout:4805 write 0xaf85c73 thru 0xaf8a81a (0x4ba8 bytes) 2024-09-12T05:21:50.441 INFO:teuthology.orchestra.run.smithi059.stdout:4806 read 0xd71f998 thru 0xd7254c6 (0x5b2f bytes) 2024-09-12T05:21:50.441 INFO:teuthology.orchestra.run.smithi059.stdout:4808 writesame 0x6455c9e thru 0x64604ef data_size 0x3e(0xa852 bytes) 2024-09-12T05:21:50.447 INFO:teuthology.orchestra.run.smithi059.stdout:4809 read 0x91e1fcc thru 0x91effe3 (0xe018 bytes) 2024-09-12T05:21:50.448 INFO:teuthology.orchestra.run.smithi059.stdout:4810 punch from 0x73d88ec to 0x73e8098, (0xf7ac bytes) 2024-09-12T05:21:50.448 INFO:teuthology.orchestra.run.smithi059.stdout:4811 writesame 0xa1798e thru 0xa21bbb data_size 0x1(0xa22e bytes) 2024-09-12T05:21:50.480 INFO:teuthology.orchestra.run.smithi059.stdout:4812 writesame 0x550585 thru 0x55bc02 data_size 0x1(0xb67e bytes) 2024-09-12T05:21:50.496 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:50.496 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:50.504 INFO:teuthology.orchestra.run.smithi059.stdout:4813 write 0xe8a8ebb thru 0xe8a9e75 (0xfbb bytes) 2024-09-12T05:21:50.509 INFO:teuthology.orchestra.run.smithi059.stdout:4815 read 0x88eb5da thru 0x88f9c1d (0xe644 bytes) 2024-09-12T05:21:50.510 INFO:teuthology.orchestra.run.smithi059.stdout:4816 punch from 0x45413b5 to 0x454dbad, (0xc7f8 bytes) 2024-09-12T05:21:50.510 INFO:teuthology.orchestra.run.smithi059.stdout:4817 read 0xe1992d4 thru 0xe19d870 (0x459d bytes) 2024-09-12T05:21:50.510 INFO:teuthology.orchestra.run.smithi059.stdout:4818 read 0x86b78c3 thru 0x86c50d3 (0xd811 bytes) 2024-09-12T05:21:50.511 INFO:teuthology.orchestra.run.smithi059.stdout:4819 write 0x2b53335 thru 0x2b5fd7c (0xca48 bytes) 2024-09-12T05:21:50.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:50.521 INFO:teuthology.orchestra.run.smithi059.stdout:4820 trunc from 0xe908360 to 0xa0f61d6 2024-09-12T05:21:50.522 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:50.523+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:50.547 INFO:teuthology.orchestra.run.smithi059.stdout:4821 read 0x8370275 thru 0x8380055 (0xfde1 bytes) 2024-09-12T05:21:50.547 INFO:teuthology.orchestra.run.smithi059.stdout:4823 write 0x7976b26 thru 0x797e2cf (0x77aa bytes) 2024-09-12T05:21:50.549 INFO:teuthology.orchestra.run.smithi059.stdout:4824 punch from 0x85239bc to 0x8527c49, (0x428d bytes) 2024-09-12T05:21:50.549 INFO:teuthology.orchestra.run.smithi059.stdout:4825 write 0x35ef0ca thru 0x35f986e (0xa7a5 bytes) 2024-09-12T05:21:50.555 INFO:teuthology.orchestra.run.smithi059.stdout:4826 punch from 0x2ca381f to 0x2cab314, (0x7af5 bytes) 2024-09-12T05:21:50.555 INFO:teuthology.orchestra.run.smithi059.stdout:4827 read 0x554ebcb thru 0x555d0e0 (0xe516 bytes) 2024-09-12T05:21:50.555 INFO:teuthology.orchestra.run.smithi059.stdout:4828 read 0xa07c023 thru 0xa0848dd (0x88bb bytes) 2024-09-12T05:21:50.564 INFO:teuthology.orchestra.run.smithi059.stdout:4829 writesame 0xb31e21e thru 0xb32399e data_size 0x39(0x5781 bytes) 2024-09-12T05:21:50.575 INFO:teuthology.orchestra.run.smithi059.stdout:4830 writesame 0xcb05744 thru 0xcb135d3 data_size 0x18(0xde90 bytes) 2024-09-12T05:21:50.577 INFO:teuthology.orchestra.run.smithi059.stdout:4831 read 0xc88943d thru 0xc8900e8 (0x6cac bytes) 2024-09-12T05:21:50.577 INFO:teuthology.orchestra.run.smithi059.stdout:4834 write 0x5ed0b1c thru 0x5edb71a (0xabff bytes) 2024-09-12T05:21:50.580 INFO:teuthology.orchestra.run.smithi059.stdout:4837 write 0x9b13643 thru 0x9b225dc (0xef9a bytes) 2024-09-12T05:21:50.585 INFO:teuthology.orchestra.run.smithi059.stdout:4838 read 0xca0431b thru 0xca06055 (0x1d3b bytes) 2024-09-12T05:21:50.585 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.585 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.585 INFO:teuthology.orchestra.run.smithi059.stdout:4841 writesame 0x269686d thru 0x26a6008 data_size 0x6a(0xf79c bytes) 2024-09-12T05:21:50.590 INFO:teuthology.orchestra.run.smithi059.stdout:4842 write 0xbb80eff thru 0xbb8da22 (0xcb24 bytes) 2024-09-12T05:21:50.594 INFO:teuthology.orchestra.run.smithi059.stdout:4843 write 0x8aba194 thru 0x8ac058e (0x63fb bytes) 2024-09-12T05:21:50.597 INFO:teuthology.orchestra.run.smithi059.stdout:4844 writesame 0x661c78c thru 0x661f11f data_size 0x6(0x2994 bytes) 2024-09-12T05:21:50.599 INFO:teuthology.orchestra.run.smithi059.stdout:4846 write 0x430c4e1 thru 0x430f8b2 (0x33d2 bytes) 2024-09-12T05:21:50.605 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:50.605 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:50.613 INFO:teuthology.orchestra.run.smithi059.stdout:4848 trunc from 0xcb135d4 to 0x490b345 2024-09-12T05:21:50.623 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:50.623+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:50.626 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:50.645 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:4849 write 0xafa56ba thru 0xafa8473 (0x2dba bytes) 2024-09-12T05:21:50.657 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:50.657 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:4850 write 0xb4b6f1e thru 0xb4bb3fc (0x44df bytes) 2024-09-12T05:21:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:4851 read 0xb36b94a thru 0xb37a5cf (0xec86 bytes) 2024-09-12T05:21:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:4853 punch from 0x267b86 to 0x26a427, (0x28a1 bytes) 2024-09-12T05:21:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:4854 read 0x6d54a8b thru 0x6d56d92 (0x2308 bytes) 2024-09-12T05:21:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:4855 punch from 0x2f96f97 to 0x2f99ff7, (0x3060 bytes) 2024-09-12T05:21:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:4856 writesame 0xa6f2262 thru 0xa6f5937 data_size 0x1(0x36d6 bytes) 2024-09-12T05:21:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:4858 read 0x8c0ccdb thru 0x8c181df (0xb505 bytes) 2024-09-12T05:21:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:4861 write 0x958ddf1 thru 0x959cbf4 (0xee04 bytes) 2024-09-12T05:21:50.672 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:4862 trunc from 0xb4bb3fd to 0x72a4ae3 2024-09-12T05:21:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:4863 write 0x900e900 thru 0x9018f4b (0xa64c bytes) 2024-09-12T05:21:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:4866 writesame 0xa646eb4 thru 0xa647801 data_size 0x3(0x94e bytes) 2024-09-12T05:21:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:4867 write 0x62bbf86 thru 0x62c1692 (0x570d bytes) 2024-09-12T05:21:50.723 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:50.723+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:4869 writesame 0x82730ca thru 0x8280f00 data_size 0x1(0xde37 bytes) 2024-09-12T05:21:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:4871 punch from 0x56fea57 to 0x56ff995, (0xf3e bytes) 2024-09-12T05:21:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:4872 read 0x73ab7fe thru 0x73adf91 (0x2794 bytes) 2024-09-12T05:21:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:4875 punch from 0x3c2956b to 0x3c38d81, (0xf816 bytes) 2024-09-12T05:21:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:4876 write 0x976786a thru 0x976e49c (0x6c33 bytes) 2024-09-12T05:21:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:4877 write 0x246c349 thru 0x2477aa4 (0xb75c bytes) 2024-09-12T05:21:50.746 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:50.746 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:4878 write 0x1b784c6 thru 0x1b8565e (0xd199 bytes) 2024-09-12T05:21:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:4879 write 0xa392a87 thru 0xa397ad1 (0x504b bytes) 2024-09-12T05:21:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:4880 read 0x6a5d05f thru 0x6a68ee1 (0xbe83 bytes) 2024-09-12T05:21:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:4881 read 0x3b75b9b thru 0x3b83e5b (0xe2c1 bytes) 2024-09-12T05:21:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:4882 punch from 0x97e5c04 to 0x97ea382, (0x477e bytes) 2024-09-12T05:21:50.766 INFO:teuthology.orchestra.run.smithi059.stdout:4883 write 0xc3c2aed thru 0xc3d0468 (0xd97c bytes) 2024-09-12T05:21:50.771 INFO:teuthology.orchestra.run.smithi059.stdout:4884 clone 38 order 21 su 1048576 sc 12 2024-09-12T05:21:50.799 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:50.799 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:50.799 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:50.800 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:50.800 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:50.815 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:50.825 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:50.827+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:50.926 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:50.923+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:50.940 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.437631873000001, 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:21:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.437600224000001, 2024-09-12T05:21:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:21:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:21:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.437564081, 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:21:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:21:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.437533271, 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.437502712000001, 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.437472816, 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:21:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.435715872999999, 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:21:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.435672304000001, 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:21:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:21:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:21:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.435440414, 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:21:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.435319503000001, 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:21:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:21:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.435202465, 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:21:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.435082856999999, 2024-09-12T05:21:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101774 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4833280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.432136903, 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090801491999999998, 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101774 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507679+0000", 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2399999999999996e-07 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507682+0000", 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507691+0000", 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3230000000000004e-06 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507698+0000", 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1400000000000002e-06 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598168+0000", 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090470153999999997 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598305+0000", 2024-09-12T05:21:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136935 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598479+0000", 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0001738 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.432104130000001, 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:21:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.432069823999999, 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:21:51.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:21:51.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.432037648, 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:21:51.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:21:51.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:21:51.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.431976032, 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:21:51.013 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:21:51.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:21:51.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:21:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.431920676000001, 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:21:51.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:51.022 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.431865869999999, 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:51.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.026 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:21:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.431706196, 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:51.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:21:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:21:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.032 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:51.032 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6, 2] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:21:51.032 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:51.032 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-12T05:21:51.032 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T05:21:51.033 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T05:21:51.033 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-12T05:21:51.034 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:51.035 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:51.035+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:51.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:21:51.135 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:51.135+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:51.150 INFO:teuthology.orchestra.run.smithi059.stdout:flattening image image_client.0-clone37 2024-09-12T05:21:51.176 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T05:21:51.177 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:51.205 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:51.205 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:51.219 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:51.269 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:51.267+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:51.337 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:51.339+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:51.337 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-12T05:21:51.344 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:51.344 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:51.344 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:51.344 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:51.345 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:51.359 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:51.360 INFO:teuthology.orchestra.run.smithi059.stdout:4885 trunc from 0xc3d0469 to 0x76ac08c 2024-09-12T05:21:51.385 INFO:teuthology.orchestra.run.smithi059.stdout:4886 write 0x12fccb8 thru 0x13042e1 (0x762a bytes) 2024-09-12T05:21:51.414 INFO:teuthology.orchestra.run.smithi059.stdout:4888 write 0x134ffcb thru 0x13563ef (0x6425 bytes) 2024-09-12T05:21:51.418 INFO:teuthology.orchestra.run.smithi059.stdout:4891 write 0x300c6b6 thru 0x301c5e9 (0xff34 bytes) 2024-09-12T05:21:51.427 INFO:teuthology.orchestra.run.smithi059.stdout:4892 write 0x3494ffe thru 0x349cede (0x7ee1 bytes) 2024-09-12T05:21:51.437 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:51.439+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:51.450 INFO:teuthology.orchestra.run.smithi059.stdout:4893 write 0xc86830b thru 0xc868fd7 (0xccd bytes) 2024-09-12T05:21:51.455 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:51.455 INFO:teuthology.orchestra.run.smithi059.stdout:4895 writesame 0x80112dc thru 0x8020ea8 data_size 0x1(0xfbcd bytes) 2024-09-12T05:21:51.526 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.353988654000005, 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.527 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:51.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.531 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.353287133999999, 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:21:51.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.536 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.353164399999997, 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:21:51.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.353102187000005, 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.541 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.542 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:21:51.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.542 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:21:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.546 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.353035370000001, 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:21:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:21:51.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352975337000004, 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.552 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:21:51.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:21:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352895400999998, 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.557 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:21:51.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:21:51.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352835839999997, 2024-09-12T05:21:51.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:21:51.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352761051000002, 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:21:51.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:51.570 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352623651000002, 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352471915999999, 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:21:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352408941999997, 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.579 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:21:51.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:21:51.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352273049999994, 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:21:51.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:21:51.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352209090000002, 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:21:51.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:21:51.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352124837000005, 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:21:51.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:21:51.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:51.597 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352065476999996, 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:21:51.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:21:51.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:21:51.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.352005210000002, 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:21:51.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.351942217000001, 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.607 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.351781609, 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:51.612 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:51.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.616 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.908549895, 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:21:51.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:21:51.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:21:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:51.621 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:4896 trunc from 0xc868fd8 to 0x7a94a68 2024-09-12T05:21:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:4897 read 0x262e841 thru 0x26381a0 (0x9960 bytes) 2024-09-12T05:21:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:4898 write 0x7f5d3eb thru 0x7f6147e (0x4094 bytes) 2024-09-12T05:21:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:4899 write 0xe9085a6 thru 0xe9148a9 (0xc304 bytes) 2024-09-12T05:21:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:4902 read 0xde36400 thru 0xde4513b (0xed3c bytes) 2024-09-12T05:21:51.623 INFO:teuthology.orchestra.run.smithi059.stdout:4903 write 0x23a1b60 thru 0x23aa1a7 (0x8648 bytes) 2024-09-12T05:21:51.624 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:51.624 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:51.623+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:51.630 INFO:teuthology.orchestra.run.smithi059.stdout:4904 write 0x6e74848 thru 0x6e7b97d (0x7136 bytes) 2024-09-12T05:21:51.641 INFO:teuthology.orchestra.run.smithi059.stdout:4905 read 0x9e8435b thru 0x9e88c73 (0x4919 bytes) 2024-09-12T05:21:51.642 INFO:teuthology.orchestra.run.smithi059.stdout:4906 write 0x24516ff thru 0x245d9fd (0xc2ff bytes) 2024-09-12T05:21:51.656 INFO:teuthology.orchestra.run.smithi059.stdout:4907 writesame 0xdc80e79 thru 0xdc81cf6 data_size 0x23(0xe7e bytes) 2024-09-12T05:21:51.663 INFO:teuthology.orchestra.run.smithi059.stdout:4908 write 0x4ee4b37 thru 0x4eec551 (0x7a1b bytes) 2024-09-12T05:21:51.673 INFO:teuthology.orchestra.run.smithi059.stdout:4909 punch from 0xc5f09c4 to 0xc5f6925, (0x5f61 bytes) 2024-09-12T05:21:51.673 INFO:teuthology.orchestra.run.smithi059.stdout:4910 read 0xd67f8ad thru 0xd68488a (0x4fde bytes) 2024-09-12T05:21:51.674 INFO:teuthology.orchestra.run.smithi059.stdout:4912 write 0x8cab5bc thru 0x8cba290 (0xecd5 bytes) 2024-09-12T05:21:51.680 INFO:teuthology.orchestra.run.smithi059.stdout:4913 write 0xd21f24d thru 0xd22aaee (0xb8a2 bytes) 2024-09-12T05:21:51.686 INFO:teuthology.orchestra.run.smithi059.stdout:4914 clone 39 order 22 su 65536 sc 5 2024-09-12T05:21:51.724 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:51.723+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:51.755 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:51.756 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:51.769 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:51.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:51.823+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:51.891 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:51.892 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:51.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:51.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:51.947+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:52.027 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:52.023+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:52.027 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:21:52.078 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:52.078 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:52.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:52.078 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8377002759999996, 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:21:52.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:21:52.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:21:52.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8366865539999999, 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.085 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:21:52.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:52.091 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8359926929999997, 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.092 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:21:52.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:21:52.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.097 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8330078499999996, 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:21:52.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:21:52.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8327665250000003, 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.105 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.105 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:21:52.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.106 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:52.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:21:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:21:52.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:52.111 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.832018315, 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:21:52.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:21:52.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:21:52.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:21:52.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:21:52.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:21:52.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:21:52.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:21:52.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:21:52.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:21:52.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.119 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8317065540000002, 2024-09-12T05:21:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:21:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:21:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:21:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:21:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:21:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:21:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:21:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:21:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:21:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:21:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:21:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:21:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:21:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:21:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:21:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:21:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:21:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:21:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:21:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:21:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:21:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:21:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.830983593, 2024-09-12T05:21:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:21:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:21:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:21:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:21:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:21:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:21:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:21:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:21:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:21:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:21:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:21:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:21:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:21:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:21:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:21:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:21:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:21:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:21:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8296846740000001, 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:21:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:21:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:21:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:21:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:21:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:21:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:21:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:21:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:21:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:21:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:21:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:21:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:21:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:21:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:21:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:21:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:21:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8271329200000004, 2024-09-12T05:21:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:21:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.159 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:21:52.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:21:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:21:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:21:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:21:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:21:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:21:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:21:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:21:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:21:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:21:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:21:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:21:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:21:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:21:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:21:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:21:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:21:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:21:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:21:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:21:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8263544300000003, 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:21:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:21:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:21:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:21:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:21:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:21:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:21:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:21:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8260820889999998, 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:21:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8248058030000003, 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:21:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:21:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8234031870000003, 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:21:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:21:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8226876860000001, 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:21:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:21:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8213662900000003, 2024-09-12T05:21:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:21:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8202896449999999, 2024-09-12T05:21:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:21:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:21:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8200669009999997, 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:21:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8194458620000002, 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:21:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.8177977290000005, 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:21:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:52.229 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:52.230 INFO:teuthology.orchestra.run.smithi059.stdout:leaving image image_client.0-clone38 intact 2024-09-12T05:21:52.231 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:52.227+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:52.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:52.332 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:52.331+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:52.363 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:52.363 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:52.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:52.403 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-12T05:21:52.449 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:52.451+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:52.533 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:52.535+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:52.547 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:52.547 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:52.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:52.635 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:52.635+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:52.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:52.735+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:52.744 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:52.744 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:52.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.623708090000001, 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:21:52.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.293107020000001, 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.751 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:52.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:21:52.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:21:52.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.166546582000002, 2024-09-12T05:21:52.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:21:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.166021057000002, 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:21:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:21:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.165998508999998, 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:21:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.165976719, 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.165955353999998, 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:21:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:21:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.165932808999997, 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:21:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:21:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.165910574000002, 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:21:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.165888989999999, 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.165687591000001, 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:21:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:21:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.165662191000003, 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:21:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:21:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.158388914, 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:21:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:21:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.158366524000002, 2024-09-12T05:21:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:21:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.158343876000004, 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:21:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.158323387000003, 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:21:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.158297322000003, 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:21:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.158274104999997, 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:21:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.158251741000001, 2024-09-12T05:21:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.681711364999998, 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:21:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:21:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:21:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:52.842 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:52.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:52.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:52.844 INFO:teuthology.orchestra.run.smithi059.stdout:4915 trunc from 0xe9148aa to 0x294557 2024-09-12T05:21:52.845 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:52.839+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:52.896 INFO:teuthology.orchestra.run.smithi059.stdout:4916 punch from 0x1d3e94 to 0x1d9e1e, (0x5f8a bytes) 2024-09-12T05:21:52.937 INFO:teuthology.orchestra.run.smithi059.stdout:4917 write 0xe93e102 thru 0xe941f13 (0x3e12 bytes) 2024-09-12T05:21:52.944 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:52.943+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:52.946 INFO:teuthology.orchestra.run.smithi059.stdout:4918 write 0x46b4ed8 thru 0x46b7245 (0x236e bytes) 2024-09-12T05:21:52.952 INFO:teuthology.orchestra.run.smithi059.stdout:4919 writesame 0xa01dda2 thru 0xa022d31 data_size 0x4c(0x4f90 bytes) 2024-09-12T05:21:52.959 INFO:teuthology.orchestra.run.smithi059.stdout:4920 write 0xafe8778 thru 0xafe91f6 (0xa7f bytes) 2024-09-12T05:21:52.965 INFO:teuthology.orchestra.run.smithi059.stdout:4924 writesame 0x555c4fc thru 0x555f750 data_size 0x5(0x3255 bytes) 2024-09-12T05:21:52.972 INFO:teuthology.orchestra.run.smithi059.stdout:4926 read 0x28aec30 thru 0x28b666f (0x7a40 bytes) 2024-09-12T05:21:52.972 INFO:teuthology.orchestra.run.smithi059.stdout:4927 write 0x225d2a8 thru 0x2267711 (0xa46a bytes) 2024-09-12T05:21:52.979 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:52.979 INFO:teuthology.orchestra.run.smithi059.stdout:4929 write 0xd4c83de thru 0xd4c8ee2 (0xb05 bytes) 2024-09-12T05:21:52.985 INFO:teuthology.orchestra.run.smithi059.stdout:4930 punch from 0x772fb9c to 0x773f4f9, (0xf95d bytes) 2024-09-12T05:21:52.985 INFO:teuthology.orchestra.run.smithi059.stdout:4931 writesame 0x33f3ac6 thru 0x33f711a data_size 0x1(0x3655 bytes) 2024-09-12T05:21:53.001 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:53.001 INFO:teuthology.orchestra.run.smithi059.stdout:4934 read 0x2c2443e thru 0x2c28750 (0x4313 bytes) 2024-09-12T05:21:53.001 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:53.001 INFO:teuthology.orchestra.run.smithi059.stdout:4937 read 0x9d1a2a1 thru 0x9d1eccd (0x4a2d bytes) 2024-09-12T05:21:53.002 INFO:teuthology.orchestra.run.smithi059.stdout:4938 read 0x4a14d64 thru 0x4a22497 (0xd734 bytes) 2024-09-12T05:21:53.002 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:53.003 INFO:teuthology.orchestra.run.smithi059.stdout:4941 write 0xe31d082 thru 0xe325347 (0x82c6 bytes) 2024-09-12T05:21:53.017 INFO:teuthology.orchestra.run.smithi059.stdout:4943 trunc from 0xe941f14 to 0xa844f9f 2024-09-12T05:21:53.031 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:53.032 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:53.043 INFO:teuthology.orchestra.run.smithi059.stdout:4945 punch from 0x90575b3 to 0x9060a7c, (0x94c9 bytes) 2024-09-12T05:21:53.044 INFO:teuthology.orchestra.run.smithi059.stdout:4946 read 0x4021f5b thru 0x4030b40 (0xebe6 bytes) 2024-09-12T05:21:53.044 INFO:teuthology.orchestra.run.smithi059.stdout:4947 write 0x9962203 thru 0x996b382 (0x9180 bytes) 2024-09-12T05:21:53.045 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:53.047+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:53.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:53.062 INFO:teuthology.orchestra.run.smithi059.stdout:4948 trunc from 0xa844f9f to 0x2454a34 2024-09-12T05:21:53.070 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:53.070 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:53.089 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:53.109 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:53.109 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:53.110 INFO:teuthology.orchestra.run.smithi059.stdout:4950 writesame 0x42b7e6e thru 0x42c4576 data_size 0x1d(0xc709 bytes) 2024-09-12T05:21:53.110 INFO:teuthology.orchestra.run.smithi059.stdout:4951 read 0x3747c4f thru 0x3757188 (0xf53a bytes) 2024-09-12T05:21:53.110 INFO:teuthology.orchestra.run.smithi059.stdout:4952 read 0x1f9ffe0 thru 0x1fa9be2 (0x9c03 bytes) 2024-09-12T05:21:53.110 INFO:teuthology.orchestra.run.smithi059.stdout:4953 read 0x30162f6 thru 0x301c2e7 (0x5ff2 bytes) 2024-09-12T05:21:53.126 INFO:teuthology.orchestra.run.smithi059.stdout:4954 writesame 0x574017b thru 0x57458a9 data_size 0x1(0x572f bytes) 2024-09-12T05:21:53.126 INFO:teuthology.orchestra.run.smithi059.stdout:4955 punch from 0x77fa66 to 0x78111b, (0x16b5 bytes) 2024-09-12T05:21:53.126 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:53.126 INFO:teuthology.orchestra.run.smithi059.stdout:4957 read 0x46ff5ea thru 0x46ff89d (0x2b4 bytes) 2024-09-12T05:21:53.126 INFO:teuthology.orchestra.run.smithi059.stdout:4958 write 0x39d6cc5 thru 0x39e58f1 (0xec2d bytes) 2024-09-12T05:21:53.128 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:53.134 INFO:teuthology.orchestra.run.smithi059.stdout:4960 punch from 0x5292e0f to 0x52a036f, (0xd560 bytes) 2024-09-12T05:21:53.146 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:53.143+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:53.158 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:53.164 INFO:teuthology.orchestra.run.smithi059.stdout:4961 write 0xde0d71e thru 0xde1ac96 (0xd579 bytes) 2024-09-12T05:21:53.169 INFO:teuthology.orchestra.run.smithi059.stdout:4962 read 0x18be250 thru 0x18cd8eb (0xf69c bytes) 2024-09-12T05:21:53.182 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:53.183 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:53.183 INFO:teuthology.orchestra.run.smithi059.stdout:4964 write 0xe0f8604 thru 0xe0f94bd (0xeba bytes) 2024-09-12T05:21:53.186 INFO:teuthology.orchestra.run.smithi059.stdout:4965 punch from 0x1b0e72 to 0x1b0f94, (0x122 bytes) 2024-09-12T05:21:53.189 INFO:teuthology.orchestra.run.smithi059.stdout:4967 trunc from 0xe0f94be to 0xcc707b8 2024-09-12T05:21:53.191 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:53.191 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:53.208 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:53.209 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:53.210 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:53.210 INFO:teuthology.orchestra.run.smithi059.stdout:4971 writesame 0xc80d550 thru 0xc81b73f data_size 0x1e(0xe1f0 bytes) 2024-09-12T05:21:53.212 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:53.213 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:53.217 INFO:teuthology.orchestra.run.smithi059.stdout:4972 write 0x466c0e8 thru 0x4677e74 (0xbd8d bytes) 2024-09-12T05:21:53.223 INFO:teuthology.orchestra.run.smithi059.stdout:4973 write 0xbc47532 thru 0xbc55b20 (0xe5ef bytes) 2024-09-12T05:21:53.229 INFO:teuthology.orchestra.run.smithi059.stdout:4975 write 0xcbe7d4 thru 0xcc7664 (0x8e91 bytes) 2024-09-12T05:21:53.245 INFO:teuthology.orchestra.run.smithi059.stdout:4976 writesame 0xea824f5 thru 0xea88759 data_size 0x1(0x6265 bytes) 2024-09-12T05:21:53.245 INFO:teuthology.orchestra.run.smithi059.stdout:4977 write 0x3e4ce65 thru 0x3e57887 (0xaa23 bytes) 2024-09-12T05:21:53.246 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:53.243+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:53.249 INFO:teuthology.orchestra.run.smithi059.stdout:4978 punch from 0xd944f24 to 0xd95097a, (0xba56 bytes) 2024-09-12T05:21:53.249 INFO:teuthology.orchestra.run.smithi059.stdout:4979 write 0x63359cf thru 0x6345291 (0xf8c3 bytes) 2024-09-12T05:21:53.256 INFO:teuthology.orchestra.run.smithi059.stdout:4981 writesame 0x259a213 thru 0x25a3c6d data_size 0x7(0x9a5b bytes) 2024-09-12T05:21:53.264 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:53.264 INFO:teuthology.orchestra.run.smithi059.stdout:4983 read 0x6315372 thru 0x63198d7 (0x4566 bytes) 2024-09-12T05:21:53.264 INFO:teuthology.orchestra.run.smithi059.stdout:4986 punch from 0x8898b0 to 0x890a31, (0x7181 bytes) 2024-09-12T05:21:53.264 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:53.264 INFO:teuthology.orchestra.run.smithi059.stdout:4989 punch from 0x8eb883d to 0x8ec4a1a, (0xc1dd bytes) 2024-09-12T05:21:53.269 INFO:teuthology.orchestra.run.smithi059.stdout:4990 trunc from 0xea8875a to 0xb3fba85 2024-09-12T05:21:53.287 INFO:teuthology.orchestra.run.smithi059.stdout:4991 write 0x6fd9741 thru 0x6fe6658 (0xcf18 bytes) 2024-09-12T05:21:53.304 INFO:teuthology.orchestra.run.smithi059.stdout:4993 trunc from 0xb3fba85 to 0x39a2800 2024-09-12T05:21:53.329 INFO:teuthology.orchestra.run.smithi059.stdout:4995 trunc from 0x39a2800 to 0x6aa455e 2024-09-12T05:21:53.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:53.343+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:53.349 INFO:teuthology.orchestra.run.smithi059.stdout:4996 trunc from 0x6aa455e to 0xd03f333 2024-09-12T05:21:53.350 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:53.350 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:53.361 INFO:teuthology.orchestra.run.smithi059.stdout:4997 read 0x3efe271 thru 0x3f01ed4 (0x3c64 bytes) 2024-09-12T05:21:53.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:53.375 INFO:teuthology.orchestra.run.smithi059.stdout:4999 writesame 0xe1d9855 thru 0xe1db37b data_size 0x7(0x1b27 bytes) 2024-09-12T05:21:53.375 INFO:teuthology.orchestra.run.smithi059.stdout:5000 read 0xaa6f78 thru 0xaa8869 (0x18f2 bytes) 2024-09-12T05:21:53.377 INFO:teuthology.orchestra.run.smithi059.stdout:5001 clone 40 order 23 su 1048576 sc 13 2024-09-12T05:21:53.448 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:53.447+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:53.492 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:53.678 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:53.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:53.680 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:53.679+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:53.780 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:53.779+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:53.854 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:53.854 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:53.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:53.882 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:53.879+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:53.982 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:53.983+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:54.042 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:54.042 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:54.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:21:54.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:54.084 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:54.079+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:54.184 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:54.187+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:54.193 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone39 from 0xe1db37c (overlap 0x294557) to 0x1ce3bc 2024-09-12T05:21:54.239 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:54.239 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:54.255 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:54.301 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:54.303+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:54.317 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-12T05:21:54.387 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:54.383+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:54.434 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:54.434 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:54.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:54.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:54.483+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:54.588 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:54.587+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:54.626 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:54.626 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:54.642 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:54.690 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:54.691+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:54.775 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:54.775 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:54.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:54.790 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:54.791+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:54.824 INFO:teuthology.orchestra.run.smithi059.stdout:5002 writesame 0x6d5806d thru 0x6d67ea4 data_size 0xa(0xfe38 bytes) 2024-09-12T05:21:54.841 INFO:teuthology.orchestra.run.smithi059.stdout:5003 read 0xc105cad thru 0xc109b07 (0x3e5b bytes) 2024-09-12T05:21:54.842 INFO:teuthology.orchestra.run.smithi059.stdout:5005 write 0x6535f1b thru 0x653a798 (0x487e bytes) 2024-09-12T05:21:54.849 INFO:teuthology.orchestra.run.smithi059.stdout:5006 read 0x1877759 thru 0x18831ae (0xba56 bytes) 2024-09-12T05:21:54.850 INFO:teuthology.orchestra.run.smithi059.stdout:5007 punch from 0x2bf176e to 0x2bfe859, (0xd0eb bytes) 2024-09-12T05:21:54.850 INFO:teuthology.orchestra.run.smithi059.stdout:5009 write 0x9b9fd84 thru 0x9bac4ef (0xc76c bytes) 2024-09-12T05:21:54.857 INFO:teuthology.orchestra.run.smithi059.stdout:5011 read 0x9187e55 thru 0x91958a0 (0xda4c bytes) 2024-09-12T05:21:54.857 INFO:teuthology.orchestra.run.smithi059.stdout:5013 read 0x794a0bc thru 0x7955e59 (0xbd9e bytes) 2024-09-12T05:21:54.876 INFO:teuthology.orchestra.run.smithi059.stdout:5015 trunc from 0xe1db37c to 0x2b85984 2024-09-12T05:21:54.891 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:54.891+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:54.917 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:54.917 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:54.934 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:54.941 INFO:teuthology.orchestra.run.smithi059.stdout:5016 read 0x20db7c1 thru 0x20e213f (0x697f bytes) 2024-09-12T05:21:54.942 INFO:teuthology.orchestra.run.smithi059.stdout:5017 read 0x1069ceb thru 0x1076fa2 (0xd2b8 bytes) 2024-09-12T05:21:54.944 INFO:teuthology.orchestra.run.smithi059.stdout:5018 punch from 0x226effe to 0x22750ab, (0x60ad bytes) 2024-09-12T05:21:54.944 INFO:teuthology.orchestra.run.smithi059.stdout:5019 punch from 0x18b13cc to 0x18b3686, (0x22ba bytes) 2024-09-12T05:21:54.944 INFO:teuthology.orchestra.run.smithi059.stdout:5020 read 0x3f6d6e thru 0x400e81 (0xa114 bytes) 2024-09-12T05:21:54.978 INFO:teuthology.orchestra.run.smithi059.stdout:5022 write 0xab65f2c thru 0xab733fc (0xd4d1 bytes) 2024-09-12T05:21:54.985 INFO:teuthology.orchestra.run.smithi059.stdout:5023 read 0x77350f2 thru 0x773d48c (0x839b bytes) 2024-09-12T05:21:54.985 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:54.985 INFO:teuthology.orchestra.run.smithi059.stdout:5025 punch from 0x2f7a014 to 0x2f86ef6, (0xcee2 bytes) 2024-09-12T05:21:54.985 INFO:teuthology.orchestra.run.smithi059.stdout:5027 read 0x15b7c29 thru 0x15c3712 (0xbaea bytes) 2024-09-12T05:21:54.992 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:54.991+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:55.000 INFO:teuthology.orchestra.run.smithi059.stdout:5028 trunc from 0xab733fd to 0x586214f 2024-09-12T05:21:55.031 INFO:teuthology.orchestra.run.smithi059.stdout:5029 read 0x38caf46 thru 0x38d92df (0xe39a bytes) 2024-09-12T05:21:55.036 INFO:teuthology.orchestra.run.smithi059.stdout:5030 trunc from 0x586214f to 0x3f2423d 2024-09-12T05:21:55.058 INFO:teuthology.orchestra.run.smithi059.stdout:5032 writesame 0x211a251 thru 0x21214cb data_size 0x1(0x727b bytes) 2024-09-12T05:21:55.060 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:55.060 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:55.074 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:21:55.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:55.091 INFO:teuthology.orchestra.run.smithi059.stdout:5033 read 0x32a2327 thru 0x32aec19 (0xc8f3 bytes) 2024-09-12T05:21:55.110 INFO:teuthology.orchestra.run.smithi059.stdout:5034 write 0x5c88f1a thru 0x5c8cb8c (0x3c73 bytes) 2024-09-12T05:21:55.113 INFO:teuthology.orchestra.run.smithi059.stdout:5036 read 0x2482f0e thru 0x248fa83 (0xcb76 bytes) 2024-09-12T05:21:55.114 INFO:teuthology.orchestra.run.smithi059.stdout:5037 read 0x59eabcb thru 0x59efc32 (0x5068 bytes) 2024-09-12T05:21:55.114 INFO:teuthology.orchestra.run.smithi059.stdout:5038 read 0x5c8585c thru 0x5c8cb8c (0x7331 bytes) 2024-09-12T05:21:55.115 INFO:teuthology.orchestra.run.smithi059.stdout:5039 write 0x47f92cc thru 0x47fdf45 (0x4c7a bytes) 2024-09-12T05:21:55.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:55.123+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:55.141 INFO:teuthology.orchestra.run.smithi059.stdout:5042 write 0xcf87a35 thru 0xcf8d97b (0x5f47 bytes) 2024-09-12T05:21:55.145 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.145 INFO:teuthology.orchestra.run.smithi059.stdout:5045 read 0xbbbc0a8 thru 0xbbbf30c (0x3265 bytes) 2024-09-12T05:21:55.146 INFO:teuthology.orchestra.run.smithi059.stdout:5046 writesame 0x603f4b7 thru 0x604136c data_size 0x1(0x1eb6 bytes) 2024-09-12T05:21:55.151 INFO:teuthology.orchestra.run.smithi059.stdout:5047 writesame 0x8eb481e thru 0x8eb8619 data_size 0x2(0x3dfc bytes) 2024-09-12T05:21:55.158 INFO:teuthology.orchestra.run.smithi059.stdout:5049 read 0xc4a2fdf thru 0xc4a6c47 (0x3c69 bytes) 2024-09-12T05:21:55.158 INFO:teuthology.orchestra.run.smithi059.stdout:5050 punch from 0x1368320 to 0x1369bec, (0x18cc bytes) 2024-09-12T05:21:55.158 INFO:teuthology.orchestra.run.smithi059.stdout:5051 read 0x663c34c thru 0x664af9f (0xec54 bytes) 2024-09-12T05:21:55.159 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.159 INFO:teuthology.orchestra.run.smithi059.stdout:5053 read 0x636c219 thru 0x636c7de (0x5c6 bytes) 2024-09-12T05:21:55.160 INFO:teuthology.orchestra.run.smithi059.stdout:5054 write 0x8ef2591 thru 0x8eff2ec (0xcd5c bytes) 2024-09-12T05:21:55.163 INFO:teuthology.orchestra.run.smithi059.stdout:5055 punch from 0x1b6625 to 0x1c47a7, (0xe182 bytes) 2024-09-12T05:21:55.163 INFO:teuthology.orchestra.run.smithi059.stdout:5056 read 0x155e834 thru 0x1564ff2 (0x67bf bytes) 2024-09-12T05:21:55.164 INFO:teuthology.orchestra.run.smithi059.stdout:5057 writesame 0x652f68b thru 0x65391ed data_size 0x1(0x9b63 bytes) 2024-09-12T05:21:55.194 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:55.191+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:55.204 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:55.204 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:55.207 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.207 INFO:teuthology.orchestra.run.smithi059.stdout:5059 write 0xa23f893 thru 0xa249e9f (0xa60d bytes) 2024-09-12T05:21:55.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:55.216 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:55.219 INFO:teuthology.orchestra.run.smithi059.stdout:5061 trunc from 0xcf8d97c to 0xe3547d4 2024-09-12T05:21:55.249 INFO:teuthology.orchestra.run.smithi059.stdout:5063 trunc from 0xe3547d4 to 0x6d3b333 2024-09-12T05:21:55.269 INFO:teuthology.orchestra.run.smithi059.stdout:5064 read 0x3022d2 thru 0x302cf8 (0xa27 bytes) 2024-09-12T05:21:55.274 INFO:teuthology.orchestra.run.smithi059.stdout:5065 trunc from 0x6d3b333 to 0x93b9332 2024-09-12T05:21:55.284 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.284 INFO:teuthology.orchestra.run.smithi059.stdout:5068 read 0x68a3cfd thru 0x68a87f6 (0x4afa bytes) 2024-09-12T05:21:55.284 INFO:teuthology.orchestra.run.smithi059.stdout:5069 read 0x3afaaac thru 0x3b038d8 (0x8e2d bytes) 2024-09-12T05:21:55.285 INFO:teuthology.orchestra.run.smithi059.stdout:5070 writesame 0x824a512 thru 0x8250df0 data_size 0x13(0x68df bytes) 2024-09-12T05:21:55.292 INFO:teuthology.orchestra.run.smithi059.stdout:5071 read 0x25c5bfd thru 0x25c7c4f (0x2053 bytes) 2024-09-12T05:21:55.292 INFO:teuthology.orchestra.run.smithi059.stdout:5072 punch from 0x2f46689 to 0x2f5153b, (0xaeb2 bytes) 2024-09-12T05:21:55.293 INFO:teuthology.orchestra.run.smithi059.stdout:5073 read 0x972b90 thru 0x97fe08 (0xd279 bytes) 2024-09-12T05:21:55.293 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.293 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.293 INFO:teuthology.orchestra.run.smithi059.stdout:5076 write 0x31893f0 thru 0x318b3cf (0x1fe0 bytes) 2024-09-12T05:21:55.296 INFO:teuthology.orchestra.run.smithi059.stdout:5078 write 0x7f0c7d9 thru 0x7f0f5d1 (0x2df9 bytes) 2024-09-12T05:21:55.305 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:55.303+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:55.315 INFO:teuthology.orchestra.run.smithi059.stdout:5079 write 0xb13b304 thru 0xb149c3c (0xe939 bytes) 2024-09-12T05:21:55.320 INFO:teuthology.orchestra.run.smithi059.stdout:5080 read 0x5d48c97 thru 0x5d549d8 (0xbd42 bytes) 2024-09-12T05:21:55.321 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.321 INFO:teuthology.orchestra.run.smithi059.stdout:5083 write 0x791da15 thru 0x792b275 (0xd861 bytes) 2024-09-12T05:21:55.325 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.325 INFO:teuthology.orchestra.run.smithi059.stdout:5085 read 0x14b3a07 thru 0x14ba731 (0x6d2b bytes) 2024-09-12T05:21:55.325 INFO:teuthology.orchestra.run.smithi059.stdout:5086 write 0x2718193 thru 0x271ed42 (0x6bb0 bytes) 2024-09-12T05:21:55.331 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.331 INFO:teuthology.orchestra.run.smithi059.stdout:5088 punch from 0x317309 to 0x326630, (0xf327 bytes) 2024-09-12T05:21:55.348 INFO:teuthology.orchestra.run.smithi059.stdout:5089 writesame 0xdd2bc5f thru 0xdd2f973 data_size 0x1(0x3d15 bytes) 2024-09-12T05:21:55.348 INFO:teuthology.orchestra.run.smithi059.stdout:5090 punch from 0x4335ed9 to 0x4338b40, (0x2c67 bytes) 2024-09-12T05:21:55.359 INFO:teuthology.orchestra.run.smithi059.stdout:5093 trunc from 0xdd2f974 to 0x759a7dd 2024-09-12T05:21:55.372 INFO:teuthology.orchestra.run.smithi059.stdout:5094 punch from 0x19c159a to 0x19c7110, (0x5b76 bytes) 2024-09-12T05:21:55.372 INFO:teuthology.orchestra.run.smithi059.stdout:5095 read 0x4c0c0e4 thru 0x4c100cd (0x3fea bytes) 2024-09-12T05:21:55.373 INFO:teuthology.orchestra.run.smithi059.stdout:5097 punch from 0x4ba8ede to 0x4bb7907, (0xea29 bytes) 2024-09-12T05:21:55.373 INFO:teuthology.orchestra.run.smithi059.stdout:5099 punch from 0xab6254 to 0xabdac5, (0x7871 bytes) 2024-09-12T05:21:55.374 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.381 INFO:teuthology.orchestra.run.smithi059.stdout:5101 trunc from 0x759a7dd to 0x1e42f98 2024-09-12T05:21:55.382 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:55.383 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:55.383 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:55.384 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:55.394 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:55.395+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:55.399 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:55.404 INFO:teuthology.orchestra.run.smithi059.stdout:5103 read 0x1595951 thru 0x15a4cd8 (0xf388 bytes) 2024-09-12T05:21:55.404 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:55.414 INFO:teuthology.orchestra.run.smithi059.stdout:5104 writesame 0x48e1891 thru 0x48e7a26 data_size 0x1(0x6196 bytes) 2024-09-12T05:21:55.416 INFO:teuthology.orchestra.run.smithi059.stdout:5105 read 0xd65206 thru 0xd73a23 (0xe81e bytes) 2024-09-12T05:21:55.424 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:55.429 INFO:teuthology.orchestra.run.smithi059.stdout:5106 write 0x830d318 thru 0x8314e9d (0x7b86 bytes) 2024-09-12T05:21:55.434 INFO:teuthology.orchestra.run.smithi059.stdout:5107 punch from 0x126b275 to 0x126ee1f, (0x3baa bytes) 2024-09-12T05:21:55.434 INFO:teuthology.orchestra.run.smithi059.stdout:5108 read 0x4b949a8 thru 0x4b9c335 (0x798e bytes) 2024-09-12T05:21:55.435 INFO:teuthology.orchestra.run.smithi059.stdout:5111 punch from 0x1fc3f54 to 0x1fcfc30, (0xbcdc bytes) 2024-09-12T05:21:55.435 INFO:teuthology.orchestra.run.smithi059.stdout:5112 write 0x1fe5626 thru 0x1fefe37 (0xa812 bytes) 2024-09-12T05:21:55.437 INFO:teuthology.orchestra.run.smithi059.stdout:5113 punch from 0x4180843 to 0x418709c, (0x6859 bytes) 2024-09-12T05:21:55.437 INFO:teuthology.orchestra.run.smithi059.stdout:5115 writesame 0x542d83f thru 0x54395e4 data_size 0x19(0xbda6 bytes) 2024-09-12T05:21:55.442 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:55.447 INFO:teuthology.orchestra.run.smithi059.stdout:5116 writesame 0x84b5f9c thru 0x84b8cf4 data_size 0x13(0x2d59 bytes) 2024-09-12T05:21:55.459 INFO:teuthology.orchestra.run.smithi059.stdout:5117 writesame 0xb238b67 thru 0xb23af43 data_size 0x1(0x23dd bytes) 2024-09-12T05:21:55.459 INFO:teuthology.orchestra.run.smithi059.stdout:5120 read 0x7036f56 thru 0x7046653 (0xf6fe bytes) 2024-09-12T05:21:55.459 INFO:teuthology.orchestra.run.smithi059.stdout:5121 read 0x61bfd40 thru 0x61c8c70 (0x8f31 bytes) 2024-09-12T05:21:55.459 INFO:teuthology.orchestra.run.smithi059.stdout:5122 write 0x27f3b8d thru 0x27fe634 (0xaaa8 bytes) 2024-09-12T05:21:55.461 INFO:teuthology.orchestra.run.smithi059.stdout:5123 read 0xa1f65a thru 0xa27016 (0x79bd bytes) 2024-09-12T05:21:55.466 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:55.473 INFO:teuthology.orchestra.run.smithi059.stdout:5124 write 0xd9c7fd6 thru 0xd9d4b72 (0xcb9d bytes) 2024-09-12T05:21:55.478 INFO:teuthology.orchestra.run.smithi059.stdout:5125 write 0x86d7c0a thru 0x86e4d15 (0xd10c bytes) 2024-09-12T05:21:55.483 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.483 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.483 INFO:teuthology.orchestra.run.smithi059.stdout:5130 write 0x705e989 thru 0x7060c1a (0x2292 bytes) 2024-09-12T05:21:55.487 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:55.487 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:55.488 INFO:teuthology.orchestra.run.smithi059.stdout:5131 write 0x4386237 thru 0x438ea88 (0x8852 bytes) 2024-09-12T05:21:55.489 INFO:teuthology.orchestra.run.smithi059.stdout:5132 writesame 0x602a837 thru 0x6037b2e data_size 0x56(0xd2f8 bytes) 2024-09-12T05:21:55.491 INFO:teuthology.orchestra.run.smithi059.stdout:5133 write 0xc5222a6 thru 0xc5261f9 (0x3f54 bytes) 2024-09-12T05:21:55.495 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:55.495+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:55.497 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.497 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.497 INFO:teuthology.orchestra.run.smithi059.stdout:5138 read 0x5bb56a1 thru 0x5bc13a4 (0xbd04 bytes) 2024-09-12T05:21:55.506 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:55.507 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:55.511 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:55.511 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:55.513 INFO:teuthology.orchestra.run.smithi059.stdout:5139 trunc from 0xd9d4b73 to 0x2454cbb 2024-09-12T05:21:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:5140 write 0x25fc5ac thru 0x2601cde (0x5733 bytes) 2024-09-12T05:21:55.545 INFO:teuthology.orchestra.run.smithi059.stdout:5141 read 0x12bede3 thru 0x12cb9e6 (0xcc04 bytes) 2024-09-12T05:21:55.546 INFO:teuthology.orchestra.run.smithi059.stdout:5144 read 0x421c90 thru 0x42dc7d (0xbfee bytes) 2024-09-12T05:21:55.566 INFO:teuthology.orchestra.run.smithi059.stdout:5146 write 0xa9db473 thru 0xa9e2932 (0x74c0 bytes) 2024-09-12T05:21:55.567 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.395060971000007, 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:21:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:21:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:21:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.394359451, 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:21:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:21:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:21:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:21:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:21:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:21:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.394236716999998, 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.394174504000006, 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:21:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:21:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:21:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.394107687000002, 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:21:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:21:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.394047654000005, 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:21:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:21:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393967717999999, 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:21:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393908156999998, 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393833368000003, 2024-09-12T05:21:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:21:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:21:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393695968000003, 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:21:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393544233, 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:21:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:21:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393481258999998, 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:21:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:21:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393345366999995, 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:21:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:21:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:21:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:21:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393281407000003, 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:21:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:21:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393197154000006, 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:21:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:21:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393137793999998, 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:21:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:55.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393077527000003, 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:21:55.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:55.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.393014534000002, 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:55.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.662 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.392853926000001, 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:55.663 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:21:55.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:21:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:21:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:21:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:21:55.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:21:55.668 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.949622212000001, 2024-09-12T05:21:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:21:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:55.669 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:21:55.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:21:55.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:21:55.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:21:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:55.674 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:55.676 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:5147 writesame 0x878a8b1 thru 0x8795fc4 data_size 0x2(0xb714 bytes) 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:5148 read 0x591cd1d thru 0x591d874 (0xb58 bytes) 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:5149 punch from 0x679b471 to 0x679e71f, (0x32ae bytes) 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:5150 writesame 0x6257b0b thru 0x6258779 data_size 0x1(0xc6f bytes) 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:5151 write 0x27e0d0 thru 0x288736 (0xa667 bytes) 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:5152 punch from 0x8b5bc02 to 0x8b5bd08, (0x106 bytes) 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:5154 read 0x9d73ca4 thru 0x9d7e17d (0xa4da bytes) 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:5155 write 0x2be429 thru 0x2cdd47 (0xf91f bytes) 2024-09-12T05:21:55.678 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5157 read 0x6419d06 thru 0x642081f (0x6b1a bytes) 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5158 writesame 0x98dcef7 thru 0x98df84f data_size 0x1d(0x2959 bytes) 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5160 read 0x151c71 thru 0x1600e5 (0xe475 bytes) 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5161 write 0x9d33cb0 thru 0x9d3bf9f (0x82f0 bytes) 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5162 writesame 0xc63e06f thru 0xc64b1ac data_size 0x1(0xd13e bytes) 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5163 writesame 0x7f9490b thru 0x7f99f9f data_size 0xd(0x5695 bytes) 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5164 read 0x35091c7 thru 0x3509802 (0x63c bytes) 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5165 trunc from 0xc64b1ad to 0xa425c49 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5167 write 0x6fd58d2 thru 0x6fde8c9 (0x8ff8 bytes) 2024-09-12T05:21:55.679 INFO:teuthology.orchestra.run.smithi059.stdout:5168 punch from 0x860cff7 to 0x861bee7, (0xeef0 bytes) 2024-09-12T05:21:55.680 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:55.675+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:55.681 INFO:teuthology.orchestra.run.smithi059.stdout:5170 trunc from 0xa425c49 to 0x24276e6 2024-09-12T05:21:55.712 INFO:teuthology.orchestra.run.smithi059.stdout:5171 write 0x669650 thru 0x67183e (0x81ef bytes) 2024-09-12T05:21:55.715 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.753 INFO:teuthology.orchestra.run.smithi059.stdout:5173 write 0xb2ecea8 thru 0xb2f34e0 (0x6639 bytes) 2024-09-12T05:21:55.760 INFO:teuthology.orchestra.run.smithi059.stdout:5174 read 0x1ad0e4e thru 0x1add628 (0xc7db bytes) 2024-09-12T05:21:55.761 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.761 INFO:teuthology.orchestra.run.smithi059.stdout:5177 punch from 0x24aba3e to 0x24acbb2, (0x1174 bytes) 2024-09-12T05:21:55.761 INFO:teuthology.orchestra.run.smithi059.stdout:5178 read 0x8eea924 thru 0x8ef5810 (0xaeed bytes) 2024-09-12T05:21:55.761 INFO:teuthology.orchestra.run.smithi059.stdout:5179 punch from 0xafb40c3 to 0xafb948c, (0x53c9 bytes) 2024-09-12T05:21:55.768 INFO:teuthology.orchestra.run.smithi059.stdout:5180 trunc from 0xb2f34e1 to 0xd8b0515 2024-09-12T05:21:55.776 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:55.775+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:55.783 INFO:teuthology.orchestra.run.smithi059.stdout:5182 punch from 0xbef3317 to 0xbef899e, (0x5687 bytes) 2024-09-12T05:21:55.783 INFO:teuthology.orchestra.run.smithi059.stdout:5184 read 0x2f4f77f thru 0x2f549a6 (0x5228 bytes) 2024-09-12T05:21:55.784 INFO:teuthology.orchestra.run.smithi059.stdout:5186 write 0x192daba thru 0x1930a74 (0x2fbb bytes) 2024-09-12T05:21:55.789 INFO:teuthology.orchestra.run.smithi059.stdout:5188 write 0x8090a05 thru 0x80951ff (0x47fb bytes) 2024-09-12T05:21:55.796 INFO:teuthology.orchestra.run.smithi059.stdout:5189 write 0x4fc44a3 thru 0x4fcc4be (0x801c bytes) 2024-09-12T05:21:55.800 INFO:teuthology.orchestra.run.smithi059.stdout:5190 write 0xc371789 thru 0xc375e21 (0x4699 bytes) 2024-09-12T05:21:55.812 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:55.812 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:55.812 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:21:55.812 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:55.826 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:55.837 INFO:teuthology.orchestra.run.smithi059.stdout:5191 trunc from 0xd8b0515 to 0x130259b 2024-09-12T05:21:55.872 INFO:teuthology.orchestra.run.smithi059.stdout:5193 read 0x649065 thru 0x64adf2 (0x1d8e bytes) 2024-09-12T05:21:55.873 INFO:teuthology.orchestra.run.smithi059.stdout:5195 read 0x635553 thru 0x637ee1 (0x298f bytes) 2024-09-12T05:21:55.877 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:55.879+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:55.908 INFO:teuthology.orchestra.run.smithi059.stdout:5196 write 0x9d427e0 thru 0x9d4932f (0x6b50 bytes) 2024-09-12T05:21:55.915 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.915 INFO:teuthology.orchestra.run.smithi059.stdout:5198 writesame 0x88b8664 thru 0x88bf004 data_size 0x1(0x69a1 bytes) 2024-09-12T05:21:55.943 INFO:teuthology.orchestra.run.smithi059.stdout:5199 write 0x5a6b702 thru 0x5a76980 (0xb27f bytes) 2024-09-12T05:21:55.951 INFO:teuthology.orchestra.run.smithi059.stdout:5200 trunc from 0x9d49330 to 0xb79bbe8 2024-09-12T05:21:55.962 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:21:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:21:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:21:55.962 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:55.964 INFO:teuthology.orchestra.run.smithi059.stdout:5202 punch from 0x91fa6f2 to 0x9206c0b, (0xc519 bytes) 2024-09-12T05:21:55.964 INFO:teuthology.orchestra.run.smithi059.stdout:5203 read 0x8ec0f42 thru 0x8ec92fa (0x83b9 bytes) 2024-09-12T05:21:55.964 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.964 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:55.964 INFO:teuthology.orchestra.run.smithi059.stdout:5209 writesame 0x885dba9 thru 0x886af5e data_size 0x9(0xd3b6 bytes) 2024-09-12T05:21:55.971 INFO:teuthology.orchestra.run.smithi059.stdout:5210 read 0xa42b077 thru 0xa432c8a (0x7c14 bytes) 2024-09-12T05:21:55.971 INFO:teuthology.orchestra.run.smithi059.stdout:5211 write 0xab6eb16 thru 0xab746db (0x5bc6 bytes) 2024-09-12T05:21:55.978 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:55.975+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:55.979 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:55.991 INFO:teuthology.orchestra.run.smithi059.stdout:5212 write 0xbe9944b thru 0xbe9d78f (0x4345 bytes) 2024-09-12T05:21:55.999 INFO:teuthology.orchestra.run.smithi059.stdout:5213 punch from 0x8f201c2 to 0x8f21265, (0x10a3 bytes) 2024-09-12T05:21:56.014 INFO:teuthology.orchestra.run.smithi059.stdout:5214 trunc from 0xbe9d790 to 0x63b90fc 2024-09-12T05:21:56.041 INFO:teuthology.orchestra.run.smithi059.stdout:5218 punch from 0x4162d33 to 0x4170abc, (0xdd89 bytes) 2024-09-12T05:21:56.041 INFO:teuthology.orchestra.run.smithi059.stdout:5219 write 0xd06da2 thru 0xd0ce79 (0x60d8 bytes) 2024-09-12T05:21:56.045 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.045 INFO:teuthology.orchestra.run.smithi059.stdout:5221 read 0x592b272 thru 0x5930271 (0x5000 bytes) 2024-09-12T05:21:56.046 INFO:teuthology.orchestra.run.smithi059.stdout:5222 read 0x124bdb7 thru 0x124e24b (0x2495 bytes) 2024-09-12T05:21:56.060 INFO:teuthology.orchestra.run.smithi059.stdout:5224 write 0x6c3746c thru 0x6c441d9 (0xcd6e bytes) 2024-09-12T05:21:56.079 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:56.079+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:56.087 INFO:teuthology.orchestra.run.smithi059.stdout:5226 write 0xa70da8c thru 0xa713222 (0x5797 bytes) 2024-09-12T05:21:56.094 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.094 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.094 INFO:teuthology.orchestra.run.smithi059.stdout:5229 punch from 0x12233f1 to 0x122d8c6, (0xa4d5 bytes) 2024-09-12T05:21:56.094 INFO:teuthology.orchestra.run.smithi059.stdout:5230 read 0x5313de4 thru 0x531b8e9 (0x7b06 bytes) 2024-09-12T05:21:56.094 INFO:teuthology.orchestra.run.smithi059.stdout:5231 read 0x1289aec thru 0x12904cc (0x69e1 bytes) 2024-09-12T05:21:56.096 INFO:teuthology.orchestra.run.smithi059.stdout:5232 read 0x94ff861 thru 0x950b0ba (0xb85a bytes) 2024-09-12T05:21:56.096 INFO:teuthology.orchestra.run.smithi059.stdout:5233 read 0x75a4e22 thru 0x75a5996 (0xb75 bytes) 2024-09-12T05:21:56.096 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.096 INFO:teuthology.orchestra.run.smithi059.stdout:5235 read 0x313658b thru 0x3137b49 (0x15bf bytes) 2024-09-12T05:21:56.108 INFO:teuthology.orchestra.run.smithi059.stdout:5237 trunc from 0xa713223 to 0xeb8aabc 2024-09-12T05:21:56.128 INFO:teuthology.orchestra.run.smithi059.stdout:5238 trunc from 0xeb8aabc to 0xc0240fc 2024-09-12T05:21:56.145 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.145 INFO:teuthology.orchestra.run.smithi059.stdout:5240 write 0x27844de thru 0x27912b8 (0xcddb bytes) 2024-09-12T05:21:56.150 INFO:teuthology.orchestra.run.smithi059.stdout:5241 writesame 0xa18ec8d thru 0xa190632 data_size 0xe(0x19a6 bytes) 2024-09-12T05:21:56.155 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:21:56.155 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:21:56.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:21:56.155 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:21:56.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.155 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9143108289999997, 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:21:56.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:21:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.913297107, 2024-09-12T05:21:56.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:21:56.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9126032459999998, 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:21:56.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:21:56.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9096184029999996, 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:21:56.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:56.178 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9093770780000003, 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:56.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.183 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9086288679999992, 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.184 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:21:56.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:21:56.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9083171070000002, 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:21:56.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:21:56.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9075941459999992, 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:21:56.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:21:56.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9062952269999993, 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:21:56.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:21:56.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9037434730000005, 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.207 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:21:56.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:21:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:21:56.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9029649830000004, 2024-09-12T05:21:56.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:21:56.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:21:56.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9026926419999999, 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.225 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9014163560000004, 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:21:56.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:21:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9000137400000003, 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.232 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:21:56.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.8992982390000002, 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:21:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:21:56.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:21:56.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.8979768430000004, 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:21:56.244 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:21:56.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:21:56.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.8969001980000009, 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:21:56.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.8966774540000007, 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:21:56.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:21:56.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:21:56.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:56.261 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.8960564150000003, 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:56.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:21:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.8944082820000006, 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:21:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:21:56.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:21:56.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:21:56.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.273 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:21:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:21:56.274 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:21:56.274 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6, 2] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:21:56.274 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:21:56.274 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T05:21:56.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:21:56.277 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:21:56.277 INFO:teuthology.orchestra.run.smithi059.stdout:5244 write 0xb953b0e thru 0xb960839 (0xcd2c bytes) 2024-09-12T05:21:56.277 INFO:teuthology.orchestra.run.smithi059.stdout:5247 read 0x48f5a80 thru 0x48fbf1a (0x649b bytes) 2024-09-12T05:21:56.277 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.277 INFO:teuthology.orchestra.run.smithi059.stdout:5249 write 0x12199f2 thru 0x12285d0 (0xebdf bytes) 2024-09-12T05:21:56.278 INFO:teuthology.orchestra.run.smithi059.stdout:5250 write 0x33262eb thru 0x3330732 (0xa448 bytes) 2024-09-12T05:21:56.278 INFO:teuthology.orchestra.run.smithi059.stdout:5252 write 0x168e9b2 thru 0x1699017 (0xa666 bytes) 2024-09-12T05:21:56.278 INFO:teuthology.orchestra.run.smithi059.stdout:5253 read 0x3bf912a thru 0x3c02a40 (0x9917 bytes) 2024-09-12T05:21:56.278 INFO:teuthology.orchestra.run.smithi059.stdout:5254 write 0x7009a26 thru 0x701880b (0xede6 bytes) 2024-09-12T05:21:56.278 INFO:teuthology.orchestra.run.smithi059.stdout:5256 trunc from 0xc0240fc to 0x39baf99 2024-09-12T05:21:56.278 INFO:teuthology.orchestra.run.smithi059.stdout:5257 trunc from 0x39baf99 to 0x9beea7c 2024-09-12T05:21:56.278 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:56.275+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:56.279 INFO:teuthology.orchestra.run.smithi059.stdout:5258 trunc from 0x9beea7c to 0xea4d3e7 2024-09-12T05:21:56.292 INFO:teuthology.orchestra.run.smithi059.stdout:5260 read 0x10af92 thru 0x112128 (0x7197 bytes) 2024-09-12T05:21:56.293 INFO:teuthology.orchestra.run.smithi059.stdout:5261 read 0x1917b4d thru 0x191e51a (0x69ce bytes) 2024-09-12T05:21:56.294 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.294 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.294 INFO:teuthology.orchestra.run.smithi059.stdout:5265 punch from 0x7136080 to 0x7144a88, (0xea08 bytes) 2024-09-12T05:21:56.294 INFO:teuthology.orchestra.run.smithi059.stdout:5267 read 0x52b0cd9 thru 0x52b2722 (0x1a4a bytes) 2024-09-12T05:21:56.294 INFO:teuthology.orchestra.run.smithi059.stdout:5268 read 0xc3cea62 thru 0xc3cf720 (0xcbf bytes) 2024-09-12T05:21:56.294 INFO:teuthology.orchestra.run.smithi059.stdout:5269 read 0xe69136d thru 0xe69d38a (0xc01e bytes) 2024-09-12T05:21:56.316 INFO:teuthology.orchestra.run.smithi059.stdout:5272 trunc from 0xea4d3e7 to 0x265f149 2024-09-12T05:21:56.329 INFO:teuthology.orchestra.run.smithi059.stdout:5273 read 0xd4cf46 thru 0xd52069 (0x5124 bytes) 2024-09-12T05:21:56.343 INFO:teuthology.orchestra.run.smithi059.stdout:5274 writesame 0x603b0ef thru 0x603f7a0 data_size 0x1(0x46b2 bytes) 2024-09-12T05:21:56.355 INFO:teuthology.orchestra.run.smithi059.stdout:5275 writesame 0x735b34b thru 0x735b93e data_size 0x6(0x5f4 bytes) 2024-09-12T05:21:56.355 INFO:teuthology.orchestra.run.smithi059.stdout:5276 read 0x566bad4 thru 0x566dfff (0x252c bytes) 2024-09-12T05:21:56.355 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.355 INFO:teuthology.orchestra.run.smithi059.stdout:5278 write 0x50b7940 thru 0x50bb572 (0x3c33 bytes) 2024-09-12T05:21:56.356 INFO:teuthology.orchestra.run.smithi059.stdout:5279 read 0x1c67cf thru 0x1d6005 (0xf837 bytes) 2024-09-12T05:21:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:5280 write 0xa7910a3 thru 0xa79f726 (0xe684 bytes) 2024-09-12T05:21:56.376 INFO:teuthology.orchestra.run.smithi059.stdout:5281 write 0x7e04e15 thru 0x7e0eff6 (0xa1e2 bytes) 2024-09-12T05:21:56.376 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:56.371+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:56.387 INFO:teuthology.orchestra.run.smithi059.stdout:5286 trunc from 0xa79f727 to 0x6c09781 2024-09-12T05:21:56.409 INFO:teuthology.orchestra.run.smithi059.stdout:5287 punch from 0x547262e to 0x548144d, (0xee1f bytes) 2024-09-12T05:21:56.419 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:56.419 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:56.419 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:5288 write 0xb726c53 thru 0xb73120e (0xa5bc bytes) 2024-09-12T05:21:56.435 INFO:teuthology.orchestra.run.smithi059.stdout:5289 writesame 0x58e0c21 thru 0x58e8f2f data_size 0x1(0x830f bytes) 2024-09-12T05:21:56.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:21:56.481 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:56.483+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:56.482 INFO:teuthology.orchestra.run.smithi059.stdout:5292 read 0x6085b4f thru 0x60905d6 (0xaa88 bytes) 2024-09-12T05:21:56.495 INFO:teuthology.orchestra.run.smithi059.stdout:5293 write 0xe83869e thru 0xe839f90 (0x18f3 bytes) 2024-09-12T05:21:56.502 INFO:teuthology.orchestra.run.smithi059.stdout:5295 writesame 0x71d99c0 thru 0x71e6e33 data_size 0x2(0xd474 bytes) 2024-09-12T05:21:56.522 INFO:teuthology.orchestra.run.smithi059.stdout:5296 trunc from 0xe839f91 to 0xbfc06a5 2024-09-12T05:21:56.542 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.549 INFO:teuthology.orchestra.run.smithi059.stdout:5298 writesame 0xc08dbca thru 0xc0929d2 data_size 0x1(0x4e09 bytes) 2024-09-12T05:21:56.560 INFO:teuthology.orchestra.run.smithi059.stdout:5299 writesame 0xdcd4a7f thru 0xdcdfe27 data_size 0x1(0xb3a9 bytes) 2024-09-12T05:21:56.560 INFO:teuthology.orchestra.run.smithi059.stdout:5300 writesame 0x9205190 thru 0x920b848 data_size 0x1(0x66b9 bytes) 2024-09-12T05:21:56.577 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:56.579+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:56.584 INFO:teuthology.orchestra.run.smithi059.stdout:5301 read 0x5f68fda thru 0x5f69dac (0xdd3 bytes) 2024-09-12T05:21:56.585 INFO:teuthology.orchestra.run.smithi059.stdout:5302 read 0xa016b4d thru 0xa020ef3 (0xa3a7 bytes) 2024-09-12T05:21:56.585 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.585 INFO:teuthology.orchestra.run.smithi059.stdout:5304 trunc from 0xdcdfe28 to 0xda6d8f4 2024-09-12T05:21:56.593 INFO:teuthology.orchestra.run.smithi059.stdout:5305 writesame 0x41dcbd0 thru 0x41e3340 data_size 0x27(0x6771 bytes) 2024-09-12T05:21:56.596 INFO:teuthology.orchestra.run.smithi059.stdout:5307 write 0x8f9a6d3 thru 0x8f9f0b2 (0x49e0 bytes) 2024-09-12T05:21:56.603 INFO:teuthology.orchestra.run.smithi059.stdout:5308 punch from 0x5f18d15 to 0x5f197d7, (0xac2 bytes) 2024-09-12T05:21:56.603 INFO:teuthology.orchestra.run.smithi059.stdout:5310 write 0x4958a8d thru 0x4967749 (0xecbd bytes) 2024-09-12T05:21:56.606 INFO:teuthology.orchestra.run.smithi059.stdout:5311 read 0x65eeb2c thru 0x65f94c0 (0xa995 bytes) 2024-09-12T05:21:56.607 INFO:teuthology.orchestra.run.smithi059.stdout:5312 punch from 0x87d5977 to 0x87dd8cb, (0x7f54 bytes) 2024-09-12T05:21:56.607 INFO:teuthology.orchestra.run.smithi059.stdout:5313 punch from 0xba82901 to 0xba8caff, (0xa1fe bytes) 2024-09-12T05:21:56.607 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.607 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:56.607 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:56.607 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:56.607 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:56.608 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:56.608 INFO:teuthology.orchestra.run.smithi059.stdout:5316 trunc from 0xda6d8f4 to 0xd1277ee 2024-09-12T05:21:56.616 INFO:teuthology.orchestra.run.smithi059.stdout:5317 write 0x96d64ba thru 0x96d77cc (0x1313 bytes) 2024-09-12T05:21:56.622 INFO:teuthology.orchestra.run.smithi059.stdout:5318 writesame 0xcfc7140 thru 0xcfd5a95 data_size 0x1(0xe956 bytes) 2024-09-12T05:21:56.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:21:56.639 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:21:56.639 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:56.639 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 101, 2024-09-12T05:21:56.639 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:21:56.639 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:21:56.639 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:21:55.057824+0000", 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:21:02.127583+0000", 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:21:38.885631+0000", 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5799936, 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:56.640 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 5, 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "luminous", 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.641 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:56.642 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:56.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:56.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:56.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:21:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:56.647 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:56.648 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:56.649 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:56.649 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:56.649 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:56.649 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:56.650 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:21:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:56.652 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:56.653 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 2, 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 2, 2024-09-12T05:21:56.654 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.75, 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.5, 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.5, 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:21:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:21:56.656 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:21:56.657 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "100", 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:21:56.658 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 42, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 100, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:21:56.660 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:21:56.661 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.9900000095367432, 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.9900000095367432, 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 0.80352783203125, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 60, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.664 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:56.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:56.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.667 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:21:56.669 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 90, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.670 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:21:56.674 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:56.675 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 88, 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:56.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.677 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.679 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:21:56.680 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:56.681 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 74, 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:56.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:21:56.684 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.685 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:21:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 0, 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:56.687 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 24, 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 60, 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:56.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.689 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:56.691 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2467380900 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/2467380900", 2024-09-12T05:21:56.692 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/2467380900", 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/2467380900", 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/2467380900", 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "exists" 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:56.693 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 87, 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.694 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:56.696 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.698 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:21:56.699 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 84, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.700 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.701 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.702 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.703 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:21:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:21:56.705 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 96, 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.706 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.707 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.708 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:21:56.710 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:56.712 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:56.713 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 60 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.714 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:21:56.716 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [ 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.1", 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 6 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.4", 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 0, 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 4 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.f", 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 4, 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.15", 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:21:56.719 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [ 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.4", 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: 1, 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: 0 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.9", 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: 2, 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: 7 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:21:56.721 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:21:56.722 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:21:56.723 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:21:56.723 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:21:56.723 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.723 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:56.725 INFO:tasks.thrashosds.thrasher:j is {'epoch': 101, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:21:55.057824+0000', 'last_up_change': '2024-09-12T05:21:02.127583+0000', 'last_in_change': '2024-09-12T05:21:38.885631+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 42, 'snap_epoch': 100, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.80352783203125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 88, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 60, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 2467380900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 2467380900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 2467380900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 2467380900}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 2467380900}]}, 'public_addr': '172.21.15.194:6825/2467380900', 'cluster_addr': '172.21.15.194:6827/2467380900', 'heartbeat_back_addr': '172.21.15.194:6831/2467380900', 'heartbeat_front_addr': '172.21.15.194:6829/2467380900', 'state': ['exists']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 96, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 60}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.1', 'mappings': [{'from': 3, 'to': 6}]}, {'pgid': '2.4', 'mappings': [{'from': 0, 'to': 4}]}, {'pgid': '3.f', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '3.15', 'mappings': [{'from': 3, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '2.4', 'osds': [1, 0]}, {'pgid': '3.9', 'osds': [2, 7]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:21:56.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:21:56.727 INFO:teuthology.orchestra.run.smithi059.stdout:5320 read 0x17ebb58 thru 0x17f067c (0x4b25 bytes) 2024-09-12T05:21:56.727 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.727 INFO:teuthology.orchestra.run.smithi059.stdout:5322 read 0x2900ca thru 0x29cc88 (0xcbbf bytes) 2024-09-12T05:21:56.727 INFO:teuthology.orchestra.run.smithi059.stdout:5323 write 0xa5f7547 thru 0xa5f915e (0x1c18 bytes) 2024-09-12T05:21:56.727 INFO:teuthology.orchestra.run.smithi059.stdout:5324 write 0xb77dd4d thru 0xb781f5f (0x4213 bytes) 2024-09-12T05:21:56.727 INFO:teuthology.orchestra.run.smithi059.stdout:5326 punch from 0x8fb06ee to 0x8fbc361, (0xbc73 bytes) 2024-09-12T05:21:56.727 INFO:teuthology.orchestra.run.smithi059.stdout:5327 write 0xe2ab38c thru 0xe2b374a (0x83bf bytes) 2024-09-12T05:21:56.727 INFO:teuthology.orchestra.run.smithi059.stdout:5329 read 0x212575c thru 0x212c182 (0x6a27 bytes) 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:5330 writesame 0xb532bb thru 0xb5670a data_size 0x1b(0x3450 bytes) 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:5332 write 0xcdd741f thru 0xcde4a3a (0xd61c bytes) 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:5334 writesame 0xdaa7e1b thru 0xdab048a data_size 0x48(0x8670 bytes) 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:5338 write 0x15d5bc5 thru 0x15d876f (0x2bab bytes) 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:5339 read 0x52fe9b2 thru 0x5300ff6 (0x2645 bytes) 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:5341 punch from 0x7c9d822 to 0x7ca8939, (0xb117 bytes) 2024-09-12T05:21:56.728 INFO:teuthology.orchestra.run.smithi059.stdout:5342 trunc from 0xe2b374b to 0xa7c4899 2024-09-12T05:21:56.729 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:56.727+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:56.739 INFO:teuthology.orchestra.run.smithi059.stdout:5343 read 0x3f8c4be thru 0x3f93511 (0x7054 bytes) 2024-09-12T05:21:56.740 INFO:teuthology.orchestra.run.smithi059.stdout:5345 read 0x2f26837 thru 0x2f3091b (0xa0e5 bytes) 2024-09-12T05:21:56.741 INFO:teuthology.orchestra.run.smithi059.stdout:5349 write 0x5d7517d thru 0x5d7d206 (0x808a bytes) 2024-09-12T05:21:56.743 INFO:teuthology.orchestra.run.smithi059.stdout:5350 writesame 0x1f5e1bd thru 0x1f5f528 data_size 0x16(0x136c bytes) 2024-09-12T05:21:56.745 INFO:teuthology.orchestra.run.smithi059.stdout:5351 read 0xa5c1abb thru 0xa5c91d8 (0x771e bytes) 2024-09-12T05:21:56.746 INFO:teuthology.orchestra.run.smithi059.stdout:5354 write 0xcee5a1 thru 0xcfafd6 (0xca36 bytes) 2024-09-12T05:21:56.750 INFO:teuthology.orchestra.run.smithi059.stdout:5355 clone 41 order 19 su 262144 sc 11 2024-09-12T05:21:56.825 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:56.827+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 56.736834536000003, 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:21:56.857 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:21:56.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:21:56.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.406233466000003, 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.279673027999998, 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:21:56.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:21:56.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:21:56.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.279147502999997, 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:21:56.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.876 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.279124955, 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:21:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:21:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.279103165000002, 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:21:56.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:56.885 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.2790818, 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:21:56.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.279059255, 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.890 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:21:56.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:56.894 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.279037019999997, 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:56.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.898 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.279015436000002, 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:21:56.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.903 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.278814036999997, 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:21:56.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:56.908 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.278788636999998, 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:21:56.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.271515360000002, 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.913 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:21:56.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.271492969999997, 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.918 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:21:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:21:56.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:21:56.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.271470321999999, 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.922 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:21:56.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:21:56.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.271449832999998, 2024-09-12T05:21:56.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:21:56.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.271423767999998, 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:21:56.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.271400550999999, 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.935 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:21:56.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:21:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.271378187000003, 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.939 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.943 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.794837811000001, 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:21:56.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:56.948 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:56.949 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:56.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:21:56.950 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:56.951+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:57.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:57.047+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:21:57.057 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:21:57.083 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-12T05:21:56.930184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1533472242,"num_objects":2281,"num_object_clones":388,"num_object_copies":4562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":803,"num_objects_misplaced":77,"num_objects_unfound":0,"num_objects_dirty":2281,"num_whiteouts":1222,"num_read":137733,"num_read_kb":824207,"num_write":19368,"num_write_kb":451761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":738,"num_bytes_recovered":39834912,"num_keys_recovered":61,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15937,"ondisk_log_size":15937,"up":69,"acting":71,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":940948,"kb_used_data":598404,"kb_used_omap":12,"kb_used_meta":342323,"kb_avail":754033772,"statfs":{"total":773094113280,"available":772130582528,"internally_reserved":0,"allocated":612765696,"data_stored":767250918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":350539312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":155646589,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":4453,"num_read_kb":55469,"num_write":786,"num_write_kb":33861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1777262,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.912730"},"pg_stats":[{"pgid":"3.1f","version":"91'328","reported_seq":8173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T05:21:51.042573+0000","last_change":"2024-09-12T05:20:11.762958+0000","last_active":"2024-09-12T05:21:51.042573+0000","last_peered":"2024-09-12T05:21:51.042573+0000","last_clean":"2024-09-12T05:21:51.042573+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:21:51.042573+0000","last_undegraded":"2024-09-12T05:21:51.042573+0000","last_fullsized":"2024-09-12T05:21:51.042573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:46.103439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036800549999999998,"stat_sum":{"num_bytes":23108289,"num_objects":77,"num_object_clones":16,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":42,"num_read":8402,"num_read_kb":32489,"num_write":323,"num_write_kb":7714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"98'305","reported_seq":7250,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.045788+0000","last_change":"2024-09-12T05:20:34.070752+0000","last_active":"2024-09-12T05:21:52.045788+0000","last_peered":"2024-09-12T05:21:52.045788+0000","last_clean":"2024-09-12T05:21:52.045788+0000","last_became_active":"2024-09-12T05:20:33.940420+0000","last_became_peered":"2024-09-12T05:20:33.940420+0000","last_unstale":"2024-09-12T05:21:52.045788+0000","last_undegraded":"2024-09-12T05:21:52.045788+0000","last_fullsized":"2024-09-12T05:21:52.045788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:05.136180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015371499999999999,"stat_sum":{"num_bytes":82730550,"num_objects":67,"num_object_clones":13,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":36,"num_read":6832,"num_read_kb":77337,"num_write":346,"num_write_kb":14202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"99'469","reported_seq":2931,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:52.064217+0000","last_change":"2024-09-12T05:21:03.152999+0000","last_active":"2024-09-12T05:21:52.064217+0000","last_peered":"2024-09-12T05:21:52.064217+0000","last_clean":"2024-09-12T05:21:01.134623+0000","last_became_active":"2024-09-12T05:21:03.152999+0000","last_became_peered":"2024-09-12T05:21:03.152999+0000","last_unstale":"2024-09-12T05:21:52.064217+0000","last_undegraded":"2024-09-12T05:21:03.151855+0000","last_fullsized":"2024-09-12T05:21:03.151583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:28.640931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098006399999999989,"stat_sum":{"num_bytes":24465857,"num_objects":67,"num_object_clones":11,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":67,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":35,"num_read":3518,"num_read_kb":6606,"num_write":498,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":67}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"98'431","reported_seq":3868,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:52.034151+0000","last_change":"2024-09-12T05:21:03.156068+0000","last_active":"2024-09-12T05:21:52.034151+0000","last_peered":"2024-09-12T05:21:52.034151+0000","last_clean":"2024-09-12T05:21:01.134412+0000","last_became_active":"2024-09-12T05:21:03.156068+0000","last_became_peered":"2024-09-12T05:21:03.156068+0000","last_unstale":"2024-09-12T05:21:52.034151+0000","last_undegraded":"2024-09-12T05:21:03.151787+0000","last_fullsized":"2024-09-12T05:21:03.151493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:47.599672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087905899999999996,"stat_sum":{"num_bytes":39085898,"num_objects":71,"num_object_clones":13,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":71,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":41,"num_read":4198,"num_read_kb":30719,"num_write":472,"num_write_kb":9218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":71}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"97'342","reported_seq":2295,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:51.667389+0000","last_change":"2024-09-12T05:21:03.160720+0000","last_active":"2024-09-12T05:21:51.667389+0000","last_peered":"2024-09-12T05:21:51.667389+0000","last_clean":"2024-09-12T05:21:01.133569+0000","last_became_active":"2024-09-12T05:21:03.160720+0000","last_became_peered":"2024-09-12T05:21:03.160720+0000","last_unstale":"2024-09-12T05:21:51.667389+0000","last_undegraded":"2024-09-12T05:21:03.156540+0000","last_fullsized":"2024-09-12T05:21:03.156423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:30.909008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040909680000000004,"stat_sum":{"num_bytes":49574328,"num_objects":80,"num_object_clones":13,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":80,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":45,"num_read":2296,"num_read_kb":33759,"num_write":314,"num_write_kb":26144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":80}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"97'361","reported_seq":4506,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:52.035968+0000","last_change":"2024-09-12T05:21:03.156899+0000","last_active":"2024-09-12T05:21:52.035968+0000","last_peered":"2024-09-12T05:21:52.035968+0000","last_clean":"2024-09-12T05:20:53.806542+0000","last_became_active":"2024-09-12T05:21:03.156899+0000","last_became_peered":"2024-09-12T05:21:03.156899+0000","last_unstale":"2024-09-12T05:21:52.035968+0000","last_undegraded":"2024-09-12T05:21:03.155951+0000","last_fullsized":"2024-09-12T05:21:03.155860+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:55.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014130220000000001,"stat_sum":{"num_bytes":42309169,"num_objects":65,"num_object_clones":10,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":65,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":39,"num_read":5097,"num_read_kb":30145,"num_write":330,"num_write_kb":18322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":65}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"98'363","reported_seq":3520,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.035446+0000","last_change":"2024-09-12T05:20:11.741831+0000","last_active":"2024-09-12T05:21:52.035446+0000","last_peered":"2024-09-12T05:21:52.035446+0000","last_clean":"2024-09-12T05:21:52.035446+0000","last_became_active":"2024-09-12T05:20:09.736422+0000","last_became_peered":"2024-09-12T05:20:09.736422+0000","last_unstale":"2024-09-12T05:21:52.035446+0000","last_undegraded":"2024-09-12T05:21:52.035446+0000","last_fullsized":"2024-09-12T05:21:52.035446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:20.187080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001296167,"stat_sum":{"num_bytes":39875863,"num_objects":74,"num_object_clones":8,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":39,"num_read":3656,"num_read_kb":32880,"num_write":336,"num_write_kb":4854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"97'482","reported_seq":2882,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.046588+0000","last_change":"2024-09-12T05:20:11.786941+0000","last_active":"2024-09-12T05:21:52.046588+0000","last_peered":"2024-09-12T05:21:52.046588+0000","last_clean":"2024-09-12T05:21:52.046588+0000","last_became_active":"2024-09-12T05:20:09.740953+0000","last_became_peered":"2024-09-12T05:20:09.740953+0000","last_unstale":"2024-09-12T05:21:52.046588+0000","last_undegraded":"2024-09-12T05:21:52.046588+0000","last_fullsized":"2024-09-12T05:21:52.046588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:45.469314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085336099999999996,"stat_sum":{"num_bytes":37465452,"num_objects":70,"num_object_clones":14,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":37,"num_read":4217,"num_read_kb":20273,"num_write":465,"num_write_kb":10721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"98'540","reported_seq":1651,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T05:21:51.645760+0000","last_change":"2024-09-12T05:20:11.763561+0000","last_active":"2024-09-12T05:21:51.645760+0000","last_peered":"2024-09-12T05:21:51.645760+0000","last_clean":"2024-09-12T05:21:51.645760+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:21:51.645760+0000","last_undegraded":"2024-09-12T05:21:51.645760+0000","last_fullsized":"2024-09-12T05:21:51.645760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:10.193476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041487850000000003,"stat_sum":{"num_bytes":33947299,"num_objects":60,"num_object_clones":9,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":35,"num_read":2847,"num_read_kb":7612,"num_write":704,"num_write_kb":6973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"98'431","reported_seq":5686,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.034136+0000","last_change":"2024-09-12T05:20:11.737024+0000","last_active":"2024-09-12T05:21:52.034136+0000","last_peered":"2024-09-12T05:21:52.034136+0000","last_clean":"2024-09-12T05:21:52.034136+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:21:52.034136+0000","last_undegraded":"2024-09-12T05:21:52.034136+0000","last_fullsized":"2024-09-12T05:21:52.034136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:20.504539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015614439999999999,"stat_sum":{"num_bytes":85945368,"num_objects":77,"num_object_clones":13,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":41,"num_read":6004,"num_read_kb":68288,"num_write":439,"num_write_kb":12959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"93'275","reported_seq":1387,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.054675+0000","last_change":"2024-09-12T05:20:49.043311+0000","last_active":"2024-09-12T05:21:52.054675+0000","last_peered":"2024-09-12T05:21:52.054675+0000","last_clean":"2024-09-12T05:21:52.054675+0000","last_became_active":"2024-09-12T05:20:49.041294+0000","last_became_peered":"2024-09-12T05:20:49.041294+0000","last_unstale":"2024-09-12T05:21:52.054675+0000","last_undegraded":"2024-09-12T05:21:52.054675+0000","last_fullsized":"2024-09-12T05:21:52.054675+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:08.888954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000920377,"stat_sum":{"num_bytes":34744905,"num_objects":63,"num_object_clones":14,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":31,"num_read":887,"num_read_kb":11509,"num_write":330,"num_write_kb":10005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"97'1122","reported_seq":4696,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:52.054365+0000","last_change":"2024-09-12T05:21:03.163718+0000","last_active":"2024-09-12T05:21:52.054365+0000","last_peered":"2024-09-12T05:21:52.054365+0000","last_clean":"2024-09-12T05:20:58.183844+0000","last_became_active":"2024-09-12T05:21:03.163718+0000","last_became_peered":"2024-09-12T05:21:03.163718+0000","last_unstale":"2024-09-12T05:21:52.054365+0000","last_undegraded":"2024-09-12T05:21:03.161795+0000","last_fullsized":"2024-09-12T05:21:03.161569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1122,"log_dups_size":0,"ondisk_log_size":1122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:57.788918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013351109999999999,"stat_sum":{"num_bytes":71493075,"num_objects":82,"num_object_clones":11,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":82,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":39,"num_read":8248,"num_read_kb":38604,"num_write":1708,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":82}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T05:21:51.139169+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:21:51.139169+0000","last_peered":"2024-09-12T05:21:51.139169+0000","last_clean":"2024-09-12T05:21:51.139169+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:21:51.139169+0000","last_undegraded":"2024-09-12T05:21:51.139169+0000","last_fullsized":"2024-09-12T05:21:51.139169+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"98'623","reported_seq":1895,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T05:21:51.620384+0000","last_change":"2024-09-12T05:20:11.760826+0000","last_active":"2024-09-12T05:21:51.620384+0000","last_peered":"2024-09-12T05:21:51.620384+0000","last_clean":"2024-09-12T05:21:51.620384+0000","last_became_active":"2024-09-12T05:20:09.741300+0000","last_became_peered":"2024-09-12T05:20:09.741300+0000","last_unstale":"2024-09-12T05:21:51.620384+0000","last_undegraded":"2024-09-12T05:21:51.620384+0000","last_fullsized":"2024-09-12T05:21:51.620384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:00:41.184574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015825539999999999,"stat_sum":{"num_bytes":34481104,"num_objects":85,"num_object_clones":12,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":52,"num_read":2439,"num_read_kb":13487,"num_write":745,"num_write_kb":21572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.035560+0000","last_change":"2024-09-12T05:20:33.943660+0000","last_active":"2024-09-12T05:21:52.035560+0000","last_peered":"2024-09-12T05:21:52.035560+0000","last_clean":"2024-09-12T05:21:52.035560+0000","last_became_active":"2024-09-12T05:20:33.943030+0000","last_became_peered":"2024-09-12T05:20:33.943030+0000","last_unstale":"2024-09-12T05:21:52.035560+0000","last_undegraded":"2024-09-12T05:21:52.035560+0000","last_fullsized":"2024-09-12T05:21:52.035560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:11.076201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"99'366","reported_seq":2917,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.046732+0000","last_change":"2024-09-12T05:20:11.787746+0000","last_active":"2024-09-12T05:21:52.046732+0000","last_peered":"2024-09-12T05:21:52.046732+0000","last_clean":"2024-09-12T05:21:52.046732+0000","last_became_active":"2024-09-12T05:20:09.747558+0000","last_became_peered":"2024-09-12T05:20:09.747558+0000","last_unstale":"2024-09-12T05:21:52.046732+0000","last_undegraded":"2024-09-12T05:21:52.046732+0000","last_fullsized":"2024-09-12T05:21:52.046732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:01.232069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001514325,"stat_sum":{"num_bytes":67877653,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":33,"num_read":2657,"num_read_kb":46179,"num_write":410,"num_write_kb":24390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.055375+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:21:52.055375+0000","last_peered":"2024-09-12T05:21:52.055375+0000","last_clean":"2024-09-12T05:21:52.055375+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:21:52.055375+0000","last_undegraded":"2024-09-12T05:21:52.055375+0000","last_fullsized":"2024-09-12T05:21:52.055375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"98'558","reported_seq":3044,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.035449+0000","last_change":"2024-09-12T05:21:42.928042+0000","last_active":"2024-09-12T05:21:52.035449+0000","last_peered":"2024-09-12T05:21:52.035449+0000","last_clean":"2024-09-12T05:21:52.035449+0000","last_became_active":"2024-09-12T05:21:42.927006+0000","last_became_peered":"2024-09-12T05:21:42.927006+0000","last_unstale":"2024-09-12T05:21:52.035449+0000","last_undegraded":"2024-09-12T05:21:52.035449+0000","last_fullsized":"2024-09-12T05:21:52.035449+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:55.120984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109662,"stat_sum":{"num_bytes":39321794,"num_objects":69,"num_object_clones":11,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":36,"num_read":4179,"num_read_kb":21825,"num_write":648,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":11476389,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":99,"state":"active+clean+remapped","last_fresh":"2024-09-12T05:21:52.035714+0000","last_change":"2024-09-12T05:21:17.330061+0000","last_active":"2024-09-12T05:21:52.035714+0000","last_peered":"2024-09-12T05:21:52.035714+0000","last_clean":"2024-09-12T05:21:52.035714+0000","last_became_active":"2024-09-12T05:21:17.329019+0000","last_became_peered":"2024-09-12T05:21:17.329019+0000","last_unstale":"2024-09-12T05:21:52.035714+0000","last_undegraded":"2024-09-12T05:21:52.035714+0000","last_fullsized":"2024-09-12T05:21:52.035714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:21.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"97'378","reported_seq":2106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.034871+0000","last_change":"2024-09-12T05:20:11.737386+0000","last_active":"2024-09-12T05:21:52.034871+0000","last_peered":"2024-09-12T05:21:52.034871+0000","last_clean":"2024-09-12T05:21:52.034871+0000","last_became_active":"2024-09-12T05:20:09.734285+0000","last_became_peered":"2024-09-12T05:20:09.734285+0000","last_unstale":"2024-09-12T05:21:52.034871+0000","last_undegraded":"2024-09-12T05:21:52.034871+0000","last_fullsized":"2024-09-12T05:21:52.034871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:01.093110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093432200000000002,"stat_sum":{"num_bytes":33042095,"num_objects":48,"num_object_clones":6,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":25,"num_read":2339,"num_read_kb":13122,"num_write":504,"num_write_kb":9770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"93'424","reported_seq":4126,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:51.042636+0000","last_change":"2024-09-12T05:21:03.157170+0000","last_active":"2024-09-12T05:21:51.042636+0000","last_peered":"2024-09-12T05:21:51.042636+0000","last_clean":"2024-09-12T05:21:00.585064+0000","last_became_active":"2024-09-12T05:21:03.157170+0000","last_became_peered":"2024-09-12T05:21:03.157170+0000","last_unstale":"2024-09-12T05:21:51.042636+0000","last_undegraded":"2024-09-12T05:21:03.156358+0000","last_fullsized":"2024-09-12T05:21:03.156283+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:06.925422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011274589999999999,"stat_sum":{"num_bytes":46206133,"num_objects":81,"num_object_clones":12,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":81,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":47,"num_read":4479,"num_read_kb":17237,"num_write":408,"num_write_kb":25470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":81}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":176,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.033913+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:21:52.033913+0000","last_peered":"2024-09-12T05:21:52.033913+0000","last_clean":"2024-09-12T05:21:52.033913+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:21:52.033913+0000","last_undegraded":"2024-09-12T05:21:52.033913+0000","last_fullsized":"2024-09-12T05:21:52.033913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"98'721","reported_seq":9185,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.035028+0000","last_change":"2024-09-12T05:21:42.929324+0000","last_active":"2024-09-12T05:21:52.035028+0000","last_peered":"2024-09-12T05:21:52.035028+0000","last_clean":"2024-09-12T05:21:52.035028+0000","last_became_active":"2024-09-12T05:21:42.927073+0000","last_became_peered":"2024-09-12T05:21:42.927073+0000","last_unstale":"2024-09-12T05:21:52.035028+0000","last_undegraded":"2024-09-12T05:21:52.035028+0000","last_fullsized":"2024-09-12T05:21:52.035028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:47.033554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011707810000000001,"stat_sum":{"num_bytes":76690379,"num_objects":76,"num_object_clones":15,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":41,"num_read":10007,"num_read_kb":52822,"num_write":1045,"num_write_kb":21303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":13855336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.033654+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:21:52.033654+0000","last_peered":"2024-09-12T05:21:52.033654+0000","last_clean":"2024-09-12T05:21:52.033654+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:21:52.033654+0000","last_undegraded":"2024-09-12T05:21:52.033654+0000","last_fullsized":"2024-09-12T05:21:52.033654+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"93'418","reported_seq":1825,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:51.042895+0000","last_change":"2024-09-12T05:21:03.157382+0000","last_active":"2024-09-12T05:21:51.042895+0000","last_peered":"2024-09-12T05:21:51.042895+0000","last_clean":"2024-09-12T05:21:01.133301+0000","last_became_active":"2024-09-12T05:21:03.157382+0000","last_became_peered":"2024-09-12T05:21:03.157382+0000","last_unstale":"2024-09-12T05:21:51.042895+0000","last_undegraded":"2024-09-12T05:21:03.156161+0000","last_fullsized":"2024-09-12T05:21:03.155969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:36.587722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002046291,"stat_sum":{"num_bytes":37809168,"num_objects":66,"num_object_clones":10,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":40,"num_read":2093,"num_read_kb":15422,"num_write":496,"num_write_kb":4714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":66}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.054001+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:21:52.054001+0000","last_peered":"2024-09-12T05:21:52.054001+0000","last_clean":"2024-09-12T05:21:52.054001+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:21:52.054001+0000","last_undegraded":"2024-09-12T05:21:52.054001+0000","last_fullsized":"2024-09-12T05:21:52.054001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'422","reported_seq":3176,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.045937+0000","last_change":"2024-09-12T05:20:11.787268+0000","last_active":"2024-09-12T05:21:52.045937+0000","last_peered":"2024-09-12T05:21:52.045937+0000","last_clean":"2024-09-12T05:21:52.045937+0000","last_became_active":"2024-09-12T05:20:09.747825+0000","last_became_peered":"2024-09-12T05:20:09.747825+0000","last_unstale":"2024-09-12T05:21:52.045937+0000","last_undegraded":"2024-09-12T05:21:52.045937+0000","last_fullsized":"2024-09-12T05:21:52.045937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:53.003916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010361979999999999,"stat_sum":{"num_bytes":104601739,"num_objects":82,"num_object_clones":16,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":41,"num_read":3286,"num_read_kb":45063,"num_write":516,"num_write_kb":32637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":195,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.033830+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:21:52.033830+0000","last_peered":"2024-09-12T05:21:52.033830+0000","last_clean":"2024-09-12T05:21:52.033830+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:21:52.033830+0000","last_undegraded":"2024-09-12T05:21:52.033830+0000","last_fullsized":"2024-09-12T05:21:52.033830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":263,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.054261+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:21:52.054261+0000","last_peered":"2024-09-12T05:21:52.054261+0000","last_clean":"2024-09-12T05:21:52.054261+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:21:52.054261+0000","last_undegraded":"2024-09-12T05:21:52.054261+0000","last_fullsized":"2024-09-12T05:21:52.054261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"98'552","reported_seq":4350,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.045942+0000","last_change":"2024-09-12T05:20:11.786966+0000","last_active":"2024-09-12T05:21:52.045942+0000","last_peered":"2024-09-12T05:21:52.045942+0000","last_clean":"2024-09-12T05:21:52.045942+0000","last_became_active":"2024-09-12T05:20:09.735109+0000","last_became_peered":"2024-09-12T05:20:09.735109+0000","last_unstale":"2024-09-12T05:21:52.045942+0000","last_undegraded":"2024-09-12T05:21:52.045942+0000","last_fullsized":"2024-09-12T05:21:52.045942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:38.732736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088249400000000005,"stat_sum":{"num_bytes":39390301,"num_objects":75,"num_object_clones":13,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":39,"num_read":6390,"num_read_kb":34331,"num_write":566,"num_write_kb":24432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"92'471","reported_seq":2077,"reported_epoch":99,"state":"active+clean+remapped","last_fresh":"2024-09-12T05:21:52.034200+0000","last_change":"2024-09-12T05:21:40.752657+0000","last_active":"2024-09-12T05:21:52.034200+0000","last_peered":"2024-09-12T05:21:52.034200+0000","last_clean":"2024-09-12T05:21:52.034200+0000","last_became_active":"2024-09-12T05:21:40.751385+0000","last_became_peered":"2024-09-12T05:21:40.751385+0000","last_unstale":"2024-09-12T05:21:52.034200+0000","last_undegraded":"2024-09-12T05:21:52.034200+0000","last_fullsized":"2024-09-12T05:21:52.034200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:04.850777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083728800000000005,"stat_sum":{"num_bytes":22376692,"num_objects":77,"num_object_clones":12,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":77,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":47,"num_read":2705,"num_read_kb":3898,"num_write":536,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":739494,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[{"shards":"2,7","objects":77}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"98'714","reported_seq":2392,"reported_epoch":98,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:51.666642+0000","last_change":"2024-09-12T05:21:03.161538+0000","last_active":"2024-09-12T05:21:51.666642+0000","last_peered":"2024-09-12T05:21:51.666642+0000","last_clean":"2024-09-12T05:21:02.486182+0000","last_became_active":"2024-09-12T05:21:03.161538+0000","last_became_peered":"2024-09-12T05:21:03.161538+0000","last_unstale":"2024-09-12T05:21:51.666642+0000","last_undegraded":"2024-09-12T05:21:03.158960+0000","last_fullsized":"2024-09-12T05:21:03.158767+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:04.383846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001140198,"stat_sum":{"num_bytes":61681826,"num_objects":72,"num_object_clones":15,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":72,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":36,"num_read":4275,"num_read_kb":12612,"num_write":912,"num_write_kb":8016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1146302,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":72}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"97'343","reported_seq":4348,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.045790+0000","last_change":"2024-09-12T05:20:11.787356+0000","last_active":"2024-09-12T05:21:52.045790+0000","last_peered":"2024-09-12T05:21:52.045790+0000","last_clean":"2024-09-12T05:21:52.045790+0000","last_became_active":"2024-09-12T05:20:09.741117+0000","last_became_peered":"2024-09-12T05:20:09.741117+0000","last_unstale":"2024-09-12T05:21:52.045790+0000","last_undegraded":"2024-09-12T05:21:52.045790+0000","last_fullsized":"2024-09-12T05:21:52.045790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:11.554983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011192330000000001,"stat_sum":{"num_bytes":33323676,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":37,"num_read":4632,"num_read_kb":14132,"num_write":309,"num_write_kb":7213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"98'1727","reported_seq":4054,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.034080+0000","last_change":"2024-09-12T05:20:11.736226+0000","last_active":"2024-09-12T05:21:52.034080+0000","last_peered":"2024-09-12T05:21:52.034080+0000","last_clean":"2024-09-12T05:21:52.034080+0000","last_became_active":"2024-09-12T05:20:09.734742+0000","last_became_peered":"2024-09-12T05:20:09.734742+0000","last_unstale":"2024-09-12T05:21:52.034080+0000","last_undegraded":"2024-09-12T05:21:52.034080+0000","last_fullsized":"2024-09-12T05:21:52.034080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1727,"log_dups_size":0,"ondisk_log_size":1727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:00.094357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085690600000000005,"stat_sum":{"num_bytes":7882863,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":36,"num_read":10128,"num_read_kb":11889,"num_write":2969,"num_write_kb":7352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"97'471","reported_seq":5049,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.054909+0000","last_change":"2024-09-12T05:20:11.785456+0000","last_active":"2024-09-12T05:21:52.054909+0000","last_peered":"2024-09-12T05:21:52.054909+0000","last_clean":"2024-09-12T05:21:52.054909+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:21:52.054909+0000","last_undegraded":"2024-09-12T05:21:52.054909+0000","last_fullsized":"2024-09-12T05:21:52.054909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:44.634993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011734079999999999,"stat_sum":{"num_bytes":33813574,"num_objects":77,"num_object_clones":16,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":41,"num_read":5697,"num_read_kb":14247,"num_write":586,"num_write_kb":10611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"97'416","reported_seq":1479,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:52.055693+0000","last_change":"2024-09-12T05:21:03.166584+0000","last_active":"2024-09-12T05:21:52.055693+0000","last_peered":"2024-09-12T05:21:52.055693+0000","last_clean":"2024-09-12T05:21:02.482903+0000","last_became_active":"2024-09-12T05:21:03.166584+0000","last_became_peered":"2024-09-12T05:21:03.166584+0000","last_unstale":"2024-09-12T05:21:52.055693+0000","last_undegraded":"2024-09-12T05:21:03.162462+0000","last_fullsized":"2024-09-12T05:21:03.162245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:09.508890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010563930000000001,"stat_sum":{"num_bytes":42828438,"num_objects":66,"num_object_clones":10,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":36,"num_read":2002,"num_read_kb":5950,"num_write":473,"num_write_kb":4501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":66}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"98'287","reported_seq":3001,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.055589+0000","last_change":"2024-09-12T05:21:50.021238+0000","last_active":"2024-09-12T05:21:52.055589+0000","last_peered":"2024-09-12T05:21:52.055589+0000","last_clean":"2024-09-12T05:21:52.055589+0000","last_became_active":"2024-09-12T05:21:50.016404+0000","last_became_peered":"2024-09-12T05:21:50.016404+0000","last_unstale":"2024-09-12T05:21:52.055589+0000","last_undegraded":"2024-09-12T05:21:52.055589+0000","last_fullsized":"2024-09-12T05:21:52.055589+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:19.520370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072867899999999998,"stat_sum":{"num_bytes":43715883,"num_objects":68,"num_object_clones":13,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":28,"num_read":2748,"num_read_kb":7898,"num_write":262,"num_write_kb":8171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1777262,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"93'401","reported_seq":2828,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T05:21:51.139120+0000","last_change":"2024-09-12T05:20:34.018441+0000","last_active":"2024-09-12T05:21:51.139120+0000","last_peered":"2024-09-12T05:21:51.139120+0000","last_clean":"2024-09-12T05:21:51.139120+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:21:51.139120+0000","last_undegraded":"2024-09-12T05:21:51.139120+0000","last_fullsized":"2024-09-12T05:21:51.139120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:08.307379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387196,"stat_sum":{"num_bytes":74211391,"num_objects":67,"num_object_clones":11,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":33,"num_read":3147,"num_read_kb":17842,"num_write":464,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"98'372","reported_seq":2363,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:52.054423+0000","last_change":"2024-09-12T05:21:03.164248+0000","last_active":"2024-09-12T05:21:52.054423+0000","last_peered":"2024-09-12T05:21:52.054423+0000","last_clean":"2024-09-12T05:21:02.482711+0000","last_became_active":"2024-09-12T05:21:03.164248+0000","last_became_peered":"2024-09-12T05:21:03.164248+0000","last_unstale":"2024-09-12T05:21:52.054423+0000","last_undegraded":"2024-09-12T05:21:03.161673+0000","last_fullsized":"2024-09-12T05:21:03.161442+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:12.603993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074458300000000005,"stat_sum":{"num_bytes":73849749,"num_objects":75,"num_object_clones":11,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":75,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":38,"num_read":2678,"num_read_kb":38814,"num_write":389,"num_write_kb":21115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":75}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"93'320","reported_seq":1613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T05:21:52.054234+0000","last_change":"2024-09-12T05:20:57.096516+0000","last_active":"2024-09-12T05:21:52.054234+0000","last_peered":"2024-09-12T05:21:52.054234+0000","last_clean":"2024-09-12T05:21:52.054234+0000","last_became_active":"2024-09-12T05:20:57.095147+0000","last_became_peered":"2024-09-12T05:20:57.095147+0000","last_unstale":"2024-09-12T05:21:52.054234+0000","last_undegraded":"2024-09-12T05:21:52.054234+0000","last_fullsized":"2024-09-12T05:21:52.054234+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:40.303118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347827,"stat_sum":{"num_bytes":60965382,"num_objects":63,"num_object_clones":12,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":35,"num_read":1786,"num_read_kb":36590,"num_write":357,"num_write_kb":28966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"97'429","reported_seq":3090,"reported_epoch":99,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:21:52.055088+0000","last_change":"2024-09-12T05:21:03.163550+0000","last_active":"2024-09-12T05:21:52.055088+0000","last_peered":"2024-09-12T05:21:52.055088+0000","last_clean":"2024-09-12T05:21:02.482791+0000","last_became_active":"2024-09-12T05:21:03.163550+0000","last_became_peered":"2024-09-12T05:21:03.163550+0000","last_unstale":"2024-09-12T05:21:52.055088+0000","last_undegraded":"2024-09-12T05:21:03.161537+0000","last_fullsized":"2024-09-12T05:21:03.161412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:27.885813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076674600000000001,"stat_sum":{"num_bytes":34065962,"num_objects":78,"num_object_clones":18,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":78,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":41,"num_read":3798,"num_read_kb":10571,"num_write":405,"num_write_kb":5654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":78}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1532881855,"num_objects":2277,"num_object_clones":388,"num_object_copies":4554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":803,"num_objects_misplaced":77,"num_objects_unfound":0,"num_objects_dirty":2277,"num_whiteouts":1222,"num_read":137667,"num_read_kb":824152,"num_write":19265,"num_write_kb":450131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":736,"num_bytes_recovered":39834912,"num_keys_recovered":61,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":606498816,"data_stored":765649740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15862,"ondisk_log_size":15862,"up":52,"acting":53,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162480,"kb_used_data":117404,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94209360,"statfs":{"total":96636764160,"available":96470384640,"internally_reserved":0,"allocated":120221696,"data_stored":158072712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57956,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94313884,"statfs":{"total":96636764160,"available":96577417216,"internally_reserved":0,"allocated":23150592,"data_stored":25969101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149508,"kb_used_data":82196,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94222332,"statfs":{"total":96636764160,"available":96483667968,"internally_reserved":0,"allocated":84168704,"data_stored":91629219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78564,"kb_used_data":39052,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94293276,"statfs":{"total":96636764160,"available":96556314624,"internally_reserved":0,"allocated":39989248,"data_stored":49268210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":168952,"kb_used_data":119720,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94202888,"statfs":{"total":96636764160,"available":96463757312,"internally_reserved":0,"allocated":122593280,"data_stored":154676715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58344,"kb_used_data":22996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94313496,"statfs":{"total":96636764160,"available":96577019904,"internally_reserved":0,"allocated":23547904,"data_stored":23711095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134792,"kb_used_data":91116,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94237048,"statfs":{"total":96636764160,"available":96498737152,"internally_reserved":0,"allocated":93302784,"data_stored":110733787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130352,"kb_used_data":103312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94241488,"statfs":{"total":96636764160,"available":96503283712,"internally_reserved":0,"allocated":105791488,"data_stored":153190079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":104038400,"data_stored":152061784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92303360,"data_stored":110338552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22409216,"data_stored":23189700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":121438208,"data_stored":154138852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39358464,"data_stored":48993160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86503424,"data_stored":94558418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21991424,"data_stored":25431174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118456320,"data_stored":156938100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:21:57.086 INFO:tasks.thrashosds.thrasher:Setting 3.9 to [0, 2] 2024-09-12T05:21:57.087 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.9', '0', '2'] 2024-09-12T05:21:57.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.9 0 2 2024-09-12T05:21:57.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:21:57.129 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:57.130 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:57.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:21:57.191 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone40 from 0xa7c4899 (overlap 0x130259b) to 0x5b3e7b 2024-09-12T05:21:57.192 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:57.191+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:57.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:57.251+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:57.337 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:57.337 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:57.337 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:21:57.337 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:21:57.337 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:57.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:21:57.354 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:57.355+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:57.388 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-12T05:21:57.420 INFO:teuthology.orchestra.run.smithi059.stdout:5356 writesame 0xd6a0263 thru 0xd6a1d22 data_size 0x20(0x1ac0 bytes) 2024-09-12T05:21:57.420 INFO:teuthology.orchestra.run.smithi059.stdout:5357 write 0x7f7c5c0 thru 0x7f8165e (0x509f bytes) 2024-09-12T05:21:57.428 INFO:teuthology.orchestra.run.smithi059.stdout:5358 writesame 0x5a73f73 thru 0x5a762ad data_size 0x1(0x233b bytes) 2024-09-12T05:21:57.437 INFO:teuthology.orchestra.run.smithi059.stdout:5359 writesame 0xa591101 thru 0xa59d33c data_size 0x3e(0xc23c bytes) 2024-09-12T05:21:57.442 INFO:teuthology.orchestra.run.smithi059.stdout:5361 write 0x8470ac3 thru 0x847657c (0x5aba bytes) 2024-09-12T05:21:57.446 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:57.446 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:57.454 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:21:57.455+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:21:57.455 INFO:teuthology.orchestra.run.smithi059.stdout:5365 trunc from 0xd6a1d23 to 0x74f6e3b 2024-09-12T05:21:57.485 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:57.486 INFO:teuthology.orchestra.run.smithi059.stdout:5367 punch from 0x59c604d to 0x59ce2bb, (0x826e bytes) 2024-09-12T05:21:57.486 INFO:teuthology.orchestra.run.smithi059.stdout:5368 punch from 0x181b7e to 0x181d9c, (0x21e bytes) 2024-09-12T05:21:57.486 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:57.494 INFO:teuthology.orchestra.run.smithi059.stdout:5370 write 0x76236d3 thru 0x762e05f (0xa98d bytes) 2024-09-12T05:21:57.497 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:57.497 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:21:57.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.078397078000002, 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.498 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:21:57.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:21:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:21:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:21:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.066948869000001, 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.504 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:21:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979333963999999, 2024-09-12T05:21:57.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:21:57.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.512 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979290859999999, 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979263611999997, 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.518 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:21:57.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:21:57.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979237331999997, 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.522 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:21:57.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:21:57.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979214720999998, 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:21:57.526 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:21:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.530 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979186892000001, 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:21:57.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979164472999997, 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:21:57.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:21:57.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979143340999997, 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:57.543 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979054707000003, 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:21:57.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.547 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.979023773000002, 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:21:57.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.978997610999997, 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.552 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:21:57.555 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.978975437000003, 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.556 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:21:57.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.978954322999996, 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.560 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:21:57.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.564 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.978932686, 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:21:57.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:21:57.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.978767771000001, 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:21:57.569 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:21:57.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:21:57.573 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.978740055000003, 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:21:57.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.893212159000001, 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:21:57.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:21:57.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:21:57.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:103340 3.0 3:06fad095:::rbd_data.1118e5d0fec8.00000000000000e6:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 124922~6150] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.525219226000001, 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95737219699999998, 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 103340 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.584 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:21:57.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972843+0000", 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5469999999999999e-06 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972859+0000", 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5625999999999999e-05 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972881+0000", 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.262e-05 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972893+0000", 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1866e-05 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972961+0000", 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8208999999999997e-05 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972973+0000", 2024-09-12T05:21:57.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1425e-05 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.927928+0000", 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95495565000000004 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928050+0000", 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012213799999999999 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928260+0000", 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000209626 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.929880+0000", 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016203019999999999 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930114+0000", 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023339699999999999 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930171+0000", 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7697e-05 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930213+0000", 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1094000000000003e-05 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:21:57.590 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:57.591 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:21:57.592 INFO:teuthology.orchestra.run.smithi059.stdout:5371 write 0x13df8d2 thru 0x13ef42d (0xfb5c bytes) 2024-09-12T05:21:57.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:21:57.593 INFO:teuthology.orchestra.run.smithi059.stdout:5373 write 0xbbe7c3b thru 0xbbf42d5 (0xc69b bytes) 2024-09-12T05:21:57.594 INFO:teuthology.orchestra.run.smithi059.stdout:5374 write 0x200cac0 thru 0x2016625 (0x9b66 bytes) 2024-09-12T05:21:57.594 INFO:teuthology.orchestra.run.smithi059.stdout:5375 punch from 0xac75871 to 0xac76212, (0x9a1 bytes) 2024-09-12T05:21:57.594 INFO:teuthology.orchestra.run.smithi059.stdout:5376 trunc from 0xbbf42d6 to 0x4bbe0f8 2024-09-12T05:21:57.594 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:57.587+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:57.598 INFO:teuthology.orchestra.run.smithi059.stdout:5377 writesame 0xb00aa20 thru 0xb00aa87 data_size 0x4(0x68 bytes) 2024-09-12T05:21:57.610 INFO:teuthology.orchestra.run.smithi059.stdout:5378 writesame 0xbe907b1 thru 0xbe9d4f9 data_size 0x1(0xcd49 bytes) 2024-09-12T05:21:57.618 INFO:teuthology.orchestra.run.smithi059.stdout:5379 trunc from 0xbe9d4fa to 0x6b755af 2024-09-12T05:21:57.640 INFO:teuthology.orchestra.run.smithi059.stdout:5381 writesame 0x7eec775 thru 0x7ef5aa7 data_size 0x9(0x9333 bytes) 2024-09-12T05:21:57.646 INFO:teuthology.orchestra.run.smithi059.stdout:5382 trunc from 0x7ef5aa8 to 0x4234a46 2024-09-12T05:21:57.693 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:57.691+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:57.695 INFO:teuthology.orchestra.run.smithi059.stdout:5383 write 0xbd21cea thru 0xbd26c85 (0x4f9c bytes) 2024-09-12T05:21:57.697 INFO:teuthology.orchestra.run.smithi059.stdout:5384 write 0x1b3d09e thru 0x1b3d71c (0x67f bytes) 2024-09-12T05:21:57.718 INFO:teuthology.orchestra.run.smithi059.stdout:5386 write 0xdfd5b67 thru 0xdfd7630 (0x1aca bytes) 2024-09-12T05:21:57.723 INFO:teuthology.orchestra.run.smithi059.stdout:5387 read 0x42461fd thru 0x4250a9e (0xa8a2 bytes) 2024-09-12T05:21:57.723 INFO:teuthology.orchestra.run.smithi059.stdout:5388 punch from 0xbb4aef6 to 0xbb4b439, (0x543 bytes) 2024-09-12T05:21:57.723 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:57.724 INFO:teuthology.orchestra.run.smithi059.stdout:5390 trunc from 0xdfd7631 to 0xebe4225 2024-09-12T05:21:57.727 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:21:57.727 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:21:57.727 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:21:57.727 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:21:57.736 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:57.736 INFO:teuthology.orchestra.run.smithi059.stdout:5392 write 0xd1de022 thru 0xd1e697f (0x895e bytes) 2024-09-12T05:21:57.742 INFO:teuthology.orchestra.run.smithi059.stdout:5393 write 0xe887802 thru 0xe89361f (0xbe1e bytes) 2024-09-12T05:21:57.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:21:57.747 INFO:teuthology.orchestra.run.smithi059.stdout:5394 write 0xd3048f3 thru 0xd310b6e (0xc27c bytes) 2024-09-12T05:21:57.750 INFO:teuthology.orchestra.run.smithi059.stdout:5395 writesame 0x4dc8bf5 thru 0x4dcd3f5 data_size 0x1(0x4801 bytes) 2024-09-12T05:21:57.758 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:21:57.759 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:21:57.775 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:21:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:21:57.780 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:57.780 INFO:teuthology.orchestra.run.smithi059.stdout:5397 writesame 0x9ea11a2 thru 0x9eaa524 data_size 0x1(0x9383 bytes) 2024-09-12T05:21:57.792 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:21:57.792 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:21:57.793 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:57.791+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:57.809 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:21:57.809 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:21:57.809 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:21:57.832 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:21:57.832 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:21:57.834 INFO:teuthology.orchestra.run.smithi059.stdout:5400 read 0x2683248 thru 0x268d48f (0xa248 bytes) 2024-09-12T05:21:57.835 INFO:teuthology.orchestra.run.smithi059.stdout:5402 punch from 0xe81b8d8 to 0xe821c31, (0x6359 bytes) 2024-09-12T05:21:57.835 INFO:teuthology.orchestra.run.smithi059.stdout:5403 write 0xe599efc thru 0xe59c096 (0x219b bytes) 2024-09-12T05:21:57.839 INFO:teuthology.orchestra.run.smithi059.stdout:5404 punch from 0xc9d7eff to 0xc9d882f, (0x930 bytes) 2024-09-12T05:21:57.839 INFO:teuthology.orchestra.run.smithi059.stdout:5405 write 0xa9d8b6 thru 0xaaafad (0xd6f8 bytes) 2024-09-12T05:21:57.852 INFO:teuthology.orchestra.run.smithi059.stdout:5406 trunc from 0xebe4225 to 0xa4444d9 2024-09-12T05:21:57.856 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:21:57.856 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:21:57.860 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:57.860 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:57.872 INFO:teuthology.orchestra.run.smithi059.stdout:5407 read 0x27d96ff thru 0x27dd0b6 (0x39b8 bytes) 2024-09-12T05:21:57.873 INFO:teuthology.orchestra.run.smithi059.stdout:5408 punch from 0x43a8c41 to 0x43b05f5, (0x79b4 bytes) 2024-09-12T05:21:57.873 INFO:teuthology.orchestra.run.smithi059.stdout:5409 read 0x4ccbf6b thru 0x4cd5219 (0x92af bytes) 2024-09-12T05:21:57.873 INFO:teuthology.orchestra.run.smithi059.stdout:5410 punch from 0x9fd31fd to 0x9fe08f4, (0xd6f7 bytes) 2024-09-12T05:21:57.873 INFO:teuthology.orchestra.run.smithi059.stdout:5412 write 0x650e544 thru 0x6514a5c (0x6519 bytes) 2024-09-12T05:21:57.874 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:21:57.876 INFO:teuthology.orchestra.run.smithi059.stdout:5414 read 0xa24841a thru 0xa24a42d (0x2014 bytes) 2024-09-12T05:21:57.876 INFO:teuthology.orchestra.run.smithi059.stdout:5416 read 0x4c15c73 thru 0x4c1fd88 (0xa116 bytes) 2024-09-12T05:21:57.877 INFO:teuthology.orchestra.run.smithi059.stdout:5417 read 0x1ed1b9e thru 0x1ed2d29 (0x118c bytes) 2024-09-12T05:21:57.877 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:21:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:21:57.877 INFO:teuthology.orchestra.run.smithi059.stdout:5418 write 0x487992a thru 0x487af35 (0x160c bytes) 2024-09-12T05:21:57.880 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:21:57.880 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:21:57.893 INFO:teuthology.orchestra.run.smithi059.stdout:5420 writesame 0xaeddb50 thru 0xaeeb2d9 data_size 0x2f(0xd78a bytes) 2024-09-12T05:21:57.893 INFO:teuthology.orchestra.run.smithi059.stdout:5422 writesame 0x9efafb5 thru 0x9f01147 data_size 0x1(0x6193 bytes) 2024-09-12T05:21:57.894 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:57.891+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:57.919 INFO:teuthology.orchestra.run.smithi059.stdout:5423 read 0x8adc762 thru 0x8adcffa (0x899 bytes) 2024-09-12T05:21:57.919 INFO:teuthology.orchestra.run.smithi059.stdout:5424 write 0xa2f5295 thru 0xa303c16 (0xe982 bytes) 2024-09-12T05:21:57.932 INFO:teuthology.orchestra.run.smithi059.stdout:5425 trunc from 0xaeeb2da to 0x659209f 2024-09-12T05:21:57.956 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:57.957 INFO:teuthology.orchestra.run.smithi059.stdout:5427 trunc from 0x659209f to 0x503f52b 2024-09-12T05:21:57.979 INFO:teuthology.orchestra.run.smithi059.stdout:5428 writesame 0x278b270 thru 0x2798943 data_size 0x6(0xd6d4 bytes) 2024-09-12T05:21:57.992 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:57.992 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:57.995 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:57.991+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:58.001 INFO:teuthology.orchestra.run.smithi059.stdout:5429 trunc from 0x503f52b to 0x98b5666 2024-09-12T05:21:58.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:21:58.014 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:58.025 INFO:teuthology.orchestra.run.smithi059.stdout:5433 write 0xa86f3ca thru 0xa877a11 (0x8648 bytes) 2024-09-12T05:21:58.034 INFO:teuthology.orchestra.run.smithi059.stdout:5434 trunc from 0xa877a12 to 0x5cbbd87 2024-09-12T05:21:58.048 INFO:teuthology.orchestra.run.smithi059.stdout:5435 write 0x511c590 thru 0x512ad29 (0xe79a bytes) 2024-09-12T05:21:58.054 INFO:teuthology.orchestra.run.smithi059.stdout:5436 read 0x547a19a thru 0x547a3e8 (0x24f bytes) 2024-09-12T05:21:58.054 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:58.057 INFO:teuthology.orchestra.run.smithi059.stdout:5438 trunc from 0x5cbbd87 to 0x8843a2e 2024-09-12T05:21:58.068 INFO:teuthology.orchestra.run.smithi059.stdout:5439 read 0x63097a3 thru 0x630fadf (0x633d bytes) 2024-09-12T05:21:58.068 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:21:58.068 INFO:teuthology.orchestra.run.smithi059.stdout:5444 writesame 0x7b3195e thru 0x7b34bdc data_size 0x1f(0x327f bytes) 2024-09-12T05:21:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:21:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:set 3.9 pg_upmap mapping to [0,2] 2024-09-12T05:21:58.091 INFO:teuthology.orchestra.run.smithi059.stdout:5445 write 0xc2d7039 thru 0xc2db515 (0x44dd bytes) 2024-09-12T05:21:58.095 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:58.095+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:58.096 INFO:teuthology.orchestra.run.smithi059.stdout:5448 writesame 0x3fb8f59 thru 0x3fc0831 data_size 0x1(0x78d9 bytes) 2024-09-12T05:21:58.119 INFO:teuthology.orchestra.run.smithi059.stdout:5449 flatten 2024-09-12T05:21:58.153 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:58.153 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:58.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:21:58.196 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:58.191+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:58.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:58.295+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:58.321 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:58.321 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:58.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:21:58.398 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:58.399+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:58.446 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:58.446 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:58.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:21:58.501 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:58.503+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:58.590 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:58.591 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:58.600 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:58.595+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:58.606 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:21:58.719 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:58.715+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:58.784 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:58.784 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:58.799 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:21:58.807 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:58.807+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:58.919 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:58.915+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:58.989 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:58.989 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:59.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:21:59.006 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:59.007+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:59.118 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:59.111+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:59.179 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:59.179 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:59.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:21:59.206 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:21:59.207+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:21:59.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:59.303+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:59.366 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:59.367 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:59.380 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:21:59.409 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:21:59.407+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:21:59.510 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:21:59.511+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:21:59.549 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:59.549 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:59.563 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:21:59.610 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:21:59.607+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:21:59.686 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:59.687 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:59.702 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:21:59.749 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:59.747+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:21:59.811 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:21:59.807+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:21:59.869 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:21:59.870 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:21:59.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:21:59.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:21:59.925 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:21:59.923+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:00.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:00.011+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:00.040 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:00.041 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:00.052 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:00.052 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:00.057 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:00.057 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:00.066 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:00.075 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:00.075 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:00.096 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:00.097 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:00.097 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:22:00.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:22:00.115 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:00.115 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:00.116 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:00.115+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:00.133 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:00.133 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:00.167 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:00.167 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:00.170 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:00.171 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:00.202 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:00.202 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:00.202 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:00.202 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:00.214 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:00.215+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:00.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:00.315 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:00.311+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:00.377 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:00.377 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:00.377 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:00.377 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:00.378 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:00.392 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:00.437 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:00.439+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:00.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:00.515+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:00.528 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 60.408014882000003, 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:00.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:22:00.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:22:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:22:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:22:00.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:22:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:22:00.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:22:00.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.077413812000003, 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:22:00.537 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.538 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.538 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:00.538 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.538 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.538 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.538 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:22:00.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.538 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:22:00.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:22:00.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:22:00.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:22:00.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:00.543 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.950853373999998, 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:22:00.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.950327848999997, 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:22:00.549 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:00.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:22:00.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:22:00.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.950305301, 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.555 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:22:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.950283511000002, 2024-09-12T05:22:00.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:22:00.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:22:00.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.565 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.950262146, 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:22:00.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:22:00.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:22:00.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:22:00.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.571 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.950239601, 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.572 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:00.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:22:00.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:22:00.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:22:00.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:22:00.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:22:00.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:22:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:22:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:22:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.950217365999997, 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:22:00.578 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:00.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:22:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.583 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.950195782000002, 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:22:00.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.588 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.949994383000003, 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.589 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:22:00.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:22:00.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.949968982999998, 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.594 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:22:00.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:22:00.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:00.599 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.942695706000002, 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:22:00.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.942673315999997, 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.605 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:22:00.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.609 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.942650667999999, 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.610 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:00.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:22:00.614 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.942630178999998, 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.615 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:22:00.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:22:00.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.942604113999998, 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.621 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:22:00.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.942580896999999, 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:22:00.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:22:00.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.630 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.942558533000003, 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.631 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:22:00.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.636 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.466018157000001, 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.637 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:00.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:22:00.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:00.643 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:00.643 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:00.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:00.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:00.639+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:00.745 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:00.743+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:00.819 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:00.819 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:00.820 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:00.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:00.877 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:00.879+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:00.947 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:00.947+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:00.954 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:00.954 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:00.954 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:00.954 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:00.954 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:00.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:01.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:01.043+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:01.060 INFO:teuthology.orchestra.run.smithi059.stdout:5450 write 0x99c43d3 thru 0x99d05fd (0xc22b bytes) 2024-09-12T05:22:01.065 INFO:teuthology.orchestra.run.smithi059.stdout:5451 write 0x8165bb8 thru 0x8175b50 (0xff99 bytes) 2024-09-12T05:22:01.073 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:01.074 INFO:teuthology.orchestra.run.smithi059.stdout:5456 read 0xc091f35 thru 0xc09d546 (0xb612 bytes) 2024-09-12T05:22:01.074 INFO:teuthology.orchestra.run.smithi059.stdout:5457 punch from 0x16cb2a4 to 0x16da64b, (0xf3a7 bytes) 2024-09-12T05:22:01.074 INFO:teuthology.orchestra.run.smithi059.stdout:5458 read 0x22b659a thru 0x22c1b8e (0xb5f5 bytes) 2024-09-12T05:22:01.074 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:01.074 INFO:teuthology.orchestra.run.smithi059.stdout:5460 writesame 0x2a4e5e4 thru 0x2a4eedf data_size 0xa(0x8fc bytes) 2024-09-12T05:22:01.077 INFO:teuthology.orchestra.run.smithi059.stdout:5461 write 0x2e62a43 thru 0x2e71ee6 (0xf4a4 bytes) 2024-09-12T05:22:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:22:01.098 INFO:teuthology.orchestra.run.smithi059.stdout:5462 write 0xca08f94 thru 0xca17b92 (0xebff bytes) 2024-09-12T05:22:01.106 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:01.106 INFO:teuthology.orchestra.run.smithi059.stdout:5464 clone 42 order 25 su 524288 sc 2 2024-09-12T05:22:01.148 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:01.147+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:01.160 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:01.160 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:01.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:01.160 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.741490597000002, 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.161 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:22:01.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.162 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:01.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:22:01.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:22:01.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:22:01.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.167 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.730042388000001, 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:22:01.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.169 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:01.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:01.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:01.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:01.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:22:01.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:22:01.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:22:01.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:22:01.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:22:01.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:22:01.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:22:01.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:22:01.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:22:01.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:22:01.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:22:01.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:22:01.175 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.175 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.175 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.175 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642427482999999, 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:22:01.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:22:01.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642384378999999, 2024-09-12T05:22:01.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:22:01.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:22:01.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:22:01.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:22:01.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642357130999997, 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.187 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:22:01.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642330850999997, 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.192 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:22:01.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:22:01.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:22:01.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:22:01.197 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.197 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.197 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.197 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.197 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:01.198 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642308239999998, 2024-09-12T05:22:01.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:22:01.198 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.198 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.198 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.198 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.198 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:01.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:01.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:22:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:22:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:22:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:22:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:22:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:22:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:22:01.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.204 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.204 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.204 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:01.204 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642280411000002, 2024-09-12T05:22:01.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:22:01.205 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.205 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.205 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.205 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:22:01.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:22:01.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:22:01.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:22:01.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.210 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642257991999998, 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:22:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642236859999997, 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.215 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:22:01.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642148226000003, 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.220 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:01.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:22:01.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.224 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642117292000002, 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:22:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:22:01.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642091129999997, 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.230 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:22:01.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.234 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642068956000003, 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.235 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:01.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:22:01.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:22:01.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:22:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:22:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:22:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.240 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642047841999997, 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.241 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:22:01.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:22:01.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:22:01.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:22:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:22:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:22:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:22:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.642026205000001, 2024-09-12T05:22:01.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:22:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.641861290000001, 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:01.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:22:01.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:22:01.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.257 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.641833574000003, 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:22:01.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.556305678000001, 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:22:01.262 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:01.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:22:01.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:22:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:22:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:22:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:22:01.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:22:01.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:01.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:22:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:22:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:22:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:22:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.270 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:103340 3.0 3:06fad095:::rbd_data.1118e5d0fec8.00000000000000e6:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 124922~6150] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-12T05:22:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.188312745000001, 2024-09-12T05:22:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95737219699999998, 2024-09-12T05:22:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.271 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 103340 2024-09-12T05:22:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972843+0000", 2024-09-12T05:22:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5469999999999999e-06 2024-09-12T05:22:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972859+0000", 2024-09-12T05:22:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5625999999999999e-05 2024-09-12T05:22:01.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972881+0000", 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.262e-05 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972893+0000", 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1866e-05 2024-09-12T05:22:01.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972961+0000", 2024-09-12T05:22:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8208999999999997e-05 2024-09-12T05:22:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972973+0000", 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1425e-05 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.927928+0000", 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95495565000000004 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928050+0000", 2024-09-12T05:22:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012213799999999999 2024-09-12T05:22:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:22:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928260+0000", 2024-09-12T05:22:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000209626 2024-09-12T05:22:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.929880+0000", 2024-09-12T05:22:01.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016203019999999999 2024-09-12T05:22:01.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:01.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930114+0000", 2024-09-12T05:22:01.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023339699999999999 2024-09-12T05:22:01.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930171+0000", 2024-09-12T05:22:01.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7697e-05 2024-09-12T05:22:01.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930213+0000", 2024-09-12T05:22:01.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1094000000000003e-05 2024-09-12T05:22:01.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.282 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.282 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.282 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:01.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:01.284 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:01.283+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:01.385 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:01.387+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:01.459 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:01.460 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:01.460 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:01.460 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:01.475 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:01.517 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:01.519+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:01.587 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:01.587+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:01.645 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:01.646 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:01.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:01.705 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:01.707+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:01.789 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:01.787+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:01.834 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:01.834 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:01.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:01.834 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:01.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.834 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 100.855623112, 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:22:01.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:22:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.943990795000005, 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.839 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:22:01.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:22:01.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.561290310999993, 2024-09-12T05:22:01.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:22:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:22:01.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.327246664, 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:22:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:22:01.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:01.852 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.297122333000004, 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:01.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:22:01.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.735034552000002, 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.733080333999993, 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:22:01.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:22:01.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 85.791771600000004, 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:22:01.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:22:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 85.775175007000001, 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:22:01.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:22:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 84.604835566999995, 2024-09-12T05:22:01.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 76.726381314999998, 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.879 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:22:01.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:22:01.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:22:01.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:22:01.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:01.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:22:01.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:22:01.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:22:01.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:22:01.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:22:01.886 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.886 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.886 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.887 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:22:01.887 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:01.887 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 76.726336220999997, 2024-09-12T05:22:01.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:22:01.888 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.888 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.888 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.888 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:01.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:01.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:01.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:01.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:22:01.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:22:01.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:22:01.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:22:01.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:22:01.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:22:01.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:01.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:22:01.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:22:01.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:22:01.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:22:01.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:22:01.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:22:01.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:22:01.896 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.897 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.897 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.897 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:22:01.897 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:01.897 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 76.717774660000003, 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:22:01.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.902 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.915736500999998, 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:22:01.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 66.401613062999999, 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.907 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:22:01.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:22:01.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 66.393526971, 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.912 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.491340723999997, 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.917 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:22:01.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.922 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.513940802999997, 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:01.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:22:01.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:22:01.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:22:01.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 47.761793822999998, 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.402544091999999, 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:01.934 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:22:01.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:01.939 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:01.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:22:01.941 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:01.943+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:02.042 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:02.043+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:02.127 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:02.127 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:02.128 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:02.128 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:02.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:22:02.143 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:02.143+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:02.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:02.244 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:02.243+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:02.311 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:02.311 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:02.311 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:02.311 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:02.311 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:02.331 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:22:02.336 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:02.370 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:02.371 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:02.371+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:02.393 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:02.412 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:02.412 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:02.412 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:22:02.433 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:02.433 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:02.445 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:02.447+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:02.457 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:02.457 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:02.457 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:02.477 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:02.480 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-12T05:22:02.486 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:02.487 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:02.490 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:02.491 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:02.491 INFO:teuthology.orchestra.run.smithi059.stdout:5466 punch from 0x44d7e37 to 0x44dd866, (0x5a2f bytes) 2024-09-12T05:22:02.496 INFO:teuthology.orchestra.run.smithi059.stdout:5467 write 0xa53a537 thru 0xa5412c7 (0x6d91 bytes) 2024-09-12T05:22:02.503 INFO:teuthology.orchestra.run.smithi059.stdout:5468 punch from 0x29583d4 to 0x296081b, (0x8447 bytes) 2024-09-12T05:22:02.505 INFO:teuthology.orchestra.run.smithi059.stdout:5469 trunc from 0xca17b93 to 0xd8adf61 2024-09-12T05:22:02.512 INFO:teuthology.orchestra.run.smithi059.stdout:5470 read 0x7734ad2 thru 0x773f77e (0xacad bytes) 2024-09-12T05:22:02.512 INFO:teuthology.orchestra.run.smithi059.stdout:5471 write 0x68c6f45 thru 0x68d03c2 (0x947e bytes) 2024-09-12T05:22:02.522 INFO:teuthology.orchestra.run.smithi059.stdout:5472 read 0x6e7b230 thru 0x6e7c34b (0x111c bytes) 2024-09-12T05:22:02.522 INFO:teuthology.orchestra.run.smithi059.stdout:5473 read 0x8064cd thru 0x80abd6 (0x470a bytes) 2024-09-12T05:22:02.522 INFO:teuthology.orchestra.run.smithi059.stdout:5475 read 0x61c1ee0 thru 0x61c532e (0x344f bytes) 2024-09-12T05:22:02.522 INFO:teuthology.orchestra.run.smithi059.stdout:5476 read 0xb750e76 thru 0xb75d2d8 (0xc463 bytes) 2024-09-12T05:22:02.522 INFO:teuthology.orchestra.run.smithi059.stdout:5477 write 0x96848bf thru 0x968cea3 (0x85e5 bytes) 2024-09-12T05:22:02.528 INFO:teuthology.orchestra.run.smithi059.stdout:5478 writesame 0xd00ada8 thru 0xd014a63 data_size 0xe(0x9cbc bytes) 2024-09-12T05:22:02.546 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:02.543+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:02.613 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:02.613 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:02.627 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:02.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:02.667+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:02.748 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:02.743+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:02.789 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:02.789 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:02.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:02.889 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:02.887+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:02.950 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:02.951+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:02.970 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:02.970 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:02.984 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:03.051 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:03.051+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:03.103 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6, 2] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-12T05:22:03.104 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:22:03.104 INFO:tasks.thrashosds.thrasher:Reviving osd 4 2024-09-12T05:22:03.104 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T05:22:03.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T05:22:03.106 INFO:tasks.ceph.osd.4:Started 2024-09-12T05:22:03.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:03.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:22:03.141 INFO:teuthology.orchestra.run.smithi059.stdout:5479 read 0x4698afe thru 0x46a019c (0x769f bytes) 2024-09-12T05:22:03.142 INFO:teuthology.orchestra.run.smithi059.stdout:5480 read 0x1106986 thru 0x110853a (0x1bb5 bytes) 2024-09-12T05:22:03.142 INFO:teuthology.orchestra.run.smithi059.stdout:5482 read 0x91e9e24 thru 0x91ee3ed (0x45ca bytes) 2024-09-12T05:22:03.143 INFO:teuthology.orchestra.run.smithi059.stdout:5483 punch from 0x90a3988 to 0x90aaa51, (0x70c9 bytes) 2024-09-12T05:22:03.143 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.143 INFO:teuthology.orchestra.run.smithi059.stdout:5486 punch from 0x3d13a2f to 0x3d1f687, (0xbc58 bytes) 2024-09-12T05:22:03.143 INFO:teuthology.orchestra.run.smithi059.stdout:5488 read 0xa4d7c8e thru 0xa4df29f (0x7612 bytes) 2024-09-12T05:22:03.144 INFO:teuthology.orchestra.run.smithi059.stdout:5489 write 0x17d95f9 thru 0x17e6e94 (0xd89c bytes) 2024-09-12T05:22:03.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:03.151+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:03.155 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:03.155 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:03.158 INFO:teuthology.orchestra.run.smithi059.stdout:5490 read 0xcf7d17 thru 0xcf8514 (0x7fe bytes) 2024-09-12T05:22:03.174 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:03.180 INFO:teuthology.orchestra.run.smithi059.stdout:5491 trunc from 0xd8adf61 to 0x4cd4f72 2024-09-12T05:22:03.200 INFO:teuthology.orchestra.run.smithi059.stdout:5494 punch from 0x1b03f1c to 0x1b0855a, (0x463e bytes) 2024-09-12T05:22:03.200 INFO:teuthology.orchestra.run.smithi059.stdout:5495 punch from 0x28064c4 to 0x280679a, (0x2d6 bytes) 2024-09-12T05:22:03.200 INFO:teuthology.orchestra.run.smithi059.stdout:5496 read 0x87099f thru 0x877d27 (0x7389 bytes) 2024-09-12T05:22:03.204 INFO:teuthology.orchestra.run.smithi059.stdout:5497 trunc from 0x4cd4f72 to 0x68d4123 2024-09-12T05:22:03.210 INFO:teuthology.orchestra.run.smithi059.stdout:5498 punch from 0x2f9733a to 0x2fa54c1, (0xe187 bytes) 2024-09-12T05:22:03.210 INFO:teuthology.orchestra.run.smithi059.stdout:5499 punch from 0x4ba8fbe to 0x4bb37ff, (0xa841 bytes) 2024-09-12T05:22:03.214 INFO:teuthology.orchestra.run.smithi059.stdout:5500 trunc from 0x68d4123 to 0x8de23b3 2024-09-12T05:22:03.221 INFO:teuthology.orchestra.run.smithi059.stdout:5501 write 0x13ed064 thru 0x13f7bf5 (0xab92 bytes) 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:no valid command found; 10 closest matches: 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:0 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:1 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:abort 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:assert 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:config diff 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:config diff get 2024-09-12T05:22:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:config get 2024-09-12T05:22:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:config help [] 2024-09-12T05:22:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:config set ... 2024-09-12T05:22:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:admin_socket: invalid command 2024-09-12T05:22:03.227 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T05:22:03.228 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-4, ['dump_ops_in_flight'] 2024-09-12T05:22:03.233 INFO:teuthology.orchestra.run.smithi059.stdout:5502 writesame 0xafd7978 thru 0xafe0df3 data_size 0x44(0x947c bytes) 2024-09-12T05:22:03.233 INFO:teuthology.orchestra.run.smithi059.stdout:5504 punch from 0x3585468 to 0x3585ef4, (0xa8c bytes) 2024-09-12T05:22:03.242 INFO:teuthology.orchestra.run.smithi059.stdout:5505 writesame 0xc06b276 thru 0xc075d31 data_size 0x7(0xaabc bytes) 2024-09-12T05:22:03.243 INFO:teuthology.orchestra.run.smithi059.stdout:5506 punch from 0xab0fafa to 0xab17abb, (0x7fc1 bytes) 2024-09-12T05:22:03.253 INFO:teuthology.orchestra.run.smithi059.stdout:5507 writesame 0xc753db9 thru 0xc75ad56 data_size 0x5b(0x6f9e bytes) 2024-09-12T05:22:03.253 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.253 INFO:teuthology.orchestra.run.smithi059.stdout:5509 read 0x4fc34ec thru 0x4fca91f (0x7434 bytes) 2024-09-12T05:22:03.253 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:03.255+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:03.254 INFO:teuthology.orchestra.run.smithi059.stdout:5510 read 0x8256bca thru 0x825ad7c (0x41b3 bytes) 2024-09-12T05:22:03.254 INFO:teuthology.orchestra.run.smithi059.stdout:5511 read 0x20aa430 thru 0x20afe26 (0x59f7 bytes) 2024-09-12T05:22:03.254 INFO:teuthology.orchestra.run.smithi059.stdout:5512 writesame 0x253f1df thru 0x2549255 data_size 0x1(0xa077 bytes) 2024-09-12T05:22:03.283 INFO:teuthology.orchestra.run.smithi059.stdout:5513 write 0xa3f39aa thru 0xa3f3db2 (0x409 bytes) 2024-09-12T05:22:03.287 INFO:teuthology.orchestra.run.smithi059.stdout:5514 write 0x2776a74 thru 0x2778b62 (0x20ef bytes) 2024-09-12T05:22:03.288 INFO:teuthology.orchestra.run.smithi059.stdout:5517 write 0x70acf82 thru 0x70b0761 (0x37e0 bytes) 2024-09-12T05:22:03.290 INFO:teuthology.orchestra.run.smithi059.stdout:5518 read 0x1176b3c thru 0x1185927 (0xedec bytes) 2024-09-12T05:22:03.290 INFO:teuthology.orchestra.run.smithi059.stdout:5519 punch from 0x9262b0e to 0x92655bb, (0x2aad bytes) 2024-09-12T05:22:03.290 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.291 INFO:teuthology.orchestra.run.smithi059.stdout:5521 read 0x58d9ef7 thru 0x58df94a (0x5a54 bytes) 2024-09-12T05:22:03.291 INFO:teuthology.orchestra.run.smithi059.stdout:5522 read 0xb247d65 thru 0xb257042 (0xf2de bytes) 2024-09-12T05:22:03.291 INFO:teuthology.orchestra.run.smithi059.stdout:5523 read 0xaef21d8 thru 0xaef6a2c (0x4855 bytes) 2024-09-12T05:22:03.291 INFO:teuthology.orchestra.run.smithi059.stdout:5525 read 0x87f32b7 thru 0x87f401f (0xd69 bytes) 2024-09-12T05:22:03.292 INFO:teuthology.orchestra.run.smithi059.stdout:5527 writesame 0x44bb20a thru 0x44c1075 data_size 0x2(0x5e6c bytes) 2024-09-12T05:22:03.315 INFO:teuthology.orchestra.run.smithi059.stdout:5528 trunc from 0xc75ad57 to 0x488219 2024-09-12T05:22:03.333 INFO:teuthology.orchestra.run.smithi059.stdout:5529 read 0x39b2dc thru 0x3a55ba (0xa2df bytes) 2024-09-12T05:22:03.338 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:03.338 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:03.353 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:03.353 INFO:teuthology.orchestra.run.smithi059.stdout:5532 writesame 0x78f88bc thru 0x78f9ee1 data_size 0x1e(0x1626 bytes) 2024-09-12T05:22:03.354 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:03.355+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:03.361 INFO:teuthology.orchestra.run.smithi059.stdout:5534 writesame 0x881f646 thru 0x882292c data_size 0x1(0x32e7 bytes) 2024-09-12T05:22:03.361 INFO:teuthology.orchestra.run.smithi059.stdout:5536 read 0x19a355 thru 0x1a0b5a (0x6806 bytes) 2024-09-12T05:22:03.374 INFO:teuthology.orchestra.run.smithi059.stdout:5537 write 0xa8e8591 thru 0xa8f31d7 (0xac47 bytes) 2024-09-12T05:22:03.377 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.377 INFO:teuthology.orchestra.run.smithi059.stdout:5539 punch from 0x4d4555d to 0x4d4dc95, (0x8738 bytes) 2024-09-12T05:22:03.378 INFO:teuthology.orchestra.run.smithi059.stdout:5540 read 0x3167173 thru 0x3167bf5 (0xa83 bytes) 2024-09-12T05:22:03.378 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.378 INFO:teuthology.orchestra.run.smithi059.stdout:5543 writesame 0x1316b47 thru 0x1324b57 data_size 0x1(0xe011 bytes) 2024-09-12T05:22:03.399 INFO:teuthology.orchestra.run.smithi059.stdout:5546 punch from 0x1ba7242 to 0x1bacef4, (0x5cb2 bytes) 2024-09-12T05:22:03.399 INFO:teuthology.orchestra.run.smithi059.stdout:5547 write 0x47f4920 thru 0x47f619a (0x187b bytes) 2024-09-12T05:22:03.404 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.404 INFO:teuthology.orchestra.run.smithi059.stdout:5549 write 0x71a9dca thru 0x71b5468 (0xb69f bytes) 2024-09-12T05:22:03.406 INFO:teuthology.orchestra.run.smithi059.stdout:5550 write 0x84e5e83 thru 0x84ebe26 (0x5fa4 bytes) 2024-09-12T05:22:03.408 INFO:teuthology.orchestra.run.smithi059.stdout:5552 punch from 0x45fc41d to 0x460c355, (0xff38 bytes) 2024-09-12T05:22:03.408 INFO:teuthology.orchestra.run.smithi059.stdout:5553 punch from 0x10c2208 to 0x10c65d4, (0x43cc bytes) 2024-09-12T05:22:03.408 INFO:teuthology.orchestra.run.smithi059.stdout:5554 read 0x80ca3a5 thru 0x80d1e54 (0x7ab0 bytes) 2024-09-12T05:22:03.420 INFO:teuthology.orchestra.run.smithi059.stdout:5555 write 0xcdc07fb thru 0xcdcc449 (0xbc4f bytes) 2024-09-12T05:22:03.438 INFO:teuthology.orchestra.run.smithi059.stdout:5556 trunc from 0xcdcc44a to 0x7e3ff33 2024-09-12T05:22:03.455 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:03.455+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:03.475 INFO:teuthology.orchestra.run.smithi059.stdout:5557 writesame 0x938f743 thru 0x9394b0f data_size 0x1(0x53cd bytes) 2024-09-12T05:22:03.480 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:03.480 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:03.483 INFO:teuthology.orchestra.run.smithi059.stdout:5559 trunc from 0x9394b10 to 0xd579178 2024-09-12T05:22:03.494 INFO:teuthology.orchestra.run.smithi059.stdout:5561 write 0x4778685 thru 0x477bc95 (0x3611 bytes) 2024-09-12T05:22:03.495 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:03.501 INFO:teuthology.orchestra.run.smithi059.stdout:5562 write 0x1278537 thru 0x1283789 (0xb253 bytes) 2024-09-12T05:22:03.503 INFO:teuthology.orchestra.run.smithi059.stdout:5563 write 0x4033f1b thru 0x403a662 (0x6748 bytes) 2024-09-12T05:22:03.512 INFO:teuthology.orchestra.run.smithi059.stdout:5564 trunc from 0xd579178 to 0xac13405 2024-09-12T05:22:03.522 INFO:teuthology.orchestra.run.smithi059.stdout:5565 write 0x223ba77 thru 0x22451d7 (0x9761 bytes) 2024-09-12T05:22:03.536 INFO:teuthology.orchestra.run.smithi059.stdout:5566 trunc from 0xac13405 to 0x6104dfc 2024-09-12T05:22:03.556 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:03.555+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:03.572 INFO:teuthology.orchestra.run.smithi059.stdout:5567 writesame 0x863bd40 thru 0x86417eb data_size 0xe(0x5aac bytes) 2024-09-12T05:22:03.572 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.572 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.572 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.587 INFO:teuthology.orchestra.run.smithi059.stdout:5571 trunc from 0x86417ec to 0x12cda9a 2024-09-12T05:22:03.616 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:03.616 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:03.630 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:03.633 INFO:teuthology.orchestra.run.smithi059.stdout:5572 write 0x34002ce thru 0x3406a8e (0x67c1 bytes) 2024-09-12T05:22:03.636 INFO:teuthology.orchestra.run.smithi059.stdout:5573 punch from 0x1c47ac9 to 0x1c47b52, (0x89 bytes) 2024-09-12T05:22:03.636 INFO:teuthology.orchestra.run.smithi059.stdout:5575 read 0x3ed8f6 thru 0x3f79c5 (0xa0d0 bytes) 2024-09-12T05:22:03.645 INFO:teuthology.orchestra.run.smithi059.stdout:5576 trunc from 0x3406a8f to 0x681bf1 2024-09-12T05:22:03.681 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:03.679+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:03.684 INFO:teuthology.orchestra.run.smithi059.stdout:5577 write 0x265d99b thru 0x2663404 (0x5a6a bytes) 2024-09-12T05:22:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:5578 write 0x206c8a8 thru 0x2074f92 (0x86eb bytes) 2024-09-12T05:22:03.690 INFO:teuthology.orchestra.run.smithi059.stdout:5582 read 0x7738eb thru 0x781b52 (0xe268 bytes) 2024-09-12T05:22:03.692 INFO:teuthology.orchestra.run.smithi059.stdout:5583 punch from 0x14fab7c to 0x1506e30, (0xc2b4 bytes) 2024-09-12T05:22:03.716 INFO:teuthology.orchestra.run.smithi059.stdout:5584 trunc from 0x2663405 to 0xb52be8b 2024-09-12T05:22:03.730 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:03.738 INFO:teuthology.orchestra.run.smithi059.stdout:5587 trunc from 0xb52be8b to 0x8696ff3 2024-09-12T05:22:03.751 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:03.751 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:03.752 INFO:teuthology.orchestra.run.smithi059.stdout:5588 punch from 0x6a40a0b to 0x6a4718d, (0x6782 bytes) 2024-09-12T05:22:03.757 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:03.759+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:03.766 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:03.769 INFO:teuthology.orchestra.run.smithi059.stdout:5590 trunc from 0x8696ff3 to 0x237e945 2024-09-12T05:22:03.784 INFO:teuthology.orchestra.run.smithi059.stdout:5591 punch from 0x1342c9a to 0x134fc2b, (0xcf91 bytes) 2024-09-12T05:22:03.804 INFO:teuthology.orchestra.run.smithi059.stdout:5592 write 0x4c2ce11 thru 0x4c37042 (0xa232 bytes) 2024-09-12T05:22:03.810 INFO:teuthology.orchestra.run.smithi059.stdout:5593 write 0x84ee32 thru 0x85617d (0x734c bytes) 2024-09-12T05:22:03.813 INFO:teuthology.orchestra.run.smithi059.stdout:5594 read 0x1e8c2c thru 0x1f319a (0xa56f bytes) 2024-09-12T05:22:03.814 INFO:teuthology.orchestra.run.smithi059.stdout:5595 punch from 0x1b13518 to 0x1b15c63, (0x274b bytes) 2024-09-12T05:22:03.814 INFO:teuthology.orchestra.run.smithi059.stdout:5596 writesame 0x181cb84 thru 0x1824067 data_size 0x2(0x74e4 bytes) 2024-09-12T05:22:03.832 INFO:teuthology.orchestra.run.smithi059.stdout:5597 writesame 0x42f6209 thru 0x430167e data_size 0x1(0xb476 bytes) 2024-09-12T05:22:03.858 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:03.855+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:03.890 INFO:teuthology.orchestra.run.smithi059.stdout:5598 read 0x1367feb thru 0x136e5dc (0x65f2 bytes) 2024-09-12T05:22:03.895 INFO:teuthology.orchestra.run.smithi059.stdout:5600 trunc from 0x4c37043 to 0x3199afa 2024-09-12T05:22:03.919 INFO:teuthology.orchestra.run.smithi059.stdout:5602 punch from 0xdab904 to 0xdb3a6d, (0x8169 bytes) 2024-09-12T05:22:03.933 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:03.934 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:03.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:03.957 INFO:teuthology.orchestra.run.smithi059.stdout:5604 writesame 0xbf2fc38 thru 0xbf3acbf data_size 0x1c(0xb088 bytes) 2024-09-12T05:22:03.973 INFO:teuthology.orchestra.run.smithi059.stdout:5605 write 0xe122b2d thru 0xe1303b3 (0xd887 bytes) 2024-09-12T05:22:03.980 INFO:teuthology.orchestra.run.smithi059.stdout:5606 write 0xd170d8d thru 0xd175df7 (0x506b bytes) 2024-09-12T05:22:03.993 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:03.991+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:03.999 INFO:teuthology.orchestra.run.smithi059.stdout:5607 trunc from 0xe1303b4 to 0x3c149c4 2024-09-12T05:22:04.029 INFO:teuthology.orchestra.run.smithi059.stdout:5608 writesame 0x5ab486a thru 0x5abe961 data_size 0x88(0xa0f8 bytes) 2024-09-12T05:22:04.029 INFO:teuthology.orchestra.run.smithi059.stdout:5609 punch from 0x4206757 to 0x420850b, (0x1db4 bytes) 2024-09-12T05:22:04.059 INFO:teuthology.orchestra.run.smithi059.stdout:5611 writesame 0xd7215fe thru 0xd72e497 data_size 0xf(0xce9a bytes) 2024-09-12T05:22:04.059 INFO:teuthology.orchestra.run.smithi059.stdout:5612 read 0x40b456 thru 0x415572 (0xa11d bytes) 2024-09-12T05:22:04.060 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.060 INFO:teuthology.orchestra.run.smithi059.stdout:5615 punch from 0x54143a8 to 0x54201f5, (0xbe4d bytes) 2024-09-12T05:22:04.060 INFO:teuthology.orchestra.run.smithi059.stdout:5618 read 0xd0b825f thru 0xd0c2b29 (0xa8cb bytes) 2024-09-12T05:22:04.060 INFO:teuthology.orchestra.run.smithi059.stdout:5619 writesame 0x5b0b3fd thru 0x5b0fa11 data_size 0xb(0x4615 bytes) 2024-09-12T05:22:04.060 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:04.059+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:04.071 INFO:teuthology.orchestra.run.smithi059.stdout:5620 trunc from 0xd72e498 to 0xeb6b4d2 2024-09-12T05:22:04.086 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:04.086 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:04.101 INFO:teuthology.orchestra.run.smithi059.stdout:5621 trunc from 0xeb6b4d2 to 0x4abc16b 2024-09-12T05:22:04.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:04.122 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:22:04.134 INFO:teuthology.orchestra.run.smithi059.stdout:5625 write 0x619b160 thru 0x61a8181 (0xd022 bytes) 2024-09-12T05:22:04.146 INFO:teuthology.orchestra.run.smithi059.stdout:5627 read 0x1c8143d thru 0x1c8cbc0 (0xb784 bytes) 2024-09-12T05:22:04.161 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:04.159+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:04.163 INFO:teuthology.orchestra.run.smithi059.stdout:5628 write 0xb206a06 thru 0xb210fbc (0xa5b7 bytes) 2024-09-12T05:22:04.188 INFO:teuthology.orchestra.run.smithi059.stdout:5629 trunc from 0xb210fbd to 0x44ce07e 2024-09-12T05:22:04.207 INFO:teuthology.orchestra.run.smithi059.stdout:5630 write 0x3d1ebdd thru 0x3d1fdc8 (0x11ec bytes) 2024-09-12T05:22:04.221 INFO:teuthology.orchestra.run.smithi059.stdout:5631 writesame 0x5a9816a thru 0x5a9e6d0 data_size 0x3(0x6567 bytes) 2024-09-12T05:22:04.223 INFO:teuthology.orchestra.run.smithi059.stdout:5632 read 0x4cb9af4 thru 0x4cc2594 (0x8aa1 bytes) 2024-09-12T05:22:04.223 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.223 INFO:teuthology.orchestra.run.smithi059.stdout:5637 read 0x58a38fb thru 0x58b0353 (0xca59 bytes) 2024-09-12T05:22:04.224 INFO:teuthology.orchestra.run.smithi059.stdout:5638 read 0x206bb6f thru 0x207b842 (0xfcd4 bytes) 2024-09-12T05:22:04.225 INFO:teuthology.orchestra.run.smithi059.stdout:5639 punch from 0x321fd01 to 0x322e5f4, (0xe8f3 bytes) 2024-09-12T05:22:04.225 INFO:teuthology.orchestra.run.smithi059.stdout:5640 read 0x1aa9d21 thru 0x1ab7481 (0xd761 bytes) 2024-09-12T05:22:04.226 INFO:teuthology.orchestra.run.smithi059.stdout:5642 punch from 0x4120eeb to 0x4121911, (0xa26 bytes) 2024-09-12T05:22:04.226 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.235 INFO:teuthology.orchestra.run.smithi059.stdout:5644 trunc from 0x5a9e6d1 to 0xb8fa08c 2024-09-12T05:22:04.259 INFO:teuthology.orchestra.run.smithi059.stdout:5645 trunc from 0xb8fa08c to 0x48f3f70 2024-09-12T05:22:04.259 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:04.260 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:04.262 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:04.263+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:04.270 INFO:teuthology.orchestra.run.smithi059.stdout:5647 punch from 0x27021ec to 0x2702bb9, (0x9cd bytes) 2024-09-12T05:22:04.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:04.283 INFO:teuthology.orchestra.run.smithi059.stdout:5649 write 0x67e7ad8 thru 0x67f3c7c (0xc1a5 bytes) 2024-09-12T05:22:04.285 INFO:teuthology.orchestra.run.smithi059.stdout:5652 write 0x1e9f504 thru 0x1ea9d21 (0xa81e bytes) 2024-09-12T05:22:04.288 INFO:teuthology.orchestra.run.smithi059.stdout:5653 read 0x1106c0 thru 0x1198e6 (0x9227 bytes) 2024-09-12T05:22:04.289 INFO:teuthology.orchestra.run.smithi059.stdout:5654 read 0x4290727 thru 0x429b63c (0xaf16 bytes) 2024-09-12T05:22:04.290 INFO:teuthology.orchestra.run.smithi059.stdout:5655 read 0x4c6a757 thru 0x4c79f26 (0xf7d0 bytes) 2024-09-12T05:22:04.290 INFO:teuthology.orchestra.run.smithi059.stdout:5656 write 0xac834e thru 0xad1c70 (0x9923 bytes) 2024-09-12T05:22:04.304 INFO:teuthology.orchestra.run.smithi059.stdout:5657 writesame 0x835cc6c thru 0x83645c3 data_size 0x16(0x7958 bytes) 2024-09-12T05:22:04.317 INFO:teuthology.orchestra.run.smithi059.stdout:5658 write 0xaa9c726 thru 0xaaa82cf (0xbbaa bytes) 2024-09-12T05:22:04.323 INFO:teuthology.orchestra.run.smithi059.stdout:5659 flatten 2024-09-12T05:22:04.331 INFO:teuthology.orchestra.run.smithi059.stdout:5660 write 0xaa4b9b9 thru 0xaa548df (0x8f27 bytes) 2024-09-12T05:22:04.338 INFO:teuthology.orchestra.run.smithi059.stdout:5661 writesame 0x8201075 thru 0x820c61f data_size 0x1(0xb5ab bytes) 2024-09-12T05:22:04.363 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:04.359+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:04.400 INFO:teuthology.orchestra.run.smithi059.stdout:5662 write 0x68eebf8 thru 0x68fd1cf (0xe5d8 bytes) 2024-09-12T05:22:04.403 INFO:teuthology.orchestra.run.smithi059.stdout:5663 write 0x94c44d2 thru 0x94d166e (0xd19d bytes) 2024-09-12T05:22:04.407 INFO:teuthology.orchestra.run.smithi059.stdout:5664 punch from 0x2382757 to 0x238fc2d, (0xd4d6 bytes) 2024-09-12T05:22:04.407 INFO:teuthology.orchestra.run.smithi059.stdout:5665 punch from 0x354d9c to 0x363bd5, (0xee39 bytes) 2024-09-12T05:22:04.407 INFO:teuthology.orchestra.run.smithi059.stdout:5666 write 0xdd9f9 thru 0xe0f90 (0x3598 bytes) 2024-09-12T05:22:04.411 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:04.411 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:04.412 INFO:teuthology.orchestra.run.smithi059.stdout:5667 punch from 0x298e64c to 0x299da00, (0xf3b4 bytes) 2024-09-12T05:22:04.412 INFO:teuthology.orchestra.run.smithi059.stdout:5668 read 0x19c977 thru 0x1a2986 (0x6010 bytes) 2024-09-12T05:22:04.412 INFO:teuthology.orchestra.run.smithi059.stdout:5669 punch from 0x98699a2 to 0x986bef9, (0x2557 bytes) 2024-09-12T05:22:04.412 INFO:teuthology.orchestra.run.smithi059.stdout:5670 punch from 0x866b7b6 to 0x86736f5, (0x7f3f bytes) 2024-09-12T05:22:04.413 INFO:teuthology.orchestra.run.smithi059.stdout:5672 read 0x4932190 thru 0x4933469 (0x12da bytes) 2024-09-12T05:22:04.413 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.413 INFO:teuthology.orchestra.run.smithi059.stdout:5674 read 0x8719dec thru 0x8721552 (0x7767 bytes) 2024-09-12T05:22:04.414 INFO:teuthology.orchestra.run.smithi059.stdout:5676 write 0x41cf257 thru 0x41d0087 (0xe31 bytes) 2024-09-12T05:22:04.419 INFO:teuthology.orchestra.run.smithi059.stdout:5680 writesame 0x241e96f thru 0x241fa38 data_size 0x7(0x10ca bytes) 2024-09-12T05:22:04.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:04.436 INFO:teuthology.orchestra.run.smithi059.stdout:5682 trunc from 0xaaa82d0 to 0x2e9ef93 2024-09-12T05:22:04.463 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:04.459+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:04.487 INFO:teuthology.orchestra.run.smithi059.stdout:5683 writesame 0x98023d8 thru 0x98068d9 data_size 0x16(0x4502 bytes) 2024-09-12T05:22:04.487 INFO:teuthology.orchestra.run.smithi059.stdout:5684 read 0x7e97e1c thru 0x7e9e32b (0x6510 bytes) 2024-09-12T05:22:04.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:04.501 INFO:teuthology.orchestra.run.smithi059.stdout:5686 trunc from 0x98068da to 0x1cefccc 2024-09-12T05:22:04.540 INFO:teuthology.orchestra.run.smithi059.stdout:5687 write 0xce56b1c thru 0xce5ead9 (0x7fbe bytes) 2024-09-12T05:22:04.545 INFO:teuthology.orchestra.run.smithi059.stdout:5688 write 0xb89199e thru 0xb89e742 (0xcda5 bytes) 2024-09-12T05:22:04.552 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.553 INFO:teuthology.orchestra.run.smithi059.stdout:5690 write 0x92791cd thru 0x9287bcb (0xe9ff bytes) 2024-09-12T05:22:04.559 INFO:teuthology.orchestra.run.smithi059.stdout:5692 read 0x3a9e340 thru 0x3aa5576 (0x7237 bytes) 2024-09-12T05:22:04.560 INFO:teuthology.orchestra.run.smithi059.stdout:5694 write 0xa50c664 thru 0xa51b81a (0xf1b7 bytes) 2024-09-12T05:22:04.564 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:04.563+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:04.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:04.563+0000 7f35ea9257c0 -1 Falling back to public interface 2024-09-12T05:22:04.574 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:04.575 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:04.576 INFO:teuthology.orchestra.run.smithi059.stdout:5696 write 0xd5cf9aa thru 0xd5d9d61 (0xa3b8 bytes) 2024-09-12T05:22:04.584 INFO:teuthology.orchestra.run.smithi059.stdout:5699 punch from 0x40b8820 to 0x40ba81c, (0x1ffc bytes) 2024-09-12T05:22:04.584 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.584 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.584 INFO:teuthology.orchestra.run.smithi059.stdout:5702 read 0x1335065 thru 0x1340d32 (0xbcce bytes) 2024-09-12T05:22:04.585 INFO:teuthology.orchestra.run.smithi059.stdout:5704 read 0x7166531 thru 0x716c5e6 (0x60b6 bytes) 2024-09-12T05:22:04.585 INFO:teuthology.orchestra.run.smithi059.stdout:5705 writesame 0x18b3cd4 thru 0x18c2b8e data_size 0x11(0xeebb bytes) 2024-09-12T05:22:04.589 INFO:teuthology.orchestra.run.smithi059.stdout:5706 read 0x867a27d thru 0x8681ad7 (0x785b bytes) 2024-09-12T05:22:04.589 INFO:teuthology.orchestra.run.smithi059.stdout:5708 write 0x91d3b2e thru 0x91e1417 (0xd8ea bytes) 2024-09-12T05:22:04.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:04.592 INFO:teuthology.orchestra.run.smithi059.stdout:5710 write 0xbd6d01f thru 0xbd7bd95 (0xed77 bytes) 2024-09-12T05:22:04.594 INFO:teuthology.orchestra.run.smithi059.stdout:5711 write 0x2d4ad2d thru 0x2d5369a (0x896e bytes) 2024-09-12T05:22:04.596 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.596 INFO:teuthology.orchestra.run.smithi059.stdout:5713 read 0x917446d thru 0x917fbce (0xb762 bytes) 2024-09-12T05:22:04.597 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.597 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.598 INFO:teuthology.orchestra.run.smithi059.stdout:5717 read 0x7228360 thru 0x722d9f2 (0x5693 bytes) 2024-09-12T05:22:04.598 INFO:teuthology.orchestra.run.smithi059.stdout:5718 write 0x8a3f684 thru 0x8a43f0d (0x488a bytes) 2024-09-12T05:22:04.599 INFO:teuthology.orchestra.run.smithi059.stdout:5719 write 0x73bff16 thru 0x73c8af6 (0x8be1 bytes) 2024-09-12T05:22:04.604 INFO:teuthology.orchestra.run.smithi059.stdout:5720 write 0x270e429 thru 0x2718cdb (0xa8b3 bytes) 2024-09-12T05:22:04.605 INFO:teuthology.orchestra.run.smithi059.stdout:5721 writesame 0x575e50b thru 0x5765d76 data_size 0x15(0x786c bytes) 2024-09-12T05:22:04.611 INFO:teuthology.orchestra.run.smithi059.stdout:5723 write 0x7fc8218 thru 0x7fcaa45 (0x282e bytes) 2024-09-12T05:22:04.613 INFO:teuthology.orchestra.run.smithi059.stdout:5724 punch from 0x897730f to 0x89818ec, (0xa5dd bytes) 2024-09-12T05:22:04.619 INFO:teuthology.orchestra.run.smithi059.stdout:5726 trunc from 0xd5d9d62 to 0x8fec96e 2024-09-12T05:22:04.649 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:04.649 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:04.652 INFO:teuthology.orchestra.run.smithi059.stdout:5727 writesame 0xcb8652c thru 0xcb90360 data_size 0x1(0x9e35 bytes) 2024-09-12T05:22:04.652 INFO:teuthology.orchestra.run.smithi059.stdout:5728 write 0x8869e06 thru 0x886d9e3 (0x3bde bytes) 2024-09-12T05:22:04.654 INFO:teuthology.orchestra.run.smithi059.stdout:5731 write 0xa3a3593 thru 0xa3ae608 (0xb076 bytes) 2024-09-12T05:22:04.656 INFO:teuthology.orchestra.run.smithi059.stdout:5732 read 0x244e9ff thru 0x244ef13 (0x515 bytes) 2024-09-12T05:22:04.656 INFO:teuthology.orchestra.run.smithi059.stdout:5733 writesame 0x43efbfa thru 0x43f03b6 data_size 0x1(0x7bd bytes) 2024-09-12T05:22:04.658 INFO:teuthology.orchestra.run.smithi059.stdout:5734 punch from 0x90e9ab3 to 0x90f884f, (0xed9c bytes) 2024-09-12T05:22:04.661 INFO:teuthology.orchestra.run.smithi059.stdout:5735 trunc from 0xcb90361 to 0xe1ed6fc 2024-09-12T05:22:04.665 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:04.663+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:04.670 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:04.670 INFO:teuthology.orchestra.run.smithi059.stdout:5736 writesame 0xa6cc705 thru 0xa6d4688 data_size 0x2(0x7f84 bytes) 2024-09-12T05:22:04.697 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:04.697 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:04.699 INFO:teuthology.orchestra.run.smithi059.stdout:5737 trunc from 0xe1ed6fc to 0xe00ad6 2024-09-12T05:22:04.716 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:04.716 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:04.717 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:22:04.725 INFO:teuthology.orchestra.run.smithi059.stdout:5738 read 0x7db569 thru 0x7e621e (0xacb6 bytes) 2024-09-12T05:22:04.726 INFO:teuthology.orchestra.run.smithi059.stdout:5739 punch from 0xd5c89e to 0xd68cdf, (0xc441 bytes) 2024-09-12T05:22:04.726 INFO:teuthology.orchestra.run.smithi059.stdout:5741 punch from 0xa9d43c to 0xaa5861, (0x8425 bytes) 2024-09-12T05:22:04.727 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:04.727 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:04.727 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:04.727 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:04.727 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:04.730 INFO:teuthology.orchestra.run.smithi059.stdout:5742 trunc from 0xe00ad6 to 0x321cba0 2024-09-12T05:22:04.742 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:04.743 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:04.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:04.760 INFO:teuthology.orchestra.run.smithi059.stdout:5743 write 0xc0e5bff thru 0xc0f4e76 (0xf278 bytes) 2024-09-12T05:22:04.765 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:04.766 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:04.766 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:04.763+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:04.791 INFO:teuthology.orchestra.run.smithi059.stdout:5744 trunc from 0xc0f4e77 to 0x7f68ba 2024-09-12T05:22:04.798 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:04.798 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:04.801 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:04.802 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:04.811 INFO:teuthology.orchestra.run.smithi059.stdout:5745 punch from 0x65479f to 0x6640cc, (0xf92d bytes) 2024-09-12T05:22:04.823 INFO:teuthology.orchestra.run.smithi059.stdout:5747 write 0x3210e6a thru 0x3216cab (0x5e42 bytes) 2024-09-12T05:22:04.837 INFO:teuthology.orchestra.run.smithi059.stdout:5749 trunc from 0x3216cac to 0xbaedf47 2024-09-12T05:22:04.844 INFO:teuthology.orchestra.run.smithi059.stdout:5750 write 0x3174698 thru 0x3183442 (0xedab bytes) 2024-09-12T05:22:04.855 INFO:teuthology.orchestra.run.smithi059.stdout:5751 writesame 0xc9b1673 thru 0xc9c069c data_size 0x3(0xf02a bytes) 2024-09-12T05:22:04.855 INFO:teuthology.orchestra.run.smithi059.stdout:5752 read 0x14494da thru 0x144fd2d (0x6854 bytes) 2024-09-12T05:22:04.855 INFO:teuthology.orchestra.run.smithi059.stdout:5754 read 0x5d42931 thru 0x5d4caff (0xa1cf bytes) 2024-09-12T05:22:04.857 INFO:teuthology.orchestra.run.smithi059.stdout:5755 trunc from 0xc9c069d to 0xe7cca20 2024-09-12T05:22:04.865 INFO:teuthology.orchestra.run.smithi059.stdout:5756 write 0x230ee09 thru 0x23101d5 (0x13cd bytes) 2024-09-12T05:22:04.867 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:04.863+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:04.867 INFO:teuthology.orchestra.run.smithi059.stdout:5757 read 0x256f613 thru 0x257872e (0x911c bytes) 2024-09-12T05:22:04.867 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.867 INFO:teuthology.orchestra.run.smithi059.stdout:5759 write 0xc50cb0e thru 0xc517dbe (0xb2b1 bytes) 2024-09-12T05:22:04.873 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.873 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.873 INFO:teuthology.orchestra.run.smithi059.stdout:5762 read 0x90a9f thru 0x9160d (0xb6f bytes) 2024-09-12T05:22:04.874 INFO:teuthology.orchestra.run.smithi059.stdout:5764 punch from 0xd1e2e17 to 0xd1e9106, (0x62ef bytes) 2024-09-12T05:22:04.874 INFO:teuthology.orchestra.run.smithi059.stdout:5766 read 0xbf67751 thru 0xbf7338b (0xbc3b bytes) 2024-09-12T05:22:04.874 INFO:teuthology.orchestra.run.smithi059.stdout:5767 read 0xcc216d4 thru 0xcc24727 (0x3054 bytes) 2024-09-12T05:22:04.883 INFO:teuthology.orchestra.run.smithi059.stdout:5769 write 0xee45b47 thru 0xee4dbd9 (0x8093 bytes) 2024-09-12T05:22:04.884 INFO:teuthology.orchestra.run.smithi059.stdout:5770 read 0xb8ad91c thru 0xb8afed6 (0x25bb bytes) 2024-09-12T05:22:04.885 INFO:teuthology.orchestra.run.smithi059.stdout:5771 punch from 0xe8dc55e to 0xe8dedc8, (0x286a bytes) 2024-09-12T05:22:04.885 INFO:teuthology.orchestra.run.smithi059.stdout:5772 read 0x325ae92 thru 0x3266bc3 (0xbd32 bytes) 2024-09-12T05:22:04.885 INFO:teuthology.orchestra.run.smithi059.stdout:5773 read 0xe226c45 thru 0xe22e632 (0x79ee bytes) 2024-09-12T05:22:04.896 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:04.896 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:04.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:04.896 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:04.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.896 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.476351698999999, 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:22:04.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:22:04.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:22:04.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.902 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.464903489999998, 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:22:04.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:22:04.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.907 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377288585000002, 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:22:04.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:22:04.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377245481000003, 2024-09-12T05:22:04.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:04.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:04.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377218233000001, 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:22:04.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377191953000001, 2024-09-12T05:22:04.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.925 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377169342000002, 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:22:04.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:22:04.929 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377141512999998, 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.930 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:22:04.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:22:04.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377119094000001, 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.934 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:04.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:22:04.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377097962000001, 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:22:04.938 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:22:04.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.377009328, 2024-09-12T05:22:04.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:22:04.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.376978393999998, 2024-09-12T05:22:04.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:04.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.376952232000001, 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.951 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:22:04.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.376930057999999, 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.376908944, 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:22:04.959 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:22:04.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:04.963 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.376887306999997, 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:04.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:04.967 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.376722391999998, 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:04.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:22:04.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:04.971 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.376694676, 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:04.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:22:04.975 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.291166779999998, 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:22:04.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:22:04.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:103340 3.0 3:06fad095:::rbd_data.1118e5d0fec8.00000000000000e6:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 124922~6150] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.923173847000001, 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95737219699999998, 2024-09-12T05:22:04.981 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 103340 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972843+0000", 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5469999999999999e-06 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972859+0000", 2024-09-12T05:22:04.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5625999999999999e-05 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972881+0000", 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.262e-05 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972893+0000", 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1866e-05 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972961+0000", 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8208999999999997e-05 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972973+0000", 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1425e-05 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.927928+0000", 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95495565000000004 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928050+0000", 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012213799999999999 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928260+0000", 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000209626 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.929880+0000", 2024-09-12T05:22:04.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016203019999999999 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930114+0000", 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023339699999999999 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:04.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930171+0000", 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7697e-05 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930213+0000", 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1094000000000003e-05 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:04.988 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:04.989 INFO:teuthology.orchestra.run.smithi059.stdout:5774 trunc from 0xee4dbda to 0x6d27e4e 2024-09-12T05:22:04.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:04.991 INFO:teuthology.orchestra.run.smithi059.stdout:5775 trunc from 0x6d27e4e to 0x53b55b9 2024-09-12T05:22:04.991 INFO:teuthology.orchestra.run.smithi059.stdout:5776 trunc from 0x53b55b9 to 0x20aadc1 2024-09-12T05:22:04.991 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:04.991 INFO:teuthology.orchestra.run.smithi059.stdout:5781 write 0x553967e thru 0x5540389 (0x6d0c bytes) 2024-09-12T05:22:04.992 INFO:teuthology.orchestra.run.smithi059.stdout:5782 punch from 0x45991c9 to 0x459e492, (0x52c9 bytes) 2024-09-12T05:22:04.992 INFO:teuthology.orchestra.run.smithi059.stdout:5784 writesame 0x30de533 thru 0x30e7209 data_size 0x1(0x8cd7 bytes) 2024-09-12T05:22:04.992 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:04.990+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:05.009 INFO:teuthology.orchestra.run.smithi059.stdout:5787 read 0x3b1ae35 thru 0x3b1d654 (0x2820 bytes) 2024-09-12T05:22:05.013 INFO:teuthology.orchestra.run.smithi059.stdout:5788 read 0x4054594 thru 0x405e3bb (0x9e28 bytes) 2024-09-12T05:22:05.013 INFO:teuthology.orchestra.run.smithi059.stdout:5789 read 0x4e64098 thru 0x4e6e2e4 (0xa24d bytes) 2024-09-12T05:22:05.013 INFO:teuthology.orchestra.run.smithi059.stdout:5790 read 0x347c9ea thru 0x3480b31 (0x4148 bytes) 2024-09-12T05:22:05.013 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:05.030 INFO:teuthology.orchestra.run.smithi059.stdout:5794 write 0x808a9ce thru 0x8090908 (0x5f3b bytes) 2024-09-12T05:22:05.041 INFO:teuthology.orchestra.run.smithi059.stdout:5795 read 0x5994e80 thru 0x59954b7 (0x638 bytes) 2024-09-12T05:22:05.042 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:05.042 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:05.042 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:05.042 INFO:teuthology.orchestra.run.smithi059.stdout:5801 read 0x6c30c2e thru 0x6c35fd4 (0x53a7 bytes) 2024-09-12T05:22:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:5802 trunc from 0x8090909 to 0x313de10 2024-09-12T05:22:05.091 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:05.087+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:05.094 INFO:teuthology.orchestra.run.smithi059.stdout:5804 trunc from 0x313de10 to 0xcea53ab 2024-09-12T05:22:05.127 INFO:teuthology.orchestra.run.smithi059.stdout:5807 trunc from 0xcea53ab to 0x462883 2024-09-12T05:22:05.142 INFO:teuthology.orchestra.run.smithi059.stdout:5809 punch from 0x19112c to 0x194395, (0x3269 bytes) 2024-09-12T05:22:05.142 INFO:teuthology.orchestra.run.smithi059.stdout:5810 clone 43 order 19 su 65536 sc 14 2024-09-12T05:22:05.173 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:05.174 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:05.174 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:05.174 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:05.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:05.233 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:05.234+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:05.293 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:05.294+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:05.360 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:05.360 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:05.360 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:05.361 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:05.361 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:05.375 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:05.417 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:05.418+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:05.495 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:05.494+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:05.546 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:05.546 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:05.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:05.546 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:05.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 104.566295036, 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:22:05.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:22:05.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:22:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.654662719000001, 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:22:05.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.271962235000004, 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:22:05.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.037918587999997, 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.560 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:22:05.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:22:05.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:05.564 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.007794257, 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:05.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:22:05.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:22:05.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:22:05.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:22:05.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.570 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.570 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.445706475999998, 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:05.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:05.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.443752258000004, 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.576 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:22:05.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 89.502443524, 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.581 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:22:05.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:22:05.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 89.485846930999998, 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:22:05.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.590 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.315507491000005, 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:22:05.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:22:05.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 80.437053238999994, 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:22:05.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:22:05.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 80.437008144999993, 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.599 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:22:05.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 80.428446584, 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:22:05.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:22:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:22:05.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:22:05.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:22:05.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.609 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 75.626408424999994, 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:05.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:22:05.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:05.614 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 70.112284986999995, 2024-09-12T05:22:05.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:22:05.615 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.615 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:22:05.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:22:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:22:05.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 70.104198894999996, 2024-09-12T05:22:05.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:22:05.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 56.202012648, 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:22:05.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:05.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:22:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:22:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:22:05.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:22:05.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.224612727, 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:22:05.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:22:05.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.472465747000001, 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.637 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:22:05.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:22:05.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:22:05.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.113216016000003, 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:22:05.641 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:22:05.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:05.646 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:05.646 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:05.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:22:05.647 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:05.646+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:05.747 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:05.743+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:05.820 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:05.820 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:05.820 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:05.820 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:05.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:22:05.849 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:05.847+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:05.949 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:05.950+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:05.953 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:05.953 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:05.953 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:05.953 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:05.953 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:05.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:22:06.053 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:06.054+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:06.135 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80149 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7028736~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:22:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.420265792000002, 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047236827000000002, 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80149 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712539+0000", 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712542+0000", 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9639999999999999e-06 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712550+0000", 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7709999999999995e-06 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712556+0000", 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6380000000000001e-06 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759608+0000", 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047051754000000001 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759684+0000", 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6784000000000002e-05 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759775+0000", 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000001e-05 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80150 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6701056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.420238554999997, 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047422082999999997, 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80150 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713023+0000", 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00045808399999999999 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713028+0000", 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7849999999999999e-06 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713039+0000", 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0530000000000001e-05 2024-09-12T05:22:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713046+0000", 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2710000000000003e-06 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759807+0000", 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046761182999999998 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759887+0000", 2024-09-12T05:22:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9709999999999994e-05 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759987+0000", 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010052000000000001 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80151 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7036928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.419744182999999, 2024-09-12T05:22:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047137710999999999, 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80151 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713063+0000", 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7460000000000001e-06 2024-09-12T05:22:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713071+0000", 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6159999999999996e-06 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713077+0000", 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760020+0000", 2024-09-12T05:22:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046943358999999997 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760098+0000", 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7519000000000001e-05 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760197+0000", 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9778000000000006e-05 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80152 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6709248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.419718230999997, 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047326518999999997, 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80152 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713245+0000", 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015924600000000001 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713249+0000", 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3379999999999998e-06 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713265+0000", 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6184e-05 2024-09-12T05:22:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713271+0000", 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6670000000000001e-06 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760231+0000", 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046960285999999997 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760311+0000", 2024-09-12T05:22:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9643999999999998e-05 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760412+0000", 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101154 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80153 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6799360~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:22:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.419523065, 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047341640999999997, 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80153 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713474+0000", 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192898 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713477+0000", 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3890000000000001e-06 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713487+0000", 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713494+0000", 2024-09-12T05:22:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4540000000000001e-06 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760444+0000", 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046949957 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760526+0000", 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1361999999999998e-05 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760622+0000", 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6587000000000002e-05 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80154 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8413184~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.419297067000002, 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047319877000000003, 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80154 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713977+0000", 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00047076399999999998 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713985+0000", 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8790000000000003e-06 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713996+0000", 2024-09-12T05:22:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.113e-05 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714003+0000", 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8979999999999999e-06 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760655+0000", 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046651821000000003 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760734+0000", 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9208999999999993e-05 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760827+0000", 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2176000000000007e-05 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80156 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8503296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:22:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.418762549999997, 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047199342999999998, 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80156 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:22:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719243+0000", 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052018419999999999 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719248+0000", 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1760000000000001e-06 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719261+0000", 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3045e-05 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719269+0000", 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1130000000000001e-06 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761068+0000", 2024-09-12T05:22:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041798096999999999 2024-09-12T05:22:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761148+0000", 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0301000000000002e-05 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761241+0000", 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769000000000006e-05 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80227 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4956160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.412745176999998, 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047195107, 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80227 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4900000000000001e-07 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720061+0000", 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0980000000000001e-06 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720068+0000", 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.007e-06 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720074+0000", 2024-09-12T05:22:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767070+0000", 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046996653999999999 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767150+0000", 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9919000000000005e-05 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767254+0000", 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103639 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80228 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 5718016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.412723327000002, 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047313252, 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80228 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720081+0000", 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8599999999999999e-07 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720083+0000", 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720089+0000", 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720094+0000", 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7929999999999997e-06 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767286+0000", 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047191666 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767338+0000", 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2441000000000002e-05 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767394+0000", 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5526000000000003e-05 2024-09-12T05:22:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80229 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4628480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.412703319999999, 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047505240999999997, 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80229 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727276+0000", 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071757619999999996 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727282+0000", 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7019999999999998e-06 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727293+0000", 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0778000000000001e-05 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727300+0000", 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5769999999999996e-06 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767428+0000", 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040128193 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767510+0000", 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1203000000000002e-05 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767606+0000", 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6026000000000005e-05 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80275 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7069696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.404686097999999, 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047223138999999997, 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80275 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9399999999999995e-07 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728120+0000", 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2879999999999999e-06 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728127+0000", 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8669999999999996e-06 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728133+0000", 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775161+0000", 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047027843 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775243+0000", 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2126999999999995e-05 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775341+0000", 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8189000000000005e-05 2024-09-12T05:22:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80276 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6742016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.404663845000002, 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047322971999999998, 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80276 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728506+0000", 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036576600000000001 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728510+0000", 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5689999999999998e-06 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728519+0000", 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7190000000000007e-06 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728525+0000", 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775371+0000", 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046846023000000001 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775410+0000", 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8584000000000002e-05 2024-09-12T05:22:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775463+0000", 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2964999999999999e-05 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80277 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6758400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.404262842000001, 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047131702999999997, 2024-09-12T05:22:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80277 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728770+0000", 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228586 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728774+0000", 2024-09-12T05:22:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728784+0000", 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5249999999999994e-06 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728790+0000", 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6139999999999997e-06 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775498+0000", 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046708040999999999 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775577+0000", 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8553999999999994e-05 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775673+0000", 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5644999999999997e-05 2024-09-12T05:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80279 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6856704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.403975088999999, 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047172124000000003, 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80279 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:22:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729026+0000", 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019762800000000001 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729030+0000", 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729039+0000", 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1209999999999996e-06 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729046+0000", 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3450000000000002e-06 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775825+0000", 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046779646000000001 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775906+0000", 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0337e-05 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776001+0000", 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5047e-05 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80281 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6635520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.403711285, 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047239476000000002, 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80281 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729204+0000", 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111247 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729209+0000", 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2979999999999999e-06 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729220+0000", 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1032e-05 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729228+0000", 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.571e-06 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776155+0000", 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046927340999999997 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776236+0000", 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0551999999999997e-05 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776332+0000", 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6434999999999994e-05 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80282 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6971392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.403562297999997, 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047211569000000002, 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80282 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729654+0000", 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000412118 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729662+0000", 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8200000000000003e-06 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729675+0000", 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2996000000000001e-05 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729684+0000", 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1629999999999996e-06 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776362+0000", 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046678450000000003 2024-09-12T05:22:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776403+0000", 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0627999999999998e-05 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776453+0000", 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0393999999999999e-05 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80285 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 3104768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.402980589000002, 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047179632999999999, 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80285 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730008+0000", 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018459999999999999 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730012+0000", 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6090000000000003e-06 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730024+0000", 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1853e-05 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730033+0000", 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776826+0000", 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046792907000000002 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776908+0000", 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1981e-05 2024-09-12T05:22:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777003+0000", 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4712999999999999e-05 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80287 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2777088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.402563682999997, 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047092717999999999, 2024-09-12T05:22:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80287 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730400+0000", 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000159684 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730404+0000", 2024-09-12T05:22:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2780000000000004e-06 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730412+0000", 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4669999999999998e-06 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730416+0000", 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6609999999999999e-06 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777158+0000", 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046741956000000001 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777236+0000", 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7960999999999994e-05 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777333+0000", 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6711000000000003e-05 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:102631 3.7 3:e1f14bfd:::rbd_data.11181f89f1e6.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.041371753, 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048849113999999999, 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 102631 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091434+0000", 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.429e-06 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091445+0000", 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0932e-05 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091471+0000", 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-05 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091486+0000", 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5506999999999999e-05 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091583+0000", 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6407e-05 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091661+0000", 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8046999999999993e-05 2024-09-12T05:22:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.098845+0000", 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071841509999999997 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140140+0000", 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041295239999999997 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140190+0000", 2024-09-12T05:22:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9629999999999997e-05 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140240+0000", 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0353999999999999e-05 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140281+0000", 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1007000000000002e-05 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:108406 3.2 3:4229a37b:::rbd_data.1118aababa9c.0000000000000044:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:51.459499+0000", 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.673304767999999, 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059975282999999997, 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 108406 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459499+0000", 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459499+0000", 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459500+0000", 2024-09-12T05:22:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2699999999999999e-06 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459507+0000", 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2400000000000004e-06 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459522+0000", 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.543e-05 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459531+0000", 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5660000000000007e-06 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459595+0000", 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4542000000000006e-05 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459704+0000", 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108996 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.467163+0000", 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074590489999999997 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.519206+0000", 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052042494000000002 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.519310+0000", 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104615 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.519405+0000", 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4905e-05 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.519474+0000", 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9176000000000003e-05 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:06.229 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:06.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:22:06.231 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:06.232 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:06.230+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:06.325 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-12T05:22:06.332 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:06.327+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:06.363 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:06.364 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:06.364 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:06.364 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:06.377 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:06.465 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:06.463+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:06.534 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:06.534+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:06.549 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:06.549 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:06.563 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:06.649 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:06.647+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:06.703 INFO:teuthology.orchestra.run.smithi059.stdout:5812 trunc from 0x462883 to 0x54b2c91 2024-09-12T05:22:06.732 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:06.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.229463588000002, 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.733 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:22:06.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:06.737 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.229431939000001, 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:06.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.741 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.229395795999999, 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.742 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:22:06.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.746 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.229364986, 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:22:06.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.751 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.229334427000001, 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:22:06.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:22:06.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.229304531, 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.756 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:06.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.227547588, 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.761 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.765 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.227504019000001, 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.766 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.770 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.227272128999999, 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:22:06.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.227151217999999, 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.775 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:22:06.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:22:06.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.22703418, 2024-09-12T05:22:06.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.226914571999998, 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101774 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4833280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.223968618000001, 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090801491999999998, 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101774 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507679+0000", 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2399999999999996e-07 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507682+0000", 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507691+0000", 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3230000000000004e-06 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507698+0000", 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1400000000000002e-06 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598168+0000", 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090470153999999997 2024-09-12T05:22:06.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598305+0000", 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136935 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598479+0000", 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0001738 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.223935845, 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.794 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:22:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:22:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:22:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.223901539, 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.223869362999999, 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:22:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.223807746999999, 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:22:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:22:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.223752391000001, 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:22:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:22:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.223697585, 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.223537911000001, 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:22:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:22:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:06.827 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:06.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:06.829 INFO:teuthology.orchestra.run.smithi059.stdout:5813 write 0xe9bb3d2 thru 0xe9c6d3e (0xb96d bytes) 2024-09-12T05:22:06.829 INFO:teuthology.orchestra.run.smithi059.stdout:5815 trunc from 0xe9c6d3f to 0xb2895f 2024-09-12T05:22:06.829 INFO:teuthology.orchestra.run.smithi059.stdout:5816 write 0xda12698 thru 0xda1a586 (0x7eef bytes) 2024-09-12T05:22:06.830 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:06.830 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:06.827+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:06.845 INFO:teuthology.orchestra.run.smithi059.stdout:5817 writesame 0xdfe6073 thru 0xdfed413 data_size 0x75(0x73a1 bytes) 2024-09-12T05:22:06.845 INFO:teuthology.orchestra.run.smithi059.stdout:5818 punch from 0x747493a to 0x7481663, (0xcd29 bytes) 2024-09-12T05:22:06.845 INFO:teuthology.orchestra.run.smithi059.stdout:5822 write 0x27f28c1 thru 0x27fbe62 (0x95a2 bytes) 2024-09-12T05:22:06.852 INFO:teuthology.orchestra.run.smithi059.stdout:5823 read 0x67da66 thru 0x68b675 (0xdc10 bytes) 2024-09-12T05:22:06.852 INFO:teuthology.orchestra.run.smithi059.stdout:5824 writesame 0x40003b7 thru 0x400a390 data_size 0x4f(0x9fda bytes) 2024-09-12T05:22:06.858 INFO:teuthology.orchestra.run.smithi059.stdout:5826 write 0xa095f7e thru 0xa0a4d9f (0xee22 bytes) 2024-09-12T05:22:06.866 INFO:teuthology.orchestra.run.smithi059.stdout:5827 writesame 0x6a015e3 thru 0x6a05ce4 data_size 0x3d(0x4702 bytes) 2024-09-12T05:22:06.871 INFO:teuthology.orchestra.run.smithi059.stdout:5828 write 0x7747438 thru 0x7755554 (0xe11d bytes) 2024-09-12T05:22:06.877 INFO:teuthology.orchestra.run.smithi059.stdout:5829 writesame 0x180628a thru 0x1813f07 data_size 0x1a(0xdc7e bytes) 2024-09-12T05:22:06.884 INFO:teuthology.orchestra.run.smithi059.stdout:5830 write 0x4cff098 thru 0x4d08386 (0x92ef bytes) 2024-09-12T05:22:06.890 INFO:teuthology.orchestra.run.smithi059.stdout:5832 read 0xcd441df thru 0xcd46510 (0x2332 bytes) 2024-09-12T05:22:06.890 INFO:teuthology.orchestra.run.smithi059.stdout:5835 read 0x5d905f5 thru 0x5d9079b (0x1a7 bytes) 2024-09-12T05:22:06.890 INFO:teuthology.orchestra.run.smithi059.stdout:5836 writesame 0x26b94c6 thru 0x26bc916 data_size 0x1(0x3451 bytes) 2024-09-12T05:22:06.925 INFO:teuthology.orchestra.run.smithi059.stdout:5838 trunc from 0xdfed414 to 0x3cf50c2 2024-09-12T05:22:06.929 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:06.930+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:06.946 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:06.947 INFO:teuthology.orchestra.run.smithi059.stdout:5840 write 0xec9d76 thru 0xeccc7f (0x2f0a bytes) 2024-09-12T05:22:06.952 INFO:teuthology.orchestra.run.smithi059.stdout:5841 read 0x1ce9cfa thru 0x1cef16c (0x5473 bytes) 2024-09-12T05:22:06.952 INFO:teuthology.orchestra.run.smithi059.stdout:5842 read 0x1dcd2fc thru 0x1dd378c (0x6491 bytes) 2024-09-12T05:22:06.964 INFO:teuthology.orchestra.run.smithi059.stdout:5845 write 0x52be388 thru 0x52c9221 (0xae9a bytes) 2024-09-12T05:22:06.977 INFO:teuthology.orchestra.run.smithi059.stdout:5847 write 0x55e3edb thru 0x55e4d07 (0xe2d bytes) 2024-09-12T05:22:06.982 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:06.998 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:06.999 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:07.001 INFO:teuthology.orchestra.run.smithi059.stdout:5849 writesame 0xe160484 thru 0xe161720 data_size 0x1(0x129d bytes) 2024-09-12T05:22:07.001 INFO:teuthology.orchestra.run.smithi059.stdout:5850 punch from 0xad67d8f to 0xad6e3f6, (0x6667 bytes) 2024-09-12T05:22:07.004 INFO:teuthology.orchestra.run.smithi059.stdout:5851 trunc from 0xe161721 to 0xbc20c39 2024-09-12T05:22:07.006 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:07.006 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:07.006 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:07.006 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:07.010 INFO:teuthology.orchestra.run.smithi059.stdout:5852 write 0x297f815 thru 0x298d404 (0xdbf0 bytes) 2024-09-12T05:22:07.019 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:07.019 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:07.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:07.023 INFO:teuthology.orchestra.run.smithi059.stdout:5853 trunc from 0xbc20c39 to 0x579db99 2024-09-12T05:22:07.030 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:07.030+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:07.038 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:07.045 INFO:teuthology.orchestra.run.smithi059.stdout:5854 write 0x9cc7a17 thru 0x9cd3847 (0xbe31 bytes) 2024-09-12T05:22:07.050 INFO:teuthology.orchestra.run.smithi059.stdout:5856 read 0x60b6ef thru 0x60e869 (0x317b bytes) 2024-09-12T05:22:07.059 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:07.059 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:07.060 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:22:07.064 INFO:teuthology.orchestra.run.smithi059.stdout:5857 writesame 0xee55c98 thru 0xee63c3a data_size 0x1(0xdfa3 bytes) 2024-09-12T05:22:07.064 INFO:teuthology.orchestra.run.smithi059.stdout:5859 punch from 0xc0fc8c9 to 0xc0fd3bb, (0xaf2 bytes) 2024-09-12T05:22:07.064 INFO:teuthology.orchestra.run.smithi059.stdout:5860 write 0x5f3ff3d thru 0x5f443c2 (0x4486 bytes) 2024-09-12T05:22:07.073 INFO:teuthology.orchestra.run.smithi059.stdout:5862 trunc from 0xee63c3b to 0xc207ece 2024-09-12T05:22:07.080 INFO:teuthology.orchestra.run.smithi059.stdout:5863 write 0x7195ca9 thru 0x719cacb (0x6e23 bytes) 2024-09-12T05:22:07.081 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:07.083 INFO:teuthology.orchestra.run.smithi059.stdout:5864 writesame 0x75ab54f thru 0x75b1d2c data_size 0x5(0x67de bytes) 2024-09-12T05:22:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:5866 read 0x5ac4289 thru 0x5acd999 (0x9711 bytes) 2024-09-12T05:22:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:5870 punch from 0x3a4c91e to 0x3a57eb3, (0xb595 bytes) 2024-09-12T05:22:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:5871 read 0x9527ad5 thru 0x952d9ff (0x5f2b bytes) 2024-09-12T05:22:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:5872 punch from 0x79aa5db to 0x79afa41, (0x5466 bytes) 2024-09-12T05:22:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:5873 write 0x8e41a1e thru 0x8e45f8d (0x4570 bytes) 2024-09-12T05:22:07.095 INFO:teuthology.orchestra.run.smithi059.stdout:5876 writesame 0x4b1bbac thru 0x4b2068d data_size 0x5a(0x4ae2 bytes) 2024-09-12T05:22:07.100 INFO:teuthology.orchestra.run.smithi059.stdout:5877 read 0x5864f5e thru 0x586b255 (0x62f8 bytes) 2024-09-12T05:22:07.100 INFO:teuthology.orchestra.run.smithi059.stdout:5879 punch from 0x87d7e41 to 0x87e200d, (0xa1cc bytes) 2024-09-12T05:22:07.100 INFO:teuthology.orchestra.run.smithi059.stdout:5880 read 0x1681912 thru 0x168d7d3 (0xbec2 bytes) 2024-09-12T05:22:07.103 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:07.103 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:07.110 INFO:teuthology.orchestra.run.smithi059.stdout:5882 write 0xed42bea thru 0xed45971 (0x2d88 bytes) 2024-09-12T05:22:07.114 INFO:teuthology.orchestra.run.smithi059.stdout:5884 write 0x72a4c7b thru 0x72a8838 (0x3bbe bytes) 2024-09-12T05:22:07.117 INFO:teuthology.orchestra.run.smithi059.stdout:5885 write 0x72990c3 thru 0x72a020f (0x714d bytes) 2024-09-12T05:22:07.121 INFO:teuthology.orchestra.run.smithi059.stdout:5886 punch from 0x586dbf8 to 0x586e3eb, (0x7f3 bytes) 2024-09-12T05:22:07.121 INFO:teuthology.orchestra.run.smithi059.stdout:5887 write 0xd3dd3e4 thru 0xd3dd92f (0x54c bytes) 2024-09-12T05:22:07.123 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:07.123 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:07.124 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:07.124 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:07.125 INFO:teuthology.orchestra.run.smithi059.stdout:5890 write 0x56a9f88 thru 0x56b1fb2 (0x802b bytes) 2024-09-12T05:22:07.127 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:07.127 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:07.140 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:22:07.141 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:07.142+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:07.149 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:07.149 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:07.151 INFO:teuthology.orchestra.run.smithi059.stdout:5892 trunc from 0xed45972 to 0x1042ab8 2024-09-12T05:22:07.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:07.207 INFO:teuthology.orchestra.run.smithi059.stdout:5893 write 0xe51a912 thru 0xe5254df (0xabce bytes) 2024-09-12T05:22:07.214 INFO:teuthology.orchestra.run.smithi059.stdout:5894 write 0x2cac668 thru 0x2cb635a (0x9cf3 bytes) 2024-09-12T05:22:07.224 INFO:teuthology.orchestra.run.smithi059.stdout:5895 punch from 0x9316230 to 0x9322496, (0xc266 bytes) 2024-09-12T05:22:07.224 INFO:teuthology.orchestra.run.smithi059.stdout:5896 write 0xcc38ea1 thru 0xcc3a73e (0x189e bytes) 2024-09-12T05:22:07.229 INFO:teuthology.orchestra.run.smithi059.stdout:5898 writesame 0xa243257 thru 0xa2486e3 data_size 0x41(0x548d bytes) 2024-09-12T05:22:07.231 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:07.230+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:07.236 INFO:teuthology.orchestra.run.smithi059.stdout:5899 clone 44 order 24 su 262144 sc 5 2024-09-12T05:22:07.287 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:07.287 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:07.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:07.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:07.347+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:07.417 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:07.417 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:07.431 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:07.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:07.471+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:07.534 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:07.534+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:07.595 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:07.595 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:07.609 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:07.634 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:07.634+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:07.732 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:07.732 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:07.735 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:07.734+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:07.746 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:07.836 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:07.831+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:07.883 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:07.883 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:07.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:07.938 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:07.935+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:08.025 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:08.025 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:08.038 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:08.038+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:08.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:08.140 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:08.135+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:08.218 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:08.218 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:08.229 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:08.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:08.261 INFO:teuthology.orchestra.run.smithi059.stdout:truncating image image_client.0-clone43 from 0xe5254e0 (overlap 0x462883) to 0x3f2475 2024-09-12T05:22:08.261 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:08.262+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:08.341 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:08.342+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:08.362 INFO:teuthology.orchestra.run.smithi194.stderr:no valid command found; 10 closest matches: 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:0 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:1 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:2 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:abort 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:assert 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:config diff 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:config diff get 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:config get 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:config help [] 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:config set ... 2024-09-12T05:22:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:admin_socket: invalid command 2024-09-12T05:22:08.365 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T05:22:08.365 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-4, ['dump_ops_in_flight'] 2024-09-12T05:22:08.369 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-12T05:22:08.371 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:08.371 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:08.380 INFO:teuthology.orchestra.run.smithi059.stdout:5900 writesame 0x89fa7c0 thru 0x89fed6a data_size 0x29(0x45ab bytes) 2024-09-12T05:22:08.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:08.390 INFO:teuthology.orchestra.run.smithi059.stdout:5902 writesame 0x663e735 thru 0x6643849 data_size 0x33(0x5115 bytes) 2024-09-12T05:22:08.400 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:08.400 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:08.400 INFO:teuthology.orchestra.run.smithi059.stdout:5906 write 0x5e8715e thru 0x5e8ded1 (0x6d74 bytes) 2024-09-12T05:22:08.404 INFO:teuthology.orchestra.run.smithi059.stdout:5907 read 0x9766cbd thru 0x977096a (0x9cae bytes) 2024-09-12T05:22:08.404 INFO:teuthology.orchestra.run.smithi059.stdout:5908 writesame 0x765762f thru 0x7666a42 data_size 0xa4(0xf414 bytes) 2024-09-12T05:22:08.409 INFO:teuthology.orchestra.run.smithi059.stdout:5909 write 0x4e8086 thru 0x4f7361 (0xf2dc bytes) 2024-09-12T05:22:08.427 INFO:teuthology.orchestra.run.smithi059.stdout:5910 trunc from 0xe5254e0 to 0xc20dea7 2024-09-12T05:22:08.442 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:08.442+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:08.458 INFO:teuthology.orchestra.run.smithi059.stdout:5911 write 0x94610fa thru 0x94663a1 (0x52a8 bytes) 2024-09-12T05:22:08.462 INFO:teuthology.orchestra.run.smithi059.stdout:5913 writesame 0x53885a4 thru 0x5390ffa data_size 0xf(0x8a57 bytes) 2024-09-12T05:22:08.466 INFO:teuthology.orchestra.run.smithi059.stdout:5914 read 0x88008e5 thru 0x880c2ed (0xba09 bytes) 2024-09-12T05:22:08.466 INFO:teuthology.orchestra.run.smithi059.stdout:5915 read 0x6bf049e thru 0x6bf1cee (0x1851 bytes) 2024-09-12T05:22:08.466 INFO:teuthology.orchestra.run.smithi059.stdout:5916 write 0x816ab5d thru 0x816db9b (0x303f bytes) 2024-09-12T05:22:08.475 INFO:teuthology.orchestra.run.smithi059.stdout:5918 read 0xb37c973 thru 0xb3850c5 (0x8753 bytes) 2024-09-12T05:22:08.477 INFO:teuthology.orchestra.run.smithi059.stdout:5919 punch from 0x9cb5937 to 0x9cc1cd0, (0xc399 bytes) 2024-09-12T05:22:08.477 INFO:teuthology.orchestra.run.smithi059.stdout:5920 punch from 0x7ddd72a to 0x7de20db, (0x49b1 bytes) 2024-09-12T05:22:08.477 INFO:teuthology.orchestra.run.smithi059.stdout:5921 read 0x225a3da thru 0x225c6ed (0x2314 bytes) 2024-09-12T05:22:08.477 INFO:teuthology.orchestra.run.smithi059.stdout:5922 write 0x5b9a808 thru 0x5ba485a (0xa053 bytes) 2024-09-12T05:22:08.479 INFO:teuthology.orchestra.run.smithi059.stdout:5925 writesame 0x6cffc79 thru 0x6d0163c data_size 0x22(0x19c4 bytes) 2024-09-12T05:22:08.500 INFO:teuthology.orchestra.run.smithi059.stdout:5926 trunc from 0xc20dea7 to 0x5c6a1c6 2024-09-12T05:22:08.527 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:08.527 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:08.533 INFO:teuthology.orchestra.run.smithi059.stdout:5927 read 0x39b299b thru 0x39bb4e0 (0x8b46 bytes) 2024-09-12T05:22:08.533 INFO:teuthology.orchestra.run.smithi059.stdout:5928 read 0x784a36 thru 0x786bfc (0x21c7 bytes) 2024-09-12T05:22:08.543 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:08.539+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:08.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:08.564 INFO:teuthology.orchestra.run.smithi059.stdout:5929 writesame 0xe89494c thru 0xe89709e data_size 0x1(0x2753 bytes) 2024-09-12T05:22:08.564 INFO:teuthology.orchestra.run.smithi059.stdout:5930 write 0xe7e63a7 thru 0xe7f0662 (0xa2bc bytes) 2024-09-12T05:22:08.569 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:08.575 INFO:teuthology.orchestra.run.smithi059.stdout:5932 trunc from 0xe89709f to 0xb0c66c8 2024-09-12T05:22:08.588 INFO:teuthology.orchestra.run.smithi059.stdout:5934 read 0x718da5e thru 0x71965ae (0x8b51 bytes) 2024-09-12T05:22:08.589 INFO:teuthology.orchestra.run.smithi059.stdout:5935 write 0x222eb8f thru 0x22321d6 (0x3648 bytes) 2024-09-12T05:22:08.603 INFO:teuthology.orchestra.run.smithi059.stdout:5936 write 0x9e403aa thru 0x9e43e78 (0x3acf bytes) 2024-09-12T05:22:08.606 INFO:teuthology.orchestra.run.smithi059.stdout:5937 writesame 0x99ad498 thru 0x99bd020 data_size 0x1(0xfb89 bytes) 2024-09-12T05:22:08.643 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:08.642+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:08.660 INFO:teuthology.orchestra.run.smithi059.stdout:5938 writesame 0xd9d2153 thru 0xd9dec1f data_size 0x1(0xcacd bytes) 2024-09-12T05:22:08.660 INFO:teuthology.orchestra.run.smithi059.stdout:5941 write 0xb0a1c33 thru 0xb0a378e (0x1b5c bytes) 2024-09-12T05:22:08.665 INFO:teuthology.orchestra.run.smithi059.stdout:5943 read 0xa35d41a thru 0xa369620 (0xc207 bytes) 2024-09-12T05:22:08.665 INFO:teuthology.orchestra.run.smithi059.stdout:5944 read 0x75c6783 thru 0x75ce948 (0x81c6 bytes) 2024-09-12T05:22:08.677 INFO:teuthology.orchestra.run.smithi059.stdout:5946 writesame 0xe5f7114 thru 0xe5fbd6b data_size 0xe(0x4c58 bytes) 2024-09-12T05:22:08.678 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:08.678 INFO:teuthology.orchestra.run.smithi059.stdout:5949 writesame 0xe4ed9e8 thru 0xe4f65cc data_size 0x1(0x8be5 bytes) 2024-09-12T05:22:08.695 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:08.695 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:08.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:08.732 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:08.732 INFO:teuthology.orchestra.run.smithi059.stdout:5951 write 0x9557b26 thru 0x956791d (0xfdf8 bytes) 2024-09-12T05:22:08.734 INFO:teuthology.orchestra.run.smithi059.stdout:5952 write 0x1f89004 thru 0x1f9800a (0xf007 bytes) 2024-09-12T05:22:08.739 INFO:teuthology.orchestra.run.smithi059.stdout:5953 writesame 0xd4a39e4 thru 0xd4a7597 data_size 0x2(0x3bb4 bytes) 2024-09-12T05:22:08.744 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:08.742+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:08.751 INFO:teuthology.orchestra.run.smithi059.stdout:5954 write 0xa41acbc thru 0xa4213b1 (0x66f6 bytes) 2024-09-12T05:22:08.755 INFO:teuthology.orchestra.run.smithi059.stdout:5955 writesame 0xe1282b0 thru 0xe128746 data_size 0x1(0x497 bytes) 2024-09-12T05:22:08.759 INFO:teuthology.orchestra.run.smithi059.stdout:5956 punch from 0x599616 to 0x59f84f, (0x6239 bytes) 2024-09-12T05:22:08.759 INFO:teuthology.orchestra.run.smithi059.stdout:5957 punch from 0x486a72d to 0x4874dc3, (0xa696 bytes) 2024-09-12T05:22:08.759 INFO:teuthology.orchestra.run.smithi059.stdout:5958 read 0xa197e85 thru 0xa199cc9 (0x1e45 bytes) 2024-09-12T05:22:08.760 INFO:teuthology.orchestra.run.smithi059.stdout:5959 read 0x13e2fb1 thru 0x13f0443 (0xd493 bytes) 2024-09-12T05:22:08.761 INFO:teuthology.orchestra.run.smithi059.stdout:5960 write 0x546266d thru 0x5464d5c (0x26f0 bytes) 2024-09-12T05:22:08.763 INFO:teuthology.orchestra.run.smithi059.stdout:5961 read 0x3c723e7 thru 0x3c7a7c9 (0x83e3 bytes) 2024-09-12T05:22:08.764 INFO:teuthology.orchestra.run.smithi059.stdout:5962 read 0x5371b08 thru 0x53793c2 (0x78bb bytes) 2024-09-12T05:22:08.764 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:08.764 INFO:teuthology.orchestra.run.smithi059.stdout:5964 read 0xd954e95 thru 0xd962ba5 (0xdd11 bytes) 2024-09-12T05:22:08.764 INFO:teuthology.orchestra.run.smithi059.stdout:5965 write 0xacb2302 thru 0xacbe884 (0xc583 bytes) 2024-09-12T05:22:08.768 INFO:teuthology.orchestra.run.smithi059.stdout:5966 write 0x49a0614 thru 0x49afce0 (0xf6cd bytes) 2024-09-12T05:22:08.771 INFO:teuthology.orchestra.run.smithi059.stdout:5967 write 0x50e8f9d thru 0x50ea149 (0x11ad bytes) 2024-09-12T05:22:08.775 INFO:teuthology.orchestra.run.smithi059.stdout:5968 read 0x47e4e23 thru 0x47eb006 (0x61e4 bytes) 2024-09-12T05:22:08.775 INFO:teuthology.orchestra.run.smithi059.stdout:5969 writesame 0x7f9cd43 thru 0x7fa6ecd data_size 0xf(0xa18b bytes) 2024-09-12T05:22:08.785 INFO:teuthology.orchestra.run.smithi059.stdout:5970 trunc from 0xe5fbd6c to 0xbd38f5e 2024-09-12T05:22:08.800 INFO:teuthology.orchestra.run.smithi059.stdout:5971 write 0x74e807e thru 0x74f1202 (0x9185 bytes) 2024-09-12T05:22:08.803 INFO:teuthology.orchestra.run.smithi059.stdout:5972 read 0x8e70347 thru 0x8e754d8 (0x5192 bytes) 2024-09-12T05:22:08.804 INFO:teuthology.orchestra.run.smithi059.stdout:5973 flatten 2024-09-12T05:22:08.842 INFO:teuthology.orchestra.run.smithi059.stdout:5974 write 0xab97f01 thru 0xab9f103 (0x7203 bytes) 2024-09-12T05:22:08.845 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:08.843+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:08.846 INFO:teuthology.orchestra.run.smithi059.stdout:compare and write disabled 2024-09-12T05:22:08.846 INFO:teuthology.orchestra.run.smithi059.stdout:5976 writesame 0x457854c thru 0x457ca7a data_size 0x1(0x452f bytes) 2024-09-12T05:22:08.869 INFO:teuthology.orchestra.run.smithi059.stdout:5979 writesame 0x64b4fb8 thru 0x64bf25d data_size 0x6d(0xa2a6 bytes) 2024-09-12T05:22:08.869 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:08.870 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:08.872 INFO:teuthology.orchestra.run.smithi059.stdout:5980 read 0x19b8ff thru 0x1a83ed (0xcaef bytes) 2024-09-12T05:22:08.874 INFO:teuthology.orchestra.run.smithi059.stdout:5981 trunc from 0xbd38f5e to 0xbacde95 2024-09-12T05:22:08.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:08.896 INFO:teuthology.orchestra.run.smithi059.stdout:5982 read 0xa93acef thru 0xa941283 (0x6595 bytes) 2024-09-12T05:22:08.897 INFO:teuthology.orchestra.run.smithi059.stdout:5983 write 0x5afaecd thru 0x5b044b9 (0x95ed bytes) 2024-09-12T05:22:08.898 INFO:teuthology.orchestra.run.smithi059.stdout:truncating to largest ever: 0xee2f3a8 2024-09-12T05:22:08.903 INFO:teuthology.orchestra.run.smithi059.stdout:5984 trunc from 0xbacde95 to 0xee2f3a8 2024-09-12T05:22:08.917 INFO:teuthology.orchestra.run.smithi059.stdout:5985 write 0x6dc061a thru 0x6dc5ec7 (0x58ae bytes) 2024-09-12T05:22:08.919 INFO:teuthology.orchestra.run.smithi059.stdout:5986 punch from 0x4823ab1 to 0x482753d, (0x3a8c bytes) 2024-09-12T05:22:08.919 INFO:teuthology.orchestra.run.smithi059.stdout:5987 write 0xe7097af thru 0xe710429 (0x6c7b bytes) 2024-09-12T05:22:08.925 INFO:teuthology.orchestra.run.smithi059.stdout:5989 punch from 0x73e6409 to 0x73f1d45, (0xb93c bytes) 2024-09-12T05:22:08.930 INFO:teuthology.orchestra.run.smithi059.stdout:5990 trunc from 0xee2f3a8 to 0xb956b0e 2024-09-12T05:22:08.946 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:08.943+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:08.957 INFO:teuthology.orchestra.run.smithi059.stdout:5991 trunc from 0xb956b0e to 0x21fb1b6 2024-09-12T05:22:08.977 INFO:teuthology.orchestra.run.smithi059.stdout:5995 read 0x153f09d thru 0x15472f1 (0x8255 bytes) 2024-09-12T05:22:08.978 INFO:teuthology.orchestra.run.smithi059.stdout:5996 punch from 0x21e1503 to 0x21e89a0, (0x749d bytes) 2024-09-12T05:22:08.996 INFO:teuthology.orchestra.run.smithi059.stdout:5997 write 0x5fafef1 thru 0x5fbb232 (0xb342 bytes) 2024-09-12T05:22:09.001 INFO:teuthology.orchestra.run.smithi059.stdout:5998 write 0x5137cf3 thru 0x513ca90 (0x4d9e bytes) 2024-09-12T05:22:09.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:09.011+0000 7f35ea9257c0 -1 osd.4 58 log_to_monitors true 2024-09-12T05:22:09.019 INFO:teuthology.orchestra.run.smithi059.stdout:5999 trunc from 0x5fbb233 to 0xcdeb05 2024-09-12T05:22:09.031 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:09.031 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:09.040 INFO:teuthology.orchestra.run.smithi059.stdout:6000 read 0xc8642b thru 0xc88c90 (0x2866 bytes) 2024-09-12T05:22:09.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:09.048 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:09.046+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:09.087 INFO:teuthology.orchestra.run.smithi059.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-09-12T05:22:09.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:09.148 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:09.143+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:09.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:22:09.210 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:09.207+0000 7f35de700640 -1 osd.4 113 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:22:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:09.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:22:09.249 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:09.247+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:09.304 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:09.332 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:09.333 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:09.350 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:09.350 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:09.350+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:09.366 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:09.367 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:09.367 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-12T05:22:09.386 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:09.386 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:09.386 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:09.387 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:09.388 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:09.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:22:09.411 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:09.432 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:09.436 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:09.436 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:09.451 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:09.447+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:09.526 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:09.527 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:09.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:22:09.553 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:09.551+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:09.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:09.655+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:09.671 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80149 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7028736~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.958361375000003, 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047236827000000002, 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80149 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712538+0000", 2024-09-12T05:22:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712539+0000", 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6599999999999996e-07 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712542+0000", 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9639999999999999e-06 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712550+0000", 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7709999999999995e-06 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712556+0000", 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6380000000000001e-06 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759608+0000", 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047051754000000001 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759684+0000", 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6784000000000002e-05 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759775+0000", 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000001e-05 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80150 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6701056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.958334137999998, 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047422082999999997, 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.677 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80150 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.712565+0000", 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713023+0000", 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00045808399999999999 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713028+0000", 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7849999999999999e-06 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713039+0000", 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0530000000000001e-05 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713046+0000", 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2710000000000003e-06 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759807+0000", 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046761182999999998 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759887+0000", 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9709999999999994e-05 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.759987+0000", 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010052000000000001 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80151 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7036928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:22:09.681 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.957839765999999, 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047137710999999999, 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80151 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713060+0000", 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000004e-07 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713063+0000", 2024-09-12T05:22:09.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7460000000000001e-06 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713071+0000", 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6159999999999996e-06 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713077+0000", 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9780000000000002e-06 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760020+0000", 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046943358999999997 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760098+0000", 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7519000000000001e-05 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760197+0000", 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9778000000000006e-05 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80152 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6709248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.957813813999998, 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047326518999999997, 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.686 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80152 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713086+0000", 2024-09-12T05:22:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713245+0000", 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015924600000000001 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713249+0000", 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3379999999999998e-06 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713265+0000", 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6184e-05 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713271+0000", 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6670000000000001e-06 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760231+0000", 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046960285999999997 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760311+0000", 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9643999999999998e-05 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760412+0000", 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101154 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80153 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6799360~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.957618648, 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047341640999999997, 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80153 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713281+0000", 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713474+0000", 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192898 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713477+0000", 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3890000000000001e-06 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713487+0000", 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9939999999999995e-06 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713494+0000", 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4540000000000001e-06 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760444+0000", 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046949957 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760526+0000", 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1361999999999998e-05 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760622+0000", 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6587000000000002e-05 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80154 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8413184~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.957392650000003, 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047319877000000003, 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80154 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713507+0000", 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713977+0000", 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00047076399999999998 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713985+0000", 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8790000000000003e-06 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.713996+0000", 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.113e-05 2024-09-12T05:22:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714003+0000", 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8979999999999999e-06 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760655+0000", 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046651821000000003 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760734+0000", 2024-09-12T05:22:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9208999999999993e-05 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.760827+0000", 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2176000000000007e-05 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80156 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 8503296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.956858132999997, 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047199342999999998, 2024-09-12T05:22:09.699 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80156 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.714041+0000", 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719243+0000", 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052018419999999999 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719248+0000", 2024-09-12T05:22:09.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1760000000000001e-06 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719261+0000", 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3045e-05 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.719269+0000", 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1130000000000001e-06 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761068+0000", 2024-09-12T05:22:09.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041798096999999999 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761148+0000", 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0301000000000002e-05 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.761241+0000", 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769000000000006e-05 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80227 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4956160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.950840759999998, 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047195107, 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80227 2024-09-12T05:22:09.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720059+0000", 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4900000000000001e-07 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720061+0000", 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0980000000000001e-06 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720068+0000", 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.007e-06 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720074+0000", 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767070+0000", 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046996653999999999 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767150+0000", 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9919000000000005e-05 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767254+0000", 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103639 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80228 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 5718016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.950818910000002, 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047313252, 2024-09-12T05:22:09.708 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.709 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.709 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.709 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.709 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.709 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.709 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80228 2024-09-12T05:22:09.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.712 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:22:09.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720080+0000", 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720081+0000", 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8599999999999999e-07 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720083+0000", 2024-09-12T05:22:09.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0839999999999999e-06 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720089+0000", 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720094+0000", 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7929999999999997e-06 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767286+0000", 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047191666 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767338+0000", 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2441000000000002e-05 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767394+0000", 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5526000000000003e-05 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.715 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80229 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 4628480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.950798902999999, 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047505240999999997, 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80229 2024-09-12T05:22:09.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.720100+0000", 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727276+0000", 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071757619999999996 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727282+0000", 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7019999999999998e-06 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727293+0000", 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0778000000000001e-05 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.727300+0000", 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5769999999999996e-06 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767428+0000", 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040128193 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767510+0000", 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1203000000000002e-05 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.767606+0000", 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6026000000000005e-05 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80275 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 7069696~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.942781681, 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047223138999999997, 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.720 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80275 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728118+0000", 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9399999999999995e-07 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728120+0000", 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2879999999999999e-06 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728127+0000", 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8669999999999996e-06 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728133+0000", 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775161+0000", 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047027843 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775243+0000", 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2126999999999995e-05 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775341+0000", 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8189000000000005e-05 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80276 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6742016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.942759428000002, 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047322971999999998, 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80276 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728140+0000", 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728506+0000", 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036576600000000001 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728510+0000", 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5689999999999998e-06 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728519+0000", 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7190000000000007e-06 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728525+0000", 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-09-12T05:22:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775371+0000", 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046846023000000001 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775410+0000", 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8584000000000002e-05 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775463+0000", 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2964999999999999e-05 2024-09-12T05:22:09.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80277 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6758400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.942358425000002, 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047131702999999997, 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80277 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728541+0000", 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728770+0000", 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228586 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728774+0000", 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7380000000000002e-06 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728784+0000", 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5249999999999994e-06 2024-09-12T05:22:09.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728790+0000", 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6139999999999997e-06 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775498+0000", 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046708040999999999 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775577+0000", 2024-09-12T05:22:09.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8553999999999994e-05 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775673+0000", 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5644999999999997e-05 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80279 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6856704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.942070672, 2024-09-12T05:22:09.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047172124000000003, 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80279 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.728829+0000", 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729026+0000", 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019762800000000001 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729030+0000", 2024-09-12T05:22:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729039+0000", 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1209999999999996e-06 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729046+0000", 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3450000000000002e-06 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775825+0000", 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046779646000000001 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.775906+0000", 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0337e-05 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776001+0000", 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5047e-05 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80281 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6635520~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.941806868, 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047239476000000002, 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80281 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729093+0000", 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729204+0000", 2024-09-12T05:22:09.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111247 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729209+0000", 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2979999999999999e-06 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729220+0000", 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1032e-05 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729228+0000", 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.571e-06 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776155+0000", 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046927340999999997 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776236+0000", 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0551999999999997e-05 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776332+0000", 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6434999999999994e-05 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80282 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 6971392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.941657880999998, 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047211569000000002, 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.742 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80282 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729241+0000", 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729654+0000", 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000412118 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729662+0000", 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8200000000000003e-06 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729675+0000", 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2996000000000001e-05 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729684+0000", 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1629999999999996e-06 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776362+0000", 2024-09-12T05:22:09.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046678450000000003 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776403+0000", 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0627999999999998e-05 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776453+0000", 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0393999999999999e-05 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80285 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 3104768~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.941076172000002, 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047179632999999999, 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80285 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.729823+0000", 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730008+0000", 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018459999999999999 2024-09-12T05:22:09.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730012+0000", 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6090000000000003e-06 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730024+0000", 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1853e-05 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730033+0000", 2024-09-12T05:22:09.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9700000000000005e-06 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776826+0000", 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046792907000000002 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.776908+0000", 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1981e-05 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777003+0000", 2024-09-12T05:22:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4712999999999999e-05 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80287 3.1e 3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:16 [read 2777088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.940659265999997, 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047092717999999999, 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:09.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80287 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730240+0000", 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730400+0000", 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000159684 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730404+0000", 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2780000000000004e-06 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730412+0000", 2024-09-12T05:22:09.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4669999999999998e-06 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.730416+0000", 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6609999999999999e-06 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777158+0000", 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046741956000000001 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777236+0000", 2024-09-12T05:22:09.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7960999999999994e-05 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.777333+0000", 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6711000000000003e-05 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:102631 3.7 3:e1f14bfd:::rbd_data.11181f89f1e6.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.579467336, 2024-09-12T05:22:09.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048849113999999999, 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 102631 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091432+0000", 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091434+0000", 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.429e-06 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091445+0000", 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0932e-05 2024-09-12T05:22:09.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091471+0000", 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-05 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091486+0000", 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5506999999999999e-05 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091583+0000", 2024-09-12T05:22:09.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6407e-05 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.091661+0000", 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8046999999999993e-05 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.098845+0000", 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071841509999999997 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:09.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140140+0000", 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041295239999999997 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140190+0000", 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9629999999999997e-05 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140240+0000", 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0353999999999999e-05 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:38.140281+0000", 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1007000000000002e-05 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:108406 3.2 3:4229a37b:::rbd_data.1118aababa9c.0000000000000044:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:51.459499+0000", 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.211400351000002, 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059975282999999997, 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:09.761 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 108406 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459499+0000", 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459499+0000", 2024-09-12T05:22:09.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459500+0000", 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2699999999999999e-06 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459507+0000", 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2400000000000004e-06 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:09.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459522+0000", 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.543e-05 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459531+0000", 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5660000000000007e-06 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459595+0000", 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4542000000000006e-05 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.459704+0000", 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108996 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5", 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.467163+0000", 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074590489999999997 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.519206+0000", 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052042494000000002 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.519310+0000", 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104615 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.519405+0000", 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4905e-05 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:51.519474+0000", 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9176000000000003e-05 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.766 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:09.767 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:09.767 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:09.768 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:09.769 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:09.766+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:09.869 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:09.870+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:09.899 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:09.899 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:09.899 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:09.900 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:09.916 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:09.972 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:09.967+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:10.036 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:10.036 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:10.036 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:10.036 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:10.037 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:10.050 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:10.093 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:10.091+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:10.155 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:22:10.174 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:10.171+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.727753847000002, 2024-09-12T05:22:10.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:10.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:10.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:22:10.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:22:10.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.727722198000002, 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:22:10.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:22:10.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.727686054999999, 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:22:10.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:22:10.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:10.245 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.727655245000001, 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:10.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:22:10.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.727624685999999, 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:22:10.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:10.254 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.727594789999998, 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:10.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:10.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:22:10.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.725837847000001, 2024-09-12T05:22:10.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:10.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.725794278000002, 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.264 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.725562388, 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.268 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:22:10.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.725441476999997, 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:22:10.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:22:10.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.725324438999998, 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.277 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:10.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:22:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.725204830999999, 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:22:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101774 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4833280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.722258877000002, 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090801491999999998, 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101774 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507678+0000", 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507679+0000", 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2399999999999996e-07 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507682+0000", 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507691+0000", 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3230000000000004e-06 2024-09-12T05:22:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507698+0000", 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1400000000000002e-06 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598168+0000", 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090470153999999997 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598305+0000", 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136935 2024-09-12T05:22:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598479+0000", 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0001738 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.722226104000001, 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:22:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:22:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.722191797999997, 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:22:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.722159622, 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:22:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.722098006000003, 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:22:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.722042649999999, 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:22:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.721987843999997, 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:22:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.721828170000002, 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:22:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:22:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:22:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.325 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:10.326 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:10.327 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:10.323+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:10.427 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:10.426+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:10.496 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:10.496 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:10.496 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:10.496 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:10.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:10.557 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:10.555+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:10.631 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:10.631 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:10.631 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:10.632 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:10.630+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:10.645 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:10.735 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:10.734+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.644355189999999, 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:22:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:22:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:22:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.643653670000006, 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:22:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:22:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.643530936000005, 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:22:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.643468722999998, 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:22:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:22:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.643401905999994, 2024-09-12T05:22:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.643341872999997, 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:22:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.643261937000005, 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:22:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.643202376000005, 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.643127586999995, 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:22:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:22:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642990186999995, 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642838452000007, 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642775478000004, 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:22:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:22:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642639586000001, 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:22:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.879 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642575625999996, 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:22:10.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:22:10.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642491372999999, 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:22:10.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:22:10.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642432013000004, 2024-09-12T05:22:10.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:22:10.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:22:10.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:22:10.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642371745999995, 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.898 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642308752999995, 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:10.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.642148144999993, 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:10.903 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.198916431000001, 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:22:10.907 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:10.911 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:10.913 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:10.913 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:10.911+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:11.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:11.011+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:11.084 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:11.084 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:11.084 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:11.084 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:11.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:11.145 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:11.143+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:11.216 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:11.214+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:11.270 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:11.270 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:11.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:11.316 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:11.314+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:11.409 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:11.409 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:11.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:11.409 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:11.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.168498169999999, 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:22:11.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:22:11.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.167484448, 2024-09-12T05:22:11.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.166790587000001, 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.163805744000001, 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.163564419, 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.162816208999999, 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.162504448, 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:22:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:22:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.161781486999999, 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:22:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:22:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.160482567999999, 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:22:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.157930814, 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:22:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:22:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.157152323999998, 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:22:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:22:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:22:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:22:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.156879983, 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.155603697, 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:22:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:22:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.154201081, 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:22:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.153485580000002, 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:22:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:22:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:22:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:22:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.152164184, 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.151087538999999, 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.150864795, 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.509 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:22:11.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:22:11.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.150243755999998, 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:22:11.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:22:11.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.148595622999999, 2024-09-12T05:22:11.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:11.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:22:11.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:11.528 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:11.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:11.530 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:11.527+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:11.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:11.631 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:11.630+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:11.659 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:11.659 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:115727 3.1 3.5854d581 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:10.175781+0000", 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.485846225, 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4858718630000001, 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "waiting for peered", 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 115727 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.660 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:10.175781+0000", 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:10.175781+0000", 2024-09-12T05:22:11.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:10.175783+0000", 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-06 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:10.175790+0000", 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9920000000000001e-06 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:10.175810+0000", 2024-09-12T05:22:11.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9814999999999999e-05 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:10.175821+0000", 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0942e-05 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:10.175888+0000", 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7497999999999996e-05 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:10.175896+0000", 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7160000000000003e-06 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:11.171854+0000", 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.99595802099999997 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:11.171887+0000", 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3352999999999997e-05 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:11.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:11.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:11.665 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:11.665 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 1 2024-09-12T05:22:11.665 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:11.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:11.687 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:11.687 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:11.704 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:11.705 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:11.721 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:11.732 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:11.730+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:11.738 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:11.760 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-12T05:22:11.780 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:11.781 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:11.802 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:11.802 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:11.803 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:11.803 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:11.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:11.824 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:11.825 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:11.844 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:11.842+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:11.933 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:11.934+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:11.942 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:11.942 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:11.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:12.035 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:12.031+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:12.119 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:12.120 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:12.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:12.136 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:12.131+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:12.194 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:22:12.237 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:12.235+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:12.281 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:12.281 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:12.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:12.338 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:12.335+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:12.439 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:12.439 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:12.439 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:12.435+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:12.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:12.540 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:12.539+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:12.572 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:12.572 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:12.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:12.641 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:12.639+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:12.711 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:12.711 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:12.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:12.743 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:12.739+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:12.846 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:12.842+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:12.847 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:12.847 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:12.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:22:12.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:12.943+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:13.037 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:13.038 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:13.045 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:13.046+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:13.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:22:13.146 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:13.143+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:22:13.241 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:13.242 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:13.247 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:13.243+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:13.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:22:13.348 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:13.343+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:13.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:13.424 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:13.424 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:13.438 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:13.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:13.483+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:13.524 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:13.524 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:13.549 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:13.550+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:13.569 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:13.569 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:13.584 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:13.650 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:13.650+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:13.751 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:13.750+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:13.765 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:13.765 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:13.781 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:13.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:13.851 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:13.847+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:13.919 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:13.919 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:13.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:13.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:13.979+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:14.005 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:14.006 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:14.022 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:14.022 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:14.038 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:14.039 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:14.053 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:14.054+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:14.054 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:14.073 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:14.073 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:14.096 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:14.096 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:14.110 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:14.111 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:14.117 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:14.117 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:14.127 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:14.138 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:14.138 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:14.177 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:14.175+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:14.255 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:14.254+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:14.256 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:14.257 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:14.272 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:14.356 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:14.354+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:14.434 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:14.434 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.262041576000001, 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.435 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:22:14.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.261340055999995, 2024-09-12T05:22:14.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:22:14.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.261217321999993, 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.444 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:22:14.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.261155109000001, 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:22:14.448 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.452 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.261088291999997, 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.453 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:22:14.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:22:14.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.261028259, 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:14.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:14.461 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260948322999994, 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:14.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.465 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260888761999993, 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.466 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260813972999998, 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.470 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:22:14.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260676572999998, 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:22:14.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:22:14.478 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260524837999995, 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260461864000007, 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.483 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.487 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260325972000004, 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.491 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260262011999998, 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.492 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260177759000001, 2024-09-12T05:22:14.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.497 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:14.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:22:14.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260118399000007, 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:22:14.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:22:14.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.260058131999997, 2024-09-12T05:22:14.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:22:14.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.259995138999997, 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:22:14.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:14.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:14.514 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.259834530999996, 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:22:14.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:22:14.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.816602817000003, 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.522 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.523 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.523 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:14.523 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:14.523 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:14.524 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:14.525 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:14.522+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:14.625 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:14.623+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:14.649 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:14.649 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:14.650 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:14.650 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:14.663 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:14.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:14.747+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:14.827 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:14.823+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:14.835 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:14.835 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:14.836 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:14.836 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:14.836 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:14.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:14.928 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:14.926+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:15.017 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:15.017 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:15.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:15.017 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.778471621000001, 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:22:15.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.023 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.777457899000002, 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:22:15.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:22:15.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:22:15.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.776764038, 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.030 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:22:15.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:22:15.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:22:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:22:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.773779194999999, 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:22:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:22:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.773537869999998, 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:22:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:22:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:22:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:22:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:22:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.772789660000001, 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:22:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:22:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:22:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:22:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:22:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.772477898999998, 2024-09-12T05:22:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:22:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.771754938000001, 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:22:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:22:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.770456019000001, 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:22:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:22:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:22:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:22:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.767904264999999, 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:22:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:22:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:22:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:22:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:22:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.767125775, 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:22:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:22:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.766853434000001, 2024-09-12T05:22:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:22:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:22:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:22:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:22:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.765577147999998, 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:22:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:22:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:22:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:22:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:22:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.764174531999998, 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:22:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:22:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:22:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:22:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.763459031, 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:22:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:22:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:22:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:22:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:22:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.762137634999998, 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:22:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:22:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:22:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:22:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:22:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:22:15.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:22:15.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:22:15.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:22:15.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:22:15.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:22:15.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:22:15.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:22:15.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.129 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.130 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.130 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:15.130 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.761060990000001, 2024-09-12T05:22:15.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:22:15.131 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.131 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.131 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.132 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:22:15.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.132 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:15.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:15.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:22:15.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:22:15.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:22:15.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:22:15.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:22:15.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:22:15.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:22:15.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:22:15.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:22:15.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:22:15.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:22:15.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:22:15.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:22:15.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:22:15.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:22:15.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:22:15.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:22:15.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:22:15.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:22:15.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:22:15.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.142 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.143 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.143 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:15.143 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.760838245999999, 2024-09-12T05:22:15.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.144 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:22:15.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.760217207, 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.150 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:22:15.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:22:15.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.758569074, 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.156 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:22:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:22:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.163 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:15.164 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:15.164 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:15.159+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:15.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:22:15.281 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:15.282+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:15.340 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:15.340 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:15.340 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:15.340 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:15.353 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:15.365 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:15.366+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:15.466 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:15.463+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:15.476 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:15.476 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:15.476 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:15.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:15.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:15.575+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:15.661 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:15.661 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:15.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:15.661 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:15.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.661 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:27, version: 93'412, data_included: [0~33694,1460698~7155], data_size: 40849, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:27@93'412, size: 1467853, copy_subset: [(0, 1467853)], clone_subset: {}, snapset: 27=[]:{27: [27]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1467853, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:15.661 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.435570172, 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004462021, 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6300000000000001e-07 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224874+0000", 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2475999999999997e-05 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224892+0000", 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8433000000000001e-05 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224904+0000", 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1922e-05 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.226480+0000", 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015764850000000001 2024-09-12T05:22:15.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.226508+0000", 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7671e-05 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229283+0000", 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027747710000000001 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(osd.4.0:0 3.1a e118/117 ondisk, result = 0)", 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.225936+0000", 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.434454881, 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027466809999999999, 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225936+0000", 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225936+0000", 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225937+0000", 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8999999999999996e-07 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225941+0000", 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3309999999999997e-06 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225952+0000", 2024-09-12T05:22:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0752e-05 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225958+0000", 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9320000000000001e-06 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228618+0000", 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002660047 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228661+0000", 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3380000000000001e-05 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228683+0000", 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1549e-05 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(osd.4.0:1 3.1a e118/117 ondisk, result = 0)", 2024-09-12T05:22:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.227175+0000", 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4332163229999999, 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017090199999999999, 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227175+0000", 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227175+0000", 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227176+0000", 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.246e-06 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227182+0000", 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.494e-06 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227198+0000", 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6056e-05 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227224+0000", 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5446e-05 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228789+0000", 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001565283 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228797+0000", 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7069999999999992e-06 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228884+0000", 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6787999999999996e-05 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:head, version: 93'413, data_included: [0~33694], data_size: 33694, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:head@93'413, size: 524288, copy_subset: [(0, 524288)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 524288, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.433080184, 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040878429999999999, 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227312+0000", 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1480000000000001e-06 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227341+0000", 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8728e-05 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227365+0000", 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4717000000000001e-05 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227385+0000", 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9334000000000002e-05 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229393+0000", 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020081610000000001 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229417+0000", 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.231399+0000", 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019813209999999999 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head, version: 97'429, data_included: [0~262144,294912~425984,753664~163840,983040~196608], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head@97'429, size: 6848512, copy_subset: [(0, 6848512)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1179648, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.237177+0000", 2024-09-12T05:22:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4232138759999999, 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002102563, 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.237177+0000", 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.237177+0000", 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.237178+0000", 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-07 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.237635+0000", 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00045677899999999998 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.237661+0000", 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6207000000000002e-05 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.237678+0000", 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6603e-05 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.237801+0000", 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000122896 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.237815+0000", 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4633e-05 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.239280+0000", 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001464487 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head, version: 97'429, data_included: [1179648~229376,1441792~196608,1671168~163840,1867776~98304,2031616~65536,2162688~163840,2392064~98304,2555904~32768], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head@97'429, size: 6848512, copy_subset: [(0, 6848512)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2588672, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1179648, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.242908+0000", 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.417482634, 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026653739999999999, 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.242908+0000", 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.242908+0000", 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.242909+0000", 2024-09-12T05:22:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1999999999999998e-07 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243472+0000", 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056313299999999995 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243498+0000", 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5233999999999999e-05 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243518+0000", 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0492999999999998e-05 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243664+0000", 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014582399999999999 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243684+0000", 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0519000000000001e-05 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.245574+0000", 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001889251 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGRecoveryDelete(3.13 e118,115 3:cf38a6ce:::rbd_data.11185331af3a.000000000000003a:head,99'433)", 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.243555+0000", 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4168363070000001, 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002149569, 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243555+0000", 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243555+0000", 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243556+0000", 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9599999999999998e-07 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243561+0000", 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243570+0000", 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8060000000000001e-06 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243576+0000", 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2319999999999998e-06 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.245612+0000", 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020358630000000002 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.245620+0000", 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6120000000000001e-06 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.245704+0000", 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4322999999999999e-05 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head, version: 97'429, data_included: [2588672~98304,2719744~32768,2850816~98304,2981888~32768,3080192~131072,3244032~65536,3538944~65536,3670016~65536,3768320~131072,4227072~31397,4259840~32768,4358144~65536], data_size: 850597, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head@97'429, size: 6848512, copy_subset: [(0, 6848512)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 6848512, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2588672, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4132068090000001, 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035447669999999999, 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247185+0000", 2024-09-12T05:22:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0299999999999998e-07 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247574+0000", 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00038906500000000002 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247611+0000", 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6915999999999997e-05 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247649+0000", 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8053000000000003e-05 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247827+0000", 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017846499999999999 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247853+0000", 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5979999999999999e-05 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250729+0000", 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028755849999999999 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGRecoveryDelete(3.13 e118,115 3:c9b4d374:::rbd_data.111885717646.0000000000000011:head,101'441)", 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.248055+0000", 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.412335449, 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027715280000000001, 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248055+0000", 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248055+0000", 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248056+0000", 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248061+0000", 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1019999999999996e-06 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248073+0000", 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1786e-05 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248081+0000", 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.61e-06 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250756+0000", 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026750630000000001 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250763+0000", 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6000000000000001e-06 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250827+0000", 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3643e-05 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c8bf35e7:::rbd_data.1118d8682971.0000000000000001:head, version: 109'466, data_included: [383481~140807,1048576~83287,1303593~63775], data_size: 287869, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c8bf35e7:::rbd_data.1118d8682971.0000000000000001:head@109'466, size: 2097152, copy_subset: [(0, 2097152)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.260334+0000", 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.400057152, 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002090176, 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260334+0000", 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260334+0000", 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260335+0000", 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3999999999999999e-06 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260504+0000", 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016920100000000001 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260535+0000", 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1000000000000001e-05 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260565+0000", 2024-09-12T05:22:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9442999999999999e-05 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260717+0000", 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000151712 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260741+0000", 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4198000000000001e-05 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.262424+0000", 2024-09-12T05:22:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016832220000000001 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGRecoveryDelete(3.13 e118,115 3:ce55904a:::rbd_data.1118ee77a7a.00000000000001cf:head,110'468)", 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.260975+0000", 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3994157860000001, 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015827930000000001, 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260975+0000", 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260975+0000", 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260976+0000", 2024-09-12T05:22:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5600000000000004e-07 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260981+0000", 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2100000000000001e-06 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.260994+0000", 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3022e-05 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.261002+0000", 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.486e-06 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.262468+0000", 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014662099999999999 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.262476+0000", 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2020000000000004e-06 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.262558+0000", 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1806999999999998e-05 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.7.0:3085 3.e e119/118 3:76720be3:::rbd_data.1118ee77a7a.0000000000000000:2e v 119'432, mlcod=0'0)", 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.761326+0000", 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.89906486900000004, 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027874169999999999, 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761326+0000", 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761326+0000", 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761327+0000", 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761334+0000", 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2320000000000004e-06 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761347+0000", 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2931999999999999e-05 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761358+0000", 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246999999999999e-05 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761425+0000", 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6662000000000007e-05 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761454+0000", 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8810999999999999e-05 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.764056+0000", 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026027590000000001 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.764113+0000", 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7090999999999999e-05 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.5.0:3797 3.1c e119/118 3:3b574f5c:::rbd_data.1118ee77a7a.0000000000000148:2e v 119'586, mlcod=0'0)", 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.765524+0000", 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.89486684699999997, 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020937030000000001, 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765524+0000", 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765524+0000", 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765525+0000", 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0399999999999995e-07 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765531+0000", 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2580000000000001e-06 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765545+0000", 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765553+0000", 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1920000000000005e-06 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765614+0000", 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1057999999999997e-05 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765640+0000", 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5769e-05 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.767499+0000", 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018583440000000001 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.767618+0000", 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119239 2024-09-12T05:22:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.0.0:3118 3.1 e119/118 3:8128963e:::rbd_data.1118ee77a7a.000000000000000b:2e v 119'561, mlcod=0'0)", 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.765828+0000", 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.89456314199999998, 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001794838, 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765828+0000", 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765828+0000", 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765829+0000", 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3500000000000005e-07 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765836+0000", 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8940000000000004e-06 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765846+0000", 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0385e-05 2024-09-12T05:22:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765853+0000", 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8260000000000004e-06 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765929+0000", 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6524000000000001e-05 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.765959+0000", 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0173999999999999e-05 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.767570+0000", 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001610939 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.767623+0000", 2024-09-12T05:22:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2261e-05 2024-09-12T05:22:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:115914 3.1b e119/118 3:d801d429:::rbd_header.1118d8682971:head v 119'604, mlcod=119'602)", 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.790264+0000", 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87012694800000001, 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001571844, 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.790264+0000", 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.790264+0000", 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.790265+0000", 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.294e-06 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.790276+0000", 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0309000000000001e-05 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.790294+0000", 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8461000000000002e-05 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.790306+0000", 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2140999999999999e-05 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.790480+0000", 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017429699999999999 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.790518+0000", 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7947000000000001e-05 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.791754+0000", 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001235756 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.791836+0000", 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1638999999999995e-05 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:115929 3.1b e119/118 3:d801d429:::rbd_header.1118d8682971:head v 119'606, mlcod=119'604)", 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.814211+0000", 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.84617959499999995, 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016489569999999999, 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.814211+0000", 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.814211+0000", 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.814213+0000", 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0099999999999998e-06 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.814226+0000", 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.295e-05 2024-09-12T05:22:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.814254+0000", 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7926999999999999e-05 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.814277+0000", 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3213e-05 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.814453+0000", 2024-09-12T05:22:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512800000000001 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.814492+0000", 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9789999999999997e-05 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.815770+0000", 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012779670000000001 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.815860+0000", 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9971999999999998e-05 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115942 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.838371+0000", 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.82202021800000002, 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032704019999999999, 2024-09-12T05:22:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115942 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838371+0000", 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838371+0000", 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838373+0000", 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4499999999999998e-06 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838385+0000", 2024-09-12T05:22:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2097e-05 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838411+0000", 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5950000000000001e-05 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838433+0000", 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838564+0000", 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013139900000000001 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838790+0000", 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022540799999999999 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.839079+0000", 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028977799999999998 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.840329+0000", 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012492130000000001 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.841345+0000", 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010160620000000001 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.841512+0000", 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016749899999999999 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.841641+0000", 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129033 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:115944 3.1c e119/118 3:3831950c:::rbd_directory:head v 119'587, mlcod=116'584)", 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.852022+0000", 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.80836844600000002, 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001503278, 2024-09-12T05:22:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.852022+0000", 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.852022+0000", 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.852024+0000", 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4160000000000001e-06 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.852032+0000", 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8019999999999992e-06 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.852049+0000", 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7774999999999998e-05 2024-09-12T05:22:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.852058+0000", 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2849999999999995e-06 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.852136+0000", 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8504000000000006e-05 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.852167+0000", 2024-09-12T05:22:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0552999999999997e-05 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.853463+0000", 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012964439999999999 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.853526+0000", 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2498999999999999e-05 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115945 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.854233+0000", 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.80615836699999999, 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028734810000000002, 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115945 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854233+0000", 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854233+0000", 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854235+0000", 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2469999999999998e-06 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854248+0000", 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3662999999999999e-05 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854274+0000", 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5225999999999999e-05 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854288+0000", 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4727e-05 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854386+0000", 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7608000000000005e-05 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854524+0000", 2024-09-12T05:22:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013764300000000001 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854812+0000", 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028875400000000001 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.855861+0000", 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010484909999999999 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.856960+0000", 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010987320000000001 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.857040+0000", 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0711999999999996e-05 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.857106+0000", 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5678000000000004e-05 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115948 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.859193+0000", 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.80119779599999996, 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029826280000000002, 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115948 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859193+0000", 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859193+0000", 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859195+0000", 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859221+0000", 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6186e-05 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859241+0000", 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129999999999999e-05 2024-09-12T05:22:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859252+0000", 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1165999999999999e-05 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859325+0000", 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2422000000000006e-05 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859440+0000", 2024-09-12T05:22:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115603 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859704+0000", 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026347499999999999 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.860703+0000", 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099876499999999998 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.862039+0000", 2024-09-12T05:22:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001336666 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.862116+0000", 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6254999999999994e-05 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.862176+0000", 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0250000000000001e-05 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:15.753 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:15.754 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:15.751+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:15.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:15.755 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:22:15.855 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:15.854+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:15.887 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:15.887 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:15.887 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:15.887 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:15.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:15.993 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:15.994+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:16.057 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:16.054+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:16.066 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:16.066 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:16.066 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:16.066 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:16.067 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:16.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:16.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:16.158 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:16.155+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:16.258 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 76.138230394000004, 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:16.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:22:16.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:22:16.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.807629323999997, 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:16.265 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:16.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.681068885999998, 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.269 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:16.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:22:16.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.273 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680543360999998, 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:22:16.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680520813000001, 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.278 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:22:16.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:22:16.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680499023000003, 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:22:16.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680477658000001, 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.287 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:22:16.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.291 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680455113000001, 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:22:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680432877999998, 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.296 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:22:16.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:22:16.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680411294000002, 2024-09-12T05:22:16.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:16.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:22:16.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:22:16.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:22:16.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680209894999997, 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.306 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:16.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:16.310 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.680184494999999, 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.314 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.672911218000003, 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.315 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:22:16.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:22:16.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.672888827999998, 2024-09-12T05:22:16.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:22:16.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.67286618, 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:22:16.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.672845690999999, 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.328 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.332 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.672819625999999, 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:22:16.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.672796409, 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.337 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:22:16.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.672774044999997, 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:16.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.346 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.196233669000001, 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:22:16.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:22:16.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:16.351 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:16.352 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:16.352 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:16.255+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:16.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:16.354 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:16.354 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:16.355 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:16.360 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:16.359+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:16.362 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:16.383 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:16.383 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:16.405 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:16.405 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:16.426 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:16.426 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:16.447 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:16.448 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:16.460 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:16.455+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:16.473 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:16.473 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:16.487 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:16.577 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:16.578+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:16.660 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:16.660 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:16.661 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:16.659+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:16.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:16.765 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:16.766+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:16.853 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:16.853 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:16.862 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:16.859+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:16.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:16.963 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:16.962+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:17.052 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:17.052 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:17.065 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:17.063+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:17.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:17.166 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:17.166+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:17.236 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:17.236 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:17.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:17.293 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:17.294+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:17.367 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:17.366+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:17.412 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:17.412 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:17.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:22:17.469 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:17.470+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:17.569 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:17.570+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:17.588 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:17.588 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:17.603 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:22:17.670 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:17.667+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:17.774 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:17.770+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:17.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:22:17.786 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:17.787 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:17.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:22:17.872 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:17.867+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:17.973 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:17.971+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:17.980 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:17.980 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:17.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:18.074 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:18.071+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:18.125 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:18.125 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:18.139 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:18.175 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:18.174+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:18.276 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:18.271+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:18.302 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:18.302 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:18.316 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:18.377 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:18.378+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:18.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:18.474 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:18.474 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:18.487 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:18.513 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:18.514+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:18.543 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-12T05:22:18.543 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:22:18.544 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T05:22:18.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:22:18.579 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:18.575+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:18.606 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:18.606 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:18.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:18.624 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:18.624 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:18.641 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:18.641 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:18.660 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:18.660 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:18.677 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:18.677 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:18.679 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:18.678+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:18.696 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:18.714 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:18.732 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:18.732 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:18.752 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:18.752 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:18.781 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:18.779+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:22:18.789 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:18.789 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:18.790 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:18.790 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:18.790 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:18.810 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:18.876 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:22:18.876 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:18.876 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 123, 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:22:18.787241+0000", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:22:10.154005+0000", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:21:38.885631+0000", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5799936, 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:22:18.877 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 6, 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "luminous", 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:22:18.878 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:22:18.879 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:22:18.880 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:22:18.881 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:22:18.881 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:22:18.881 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:22:18.881 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:22:18.881 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:22:18.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.881 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:22:18.881 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:22:18.882 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:22:18.883 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:22:18.884 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:22:18.885 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:22:18.886 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:22:18.887 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:22:18.888 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:22:18.889 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.890 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:22:18.891 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.9900000095367432, 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.9900000095367432, 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:22:18.892 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:22:18.893 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:22:18.894 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:22:18.894 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:22:18.894 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:22:18.894 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:22:18.894 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:22:18.894 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:22:18.894 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:22:18.894 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:22:18.895 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:22:18.895 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:22:18.895 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:22:18.895 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:22:18.895 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:22:18.895 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:22:18.895 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "123", 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 46, 2024-09-12T05:22:18.896 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 123, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:22:18.897 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:22:18.898 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:22:18.898 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:22:18.901 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:22:18.902 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.75, 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.75, 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 1, 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.903 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 0.80352783203125, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 118, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:22:18.908 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:18.909 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 116, 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:18.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:22:18.911 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.912 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.913 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:18.914 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:22:18.915 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 106, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:18.918 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:18.919 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:22:18.920 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:22:18.921 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:22:18.921 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:22:18.921 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:18.921 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:18.921 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:18.921 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 74, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:18.922 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.923 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.926 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 14, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 58, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 114, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 118, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 60, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:18.928 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.931 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:18.932 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/1662122460", 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/1662122460", 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1662122460", 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/1662122460", 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.933 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 118, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.935 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:18.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:22:18.938 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 117, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.942 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:22:18.945 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 119, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.946 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.949 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:18.950 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.953 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:22:18.953 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:18.953 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:18.953 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:18.953 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:18.953 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:18.953 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:22:18.953 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:18.954 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:18.955 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:22:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:22:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:18.956 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 60 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:18.957 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:18.958 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.959 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [ 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.9", 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [ 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.960 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.1", 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 6 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.4", 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 0, 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 4 2024-09-12T05:22:18.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.f", 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 4, 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.15", 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:22:18.963 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [], 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [ 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "snaps": [ 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "begin": 42, 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "length": 5 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [ 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.965 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "snaps": [ 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "begin": 42, 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "length": 1 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:22:18.966 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:22:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:22:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:22:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:22:18.967 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:18.967 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:18.969 INFO:tasks.thrashosds.thrasher:j is {'epoch': 123, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:22:18.787241+0000', 'last_up_change': '2024-09-12T05:22:10.154005+0000', 'last_in_change': '2024-09-12T05:21:38.885631+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 46, 'snap_epoch': 123, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.80352783203125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 58, 'up_from': 114, 'up_thru': 118, 'down_at': 60, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 1662122460}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 1662122460}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 1662122460}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 1662122460}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 1662122460}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 1662122460}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 1662122460}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 1662122460}]}, 'public_addr': '172.21.15.194:6825/1662122460', 'cluster_addr': '172.21.15.194:6827/1662122460', 'heartbeat_back_addr': '172.21.15.194:6831/1662122460', 'heartbeat_front_addr': '172.21.15.194:6829/1662122460', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 117, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 60}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.9', 'osds': [0, 2]}], 'pg_upmap_items': [{'pgid': '2.1', 'mappings': [{'from': 3, 'to': 6}]}, {'pgid': '2.4', 'mappings': [{'from': 0, 'to': 4}]}, {'pgid': '3.f', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '3.15', 'mappings': [{'from': 3, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 5}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:22:18.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:22:18.970 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:18.963+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.813089145000006, 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:18.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:22:18.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:22:18.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.812387625, 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:18.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:18.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:22:18.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.812264890999998, 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.996 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:18.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.812202678000006, 2024-09-12T05:22:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:22:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.002 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.002 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:22:19.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.002 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:19.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:19.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:22:19.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:22:19.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:22:19.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:22:19.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:22:19.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:22:19.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:22:19.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:22:19.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:22:19.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.812135861000002, 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.008 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:19.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.012 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.812075828000005, 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.013 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:19.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:19.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:22:19.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:22:19.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:22:19.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:22:19.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:22:19.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:22:19.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:22:19.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:22:19.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:22:19.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:22:19.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.019 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.020 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.020 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:19.020 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811995891999999, 2024-09-12T05:22:19.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:22:19.020 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.020 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.020 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.021 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:22:19.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.022 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:19.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:19.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:22:19.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:22:19.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:22:19.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:19.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:22:19.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:22:19.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:22:19.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:22:19.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:22:19.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:22:19.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:22:19.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:22:19.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:22:19.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:22:19.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.028 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.028 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.029 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:19.029 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811936330999998, 2024-09-12T05:22:19.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:22:19.029 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.029 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.029 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.030 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:22:19.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.030 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:22:19.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:22:19.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:22:19.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:22:19.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:22:19.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:22:19.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:22:19.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:22:19.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:22:19.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:22:19.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811861542000003, 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:22:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811724142000003, 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.041 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:22:19.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:22:19.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811572407, 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811509432999998, 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:22:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811373540999995, 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:22:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:22:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:22:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:22:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:22:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:22:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:22:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:22:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:22:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:22:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:22:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:22:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:22:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:22:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811309581000003, 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:22:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811225328000006, 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:22:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:22:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:22:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:22:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:22:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811165967999997, 2024-09-12T05:22:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:22:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:22:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:22:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:22:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:22:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:22:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:22:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:22:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:22:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:22:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:22:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:22:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:22:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:22:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:22:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:22:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811105701000002, 2024-09-12T05:22:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:22:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:22:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:22:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:22:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:22:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:22:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.811042708000002, 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:22:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:22:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.810882100000001, 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.367650386000001, 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:22:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.105 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:19.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:19.107 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:19.103+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:19.207 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:19.203+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:19.278 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:19.278 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:19.278 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:19.278 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:19.286 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:22:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:22:19.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:19.309 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-12T05:22:18.936621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1653798842,"num_objects":2362,"num_object_clones":422,"num_object_copies":4724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2362,"num_whiteouts":1245,"num_read":150568,"num_read_kb":922287,"num_write":21737,"num_write_kb":471600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1339,"num_bytes_recovered":99063928,"num_keys_recovered":317,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17964,"ondisk_log_size":17964,"up":82,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1023616,"kb_used_data":687668,"kb_used_omap":38,"kb_used_meta":335641,"kb_avail":753951104,"statfs":{"total":773094113280,"available":772045930496,"internally_reserved":0,"allocated":704172032,"data_stored":892602598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39006,"internal_metadata":343697314},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17311572,"num_objects":-59,"num_object_clones":-3,"num_object_copies":-118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-59,"num_whiteouts":-1,"num_read":735,"num_read_kb":623,"num_write":141,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":395,"num_bytes_recovered":36260313,"num_keys_recovered":222,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001019"},"pg_stats":[{"pgid":"3.1f","version":"121'393","reported_seq":8569,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.961790+0000","last_change":"2024-09-12T05:22:16.779630+0000","last_active":"2024-09-12T05:22:16.961790+0000","last_peered":"2024-09-12T05:22:16.961790+0000","last_clean":"2024-09-12T05:22:16.961790+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:22:16.961790+0000","last_undegraded":"2024-09-12T05:22:16.961790+0000","last_fullsized":"2024-09-12T05:22:16.961790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:33.278031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158907,"stat_sum":{"num_bytes":23108289,"num_objects":77,"num_object_clones":16,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":42,"num_read":9127,"num_read_kb":33531,"num_write":380,"num_write_kb":7979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.1e","version":"110'329","reported_seq":7504,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.896379+0000","last_change":"2024-09-12T05:22:16.896663+0000","last_active":"2024-09-12T05:22:16.896379+0000","last_peered":"2024-09-12T05:22:16.896379+0000","last_clean":"2024-09-12T05:22:16.896379+0000","last_became_active":"2024-09-12T05:20:33.940420+0000","last_became_peered":"2024-09-12T05:20:33.940420+0000","last_unstale":"2024-09-12T05:22:16.896379+0000","last_undegraded":"2024-09-12T05:22:16.896379+0000","last_fullsized":"2024-09-12T05:22:16.896379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:27.641148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018549879999999999,"stat_sum":{"num_bytes":88563254,"num_objects":71,"num_object_clones":15,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":37,"num_read":7017,"num_read_kb":84715,"num_write":367,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.1d","version":"121'645","reported_seq":3418,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:17.042155+0000","last_change":"2024-09-12T05:22:16.798429+0000","last_active":"2024-09-12T05:22:17.042155+0000","last_peered":"2024-09-12T05:22:17.042155+0000","last_clean":"2024-09-12T05:22:17.042155+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:22:17.042155+0000","last_undegraded":"2024-09-12T05:22:17.042155+0000","last_fullsized":"2024-09-12T05:22:17.042155+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:24.257744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002602053,"stat_sum":{"num_bytes":27117658,"num_objects":71,"num_object_clones":12,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":35,"num_read":4754,"num_read_kb":8494,"num_write":778,"num_write_kb":5135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.1c","version":"121'589","reported_seq":4785,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:17.031141+0000","last_change":"2024-09-12T05:22:16.796688+0000","last_active":"2024-09-12T05:22:17.031141+0000","last_peered":"2024-09-12T05:22:17.031141+0000","last_clean":"2024-09-12T05:22:17.031141+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:22:17.031141+0000","last_undegraded":"2024-09-12T05:22:17.031141+0000","last_fullsized":"2024-09-12T05:22:17.031141+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:59.944046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014925680000000001,"stat_sum":{"num_bytes":42821450,"num_objects":74,"num_object_clones":14,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":42,"num_read":5739,"num_read_kb":38975,"num_write":643,"num_write_kb":9569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.1b","version":"121'628","reported_seq":3526,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.974009+0000","last_change":"2024-09-12T05:22:16.780744+0000","last_active":"2024-09-12T05:22:16.974009+0000","last_peered":"2024-09-12T05:22:16.974009+0000","last_clean":"2024-09-12T05:22:16.974009+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:22:16.974009+0000","last_undegraded":"2024-09-12T05:22:16.974009+0000","last_fullsized":"2024-09-12T05:22:16.974009+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:27.616947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019096359999999999,"stat_sum":{"num_bytes":57426879,"num_objects":82,"num_object_clones":14,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":45,"num_read":4748,"num_read_kb":38506,"num_write":686,"num_write_kb":28602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.1a","version":"116'378","reported_seq":4933,"reported_epoch":117,"state":"peering","last_fresh":"2024-09-12T05:22:12.445663+0000","last_change":"2024-09-12T05:22:14.208619+0000","last_active":"2024-09-12T05:22:14.208619+0000","last_peered":"2024-09-12T05:22:12.445663+0000","last_clean":"2024-09-12T05:20:53.806542+0000","last_became_active":"2024-09-12T05:22:12.185235+0000","last_became_peered":"2024-09-12T05:22:12.185235+0000","last_unstale":"2024-09-12T05:22:12.445663+0000","last_undegraded":"2024-09-12T05:22:12.445663+0000","last_fullsized":"2024-09-12T05:22:12.165417+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014130220000000001,"stat_sum":{"num_bytes":42689707,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":41,"num_read":5445,"num_read_kb":30659,"num_write":346,"num_write_kb":18470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":16982768,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"121'380","reported_seq":3616,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.954221+0000","last_change":"2024-09-12T05:22:16.762899+0000","last_active":"2024-09-12T05:22:16.954221+0000","last_peered":"2024-09-12T05:22:16.954221+0000","last_clean":"2024-09-12T05:22:16.954221+0000","last_became_active":"2024-09-12T05:20:09.736422+0000","last_became_peered":"2024-09-12T05:20:09.736422+0000","last_unstale":"2024-09-12T05:22:16.954221+0000","last_undegraded":"2024-09-12T05:22:16.954221+0000","last_fullsized":"2024-09-12T05:22:16.954221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:11.497660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001401313,"stat_sum":{"num_bytes":39875863,"num_objects":74,"num_object_clones":8,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":39,"num_read":3676,"num_read_kb":33155,"num_write":351,"num_write_kb":5066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.18","version":"121'530","reported_seq":3104,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.896315+0000","last_change":"2024-09-12T05:22:16.896315+0000","last_active":"2024-09-12T05:22:16.896315+0000","last_peered":"2024-09-12T05:22:16.896315+0000","last_clean":"2024-09-12T05:22:16.896315+0000","last_became_active":"2024-09-12T05:20:09.740953+0000","last_became_peered":"2024-09-12T05:20:09.740953+0000","last_unstale":"2024-09-12T05:22:16.896315+0000","last_undegraded":"2024-09-12T05:22:16.896315+0000","last_fullsized":"2024-09-12T05:22:16.896315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:55.802786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018145850000000001,"stat_sum":{"num_bytes":44346732,"num_objects":74,"num_object_clones":16,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":38,"num_read":4358,"num_read_kb":22089,"num_write":509,"num_write_kb":11860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.17","version":"114'590","reported_seq":1969,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.780120+0000","last_change":"2024-09-12T05:22:16.780120+0000","last_active":"2024-09-12T05:22:16.780120+0000","last_peered":"2024-09-12T05:22:16.780120+0000","last_clean":"2024-09-12T05:22:16.780120+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:22:16.780120+0000","last_undegraded":"2024-09-12T05:22:16.780120+0000","last_fullsized":"2024-09-12T05:22:16.780120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:53.544595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001379014,"stat_sum":{"num_bytes":40103916,"num_objects":66,"num_object_clones":12,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":37,"num_read":3100,"num_read_kb":14820,"num_write":749,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.16","version":"121'461","reported_seq":5826,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.797494+0000","last_change":"2024-09-12T05:22:16.797494+0000","last_active":"2024-09-12T05:22:16.797494+0000","last_peered":"2024-09-12T05:22:16.797494+0000","last_clean":"2024-09-12T05:22:16.797494+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:22:16.797494+0000","last_undegraded":"2024-09-12T05:22:16.797494+0000","last_fullsized":"2024-09-12T05:22:16.797494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:44.736285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592460000000001,"stat_sum":{"num_bytes":94876015,"num_objects":83,"num_object_clones":16,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":43,"num_read":6068,"num_read_kb":69469,"num_write":467,"num_write_kb":13679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.15","version":"121'368","reported_seq":1880,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:17.055329+0000","last_change":"2024-09-12T05:22:16.773112+0000","last_active":"2024-09-12T05:22:17.055329+0000","last_peered":"2024-09-12T05:22:17.055329+0000","last_clean":"2024-09-12T05:22:17.055329+0000","last_became_active":"2024-09-12T05:20:49.041294+0000","last_became_peered":"2024-09-12T05:20:49.041294+0000","last_unstale":"2024-09-12T05:22:17.055329+0000","last_undegraded":"2024-09-12T05:22:17.055329+0000","last_fullsized":"2024-09-12T05:22:17.055329+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:28.299296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035684860000000001,"stat_sum":{"num_bytes":38152867,"num_objects":67,"num_object_clones":15,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":32,"num_read":1769,"num_read_kb":12774,"num_write":414,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.14","version":"110'1150","reported_seq":4868,"reported_epoch":115,"state":"remapped+peering","last_fresh":"2024-09-12T05:22:11.165893+0000","last_change":"2024-09-12T05:22:11.165893+0000","last_active":"2024-09-12T05:22:11.165893+0000","last_peered":"2024-09-12T05:22:09.226313+0000","last_clean":"2024-09-12T05:20:58.183844+0000","last_became_active":"2024-09-12T05:21:03.163718+0000","last_became_peered":"2024-09-12T05:21:03.163718+0000","last_unstale":"2024-09-12T05:22:11.165893+0000","last_undegraded":"2024-09-12T05:22:11.165893+0000","last_fullsized":"2024-09-12T05:22:11.165893+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013351109999999999,"stat_sum":{"num_bytes":76735955,"num_objects":84,"num_object_clones":12,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":40,"num_read":8360,"num_read_kb":38637,"num_write":1734,"num_write_kb":25337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":4,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.907581+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:22:16.907581+0000","last_peered":"2024-09-12T05:22:16.907581+0000","last_clean":"2024-09-12T05:22:16.907581+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:22:16.907581+0000","last_undegraded":"2024-09-12T05:22:16.907581+0000","last_fullsized":"2024-09-12T05:22:16.907581+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"121'669","reported_seq":2047,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.958020+0000","last_change":"2024-09-12T05:22:16.779675+0000","last_active":"2024-09-12T05:22:16.958020+0000","last_peered":"2024-09-12T05:22:16.958020+0000","last_clean":"2024-09-12T05:22:16.958020+0000","last_became_active":"2024-09-12T05:20:09.741300+0000","last_became_peered":"2024-09-12T05:20:09.741300+0000","last_unstale":"2024-09-12T05:22:16.958020+0000","last_undegraded":"2024-09-12T05:22:16.958020+0000","last_fullsized":"2024-09-12T05:22:16.958020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:59.952576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531499999999998,"stat_sum":{"num_bytes":45390618,"num_objects":89,"num_object_clones":14,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":54,"num_read":2495,"num_read_kb":13915,"num_write":787,"num_write_kb":22015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"2.6","version":"0'0","reported_seq":230,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.762245+0000","last_change":"2024-09-12T05:20:33.943660+0000","last_active":"2024-09-12T05:22:16.762245+0000","last_peered":"2024-09-12T05:22:16.762245+0000","last_clean":"2024-09-12T05:22:16.762245+0000","last_became_active":"2024-09-12T05:20:33.943030+0000","last_became_peered":"2024-09-12T05:20:33.943030+0000","last_unstale":"2024-09-12T05:22:16.762245+0000","last_undegraded":"2024-09-12T05:22:16.762245+0000","last_fullsized":"2024-09-12T05:22:16.762245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:11.076201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"121'375","reported_seq":3125,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.952387+0000","last_change":"2024-09-12T05:22:16.897045+0000","last_active":"2024-09-12T05:22:16.952387+0000","last_peered":"2024-09-12T05:22:16.952387+0000","last_clean":"2024-09-12T05:22:16.952387+0000","last_became_active":"2024-09-12T05:20:09.747558+0000","last_became_peered":"2024-09-12T05:20:09.747558+0000","last_unstale":"2024-09-12T05:22:16.952387+0000","last_undegraded":"2024-09-12T05:22:16.952387+0000","last_fullsized":"2024-09-12T05:22:16.952387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:38.026124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020589860000000001,"stat_sum":{"num_bytes":67877653,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":33,"num_read":2802,"num_read_kb":54208,"num_write":420,"num_write_kb":24591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"2.5","version":"0'0","reported_seq":216,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.770143+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:22:16.770143+0000","last_peered":"2024-09-12T05:22:16.770143+0000","last_clean":"2024-09-12T05:22:16.770143+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:22:16.770143+0000","last_undegraded":"2024-09-12T05:22:16.770143+0000","last_fullsized":"2024-09-12T05:22:16.770143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"116'619","reported_seq":3309,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:17.052095+0000","last_change":"2024-09-12T05:22:16.763444+0000","last_active":"2024-09-12T05:22:17.052095+0000","last_peered":"2024-09-12T05:22:17.052095+0000","last_clean":"2024-09-12T05:22:17.052095+0000","last_became_active":"2024-09-12T05:21:42.927006+0000","last_became_peered":"2024-09-12T05:21:42.927006+0000","last_unstale":"2024-09-12T05:22:17.052095+0000","last_undegraded":"2024-09-12T05:22:17.052095+0000","last_fullsized":"2024-09-12T05:22:17.052095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:46.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016656959999999999,"stat_sum":{"num_bytes":43516114,"num_objects":72,"num_object_clones":12,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":37,"num_read":4611,"num_read_kb":22258,"num_write":702,"num_write_kb":28266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":11476389,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.761973+0000","last_change":"2024-09-12T05:22:12.172861+0000","last_active":"2024-09-12T05:22:16.761973+0000","last_peered":"2024-09-12T05:22:16.761973+0000","last_clean":"2024-09-12T05:22:16.761973+0000","last_became_active":"2024-09-12T05:22:12.172516+0000","last_became_peered":"2024-09-12T05:22:12.172516+0000","last_unstale":"2024-09-12T05:22:16.761973+0000","last_undegraded":"2024-09-12T05:22:16.761973+0000","last_fullsized":"2024-09-12T05:22:16.761973+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:56.896612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"121'431","reported_seq":2404,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.962382+0000","last_change":"2024-09-12T05:22:16.797461+0000","last_active":"2024-09-12T05:22:16.962382+0000","last_peered":"2024-09-12T05:22:16.962382+0000","last_clean":"2024-09-12T05:22:16.962382+0000","last_became_active":"2024-09-12T05:20:09.734285+0000","last_became_peered":"2024-09-12T05:20:09.734285+0000","last_unstale":"2024-09-12T05:22:16.962382+0000","last_undegraded":"2024-09-12T05:22:16.962382+0000","last_fullsized":"2024-09-12T05:22:16.962382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:20.982003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018402710000000001,"stat_sum":{"num_bytes":43433439,"num_objects":52,"num_object_clones":8,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":26,"num_read":2551,"num_read_kb":20396,"num_write":556,"num_write_kb":10552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.3","version":"116'464","reported_seq":4240,"reported_epoch":117,"state":"peering","last_fresh":"2024-09-12T05:22:12.585242+0000","last_change":"2024-09-12T05:22:14.208680+0000","last_active":"2024-09-12T05:22:14.208680+0000","last_peered":"2024-09-12T05:22:12.585242+0000","last_clean":"2024-09-12T05:21:00.585064+0000","last_became_active":"2024-09-12T05:22:12.204678+0000","last_became_peered":"2024-09-12T05:22:12.204678+0000","last_unstale":"2024-09-12T05:22:12.585242+0000","last_undegraded":"2024-09-12T05:22:12.585242+0000","last_fullsized":"2024-09-12T05:22:12.169328+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011274589999999999,"stat_sum":{"num_bytes":47141388,"num_objects":87,"num_object_clones":13,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":48,"num_read":4520,"num_read_kb":18104,"num_write":450,"num_write_kb":26215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":221,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.795026+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:22:16.795026+0000","last_peered":"2024-09-12T05:22:16.795026+0000","last_clean":"2024-09-12T05:22:16.795026+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:22:16.795026+0000","last_undegraded":"2024-09-12T05:22:16.795026+0000","last_fullsized":"2024-09-12T05:22:16.795026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"121'894","reported_seq":9875,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:17.069488+0000","last_change":"2024-09-12T05:22:16.762848+0000","last_active":"2024-09-12T05:22:17.069488+0000","last_peered":"2024-09-12T05:22:17.069488+0000","last_clean":"2024-09-12T05:22:17.069488+0000","last_became_active":"2024-09-12T05:21:42.927073+0000","last_became_peered":"2024-09-12T05:21:42.927073+0000","last_unstale":"2024-09-12T05:22:17.069488+0000","last_undegraded":"2024-09-12T05:22:17.069488+0000","last_fullsized":"2024-09-12T05:22:17.069488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:52:25.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013630890000000001,"stat_sum":{"num_bytes":79836143,"num_objects":80,"num_object_clones":16,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":41,"num_read":11618,"num_read_kb":54366,"num_write":1267,"num_write_kb":21741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":13855336,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"2.1","version":"0'0","reported_seq":76,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.761419+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:22:16.761419+0000","last_peered":"2024-09-12T05:22:16.761419+0000","last_clean":"2024-09-12T05:22:16.761419+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:22:16.761419+0000","last_undegraded":"2024-09-12T05:22:16.761419+0000","last_fullsized":"2024-09-12T05:22:16.761419+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'563","reported_seq":2180,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.968005+0000","last_change":"2024-09-12T05:22:16.779253+0000","last_active":"2024-09-12T05:22:16.968005+0000","last_peered":"2024-09-12T05:22:16.968005+0000","last_clean":"2024-09-12T05:22:16.968005+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:22:16.968005+0000","last_undegraded":"2024-09-12T05:22:16.968005+0000","last_fullsized":"2024-09-12T05:22:16.968005+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:50.461754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080850099999999999,"stat_sum":{"num_bytes":37809168,"num_objects":66,"num_object_clones":10,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":40,"num_read":2607,"num_read_kb":16056,"num_write":705,"num_write_kb":5680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.769398+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:22:16.769398+0000","last_peered":"2024-09-12T05:22:16.769398+0000","last_clean":"2024-09-12T05:22:16.769398+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:22:16.769398+0000","last_undegraded":"2024-09-12T05:22:16.769398+0000","last_fullsized":"2024-09-12T05:22:16.769398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"111'446","reported_seq":3317,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:17.053769+0000","last_change":"2024-09-12T05:22:16.896592+0000","last_active":"2024-09-12T05:22:17.053769+0000","last_peered":"2024-09-12T05:22:17.053769+0000","last_clean":"2024-09-12T05:22:17.053769+0000","last_became_active":"2024-09-12T05:20:09.747825+0000","last_became_peered":"2024-09-12T05:20:09.747825+0000","last_unstale":"2024-09-12T05:22:17.053769+0000","last_undegraded":"2024-09-12T05:22:17.053769+0000","last_fullsized":"2024-09-12T05:22:17.053769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:14.709339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020154769999999999,"stat_sum":{"num_bytes":109844619,"num_objects":84,"num_object_clones":17,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":42,"num_read":3351,"num_read_kb":46282,"num_write":535,"num_write_kb":32826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"2.3","version":"20'1","reported_seq":240,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.794785+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:22:16.794785+0000","last_peered":"2024-09-12T05:22:16.794785+0000","last_clean":"2024-09-12T05:22:16.794785+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:22:16.794785+0000","last_undegraded":"2024-09-12T05:22:16.794785+0000","last_fullsized":"2024-09-12T05:22:16.794785+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":308,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.769128+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:22:16.769128+0000","last_peered":"2024-09-12T05:22:16.769128+0000","last_clean":"2024-09-12T05:22:16.769128+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:22:16.769128+0000","last_undegraded":"2024-09-12T05:22:16.769128+0000","last_fullsized":"2024-09-12T05:22:16.769128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"121'574","reported_seq":4510,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.951875+0000","last_change":"2024-09-12T05:22:16.895568+0000","last_active":"2024-09-12T05:22:16.951875+0000","last_peered":"2024-09-12T05:22:16.951875+0000","last_clean":"2024-09-12T05:22:16.951875+0000","last_became_active":"2024-09-12T05:20:09.735109+0000","last_became_peered":"2024-09-12T05:20:09.735109+0000","last_unstale":"2024-09-12T05:22:16.951875+0000","last_undegraded":"2024-09-12T05:22:16.951875+0000","last_fullsized":"2024-09-12T05:22:16.951875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:51.772991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834309999999999,"stat_sum":{"num_bytes":42536029,"num_objects":77,"num_object_clones":14,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":39,"num_read":6479,"num_read_kb":34961,"num_write":587,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.9","version":"121'494","reported_seq":2225,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.954441+0000","last_change":"2024-09-12T05:22:16.779153+0000","last_active":"2024-09-12T05:22:16.954441+0000","last_peered":"2024-09-12T05:22:16.954441+0000","last_clean":"2024-09-12T05:22:16.954441+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:22:16.954441+0000","last_undegraded":"2024-09-12T05:22:16.954441+0000","last_fullsized":"2024-09-12T05:22:16.954441+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:28:23.587326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079629699999999996,"stat_sum":{"num_bytes":22376692,"num_objects":77,"num_object_clones":12,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":47,"num_read":2721,"num_read_kb":4229,"num_write":563,"num_write_kb":2177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.a","version":"121'754","reported_seq":2815,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.908596+0000","last_change":"2024-09-12T05:22:16.908596+0000","last_active":"2024-09-12T05:22:16.908596+0000","last_peered":"2024-09-12T05:22:16.908596+0000","last_clean":"2024-09-12T05:22:16.908596+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:22:16.908596+0000","last_undegraded":"2024-09-12T05:22:16.908596+0000","last_fullsized":"2024-09-12T05:22:16.908596+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.183030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090423900000000004,"stat_sum":{"num_bytes":65417378,"num_objects":76,"num_object_clones":17,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":37,"num_read":4524,"num_read_kb":20940,"num_write":953,"num_write_kb":9427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.b","version":"121'411","reported_seq":4567,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.895155+0000","last_change":"2024-09-12T05:22:16.895155+0000","last_active":"2024-09-12T05:22:16.895155+0000","last_peered":"2024-09-12T05:22:16.895155+0000","last_clean":"2024-09-12T05:22:16.895155+0000","last_became_active":"2024-09-12T05:20:09.741117+0000","last_became_peered":"2024-09-12T05:20:09.741117+0000","last_unstale":"2024-09-12T05:22:16.895155+0000","last_undegraded":"2024-09-12T05:22:16.895155+0000","last_fullsized":"2024-09-12T05:22:16.895155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:15.337916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067802900000000002,"stat_sum":{"num_bytes":52161099,"num_objects":78,"num_object_clones":16,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":40,"num_read":4748,"num_read_kb":16131,"num_write":379,"num_write_kb":9182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.c","version":"116'1740","reported_seq":4178,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.795744+0000","last_change":"2024-09-12T05:22:16.796704+0000","last_active":"2024-09-12T05:22:16.795744+0000","last_peered":"2024-09-12T05:22:16.795744+0000","last_clean":"2024-09-12T05:22:16.795744+0000","last_became_active":"2024-09-12T05:20:09.734742+0000","last_became_peered":"2024-09-12T05:20:09.734742+0000","last_unstale":"2024-09-12T05:22:16.795744+0000","last_undegraded":"2024-09-12T05:22:16.795744+0000","last_fullsized":"2024-09-12T05:22:16.795744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1740,"log_dups_size":0,"ondisk_log_size":1740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:37.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013295959999999999,"stat_sum":{"num_bytes":7882863,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":36,"num_read":10179,"num_read_kb":16120,"num_write":2976,"num_write_kb":7446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.d","version":"121'646","reported_seq":5580,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.966692+0000","last_change":"2024-09-12T05:22:16.773808+0000","last_active":"2024-09-12T05:22:16.966692+0000","last_peered":"2024-09-12T05:22:16.966692+0000","last_clean":"2024-09-12T05:22:16.966692+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:22:16.966692+0000","last_undegraded":"2024-09-12T05:22:16.966692+0000","last_fullsized":"2024-09-12T05:22:16.966692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:26.353718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040447840000000001,"stat_sum":{"num_bytes":37286982,"num_objects":79,"num_object_clones":17,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":42,"num_read":6575,"num_read_kb":29113,"num_write":813,"num_write_kb":11102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.e","version":"121'433","reported_seq":1668,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.774445+0000","last_change":"2024-09-12T05:22:16.774445+0000","last_active":"2024-09-12T05:22:16.774445+0000","last_peered":"2024-09-12T05:22:16.774445+0000","last_clean":"2024-09-12T05:22:16.774445+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:22:16.774445+0000","last_undegraded":"2024-09-12T05:22:16.774445+0000","last_fullsized":"2024-09-12T05:22:16.774445+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:42.576115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043365849999999996,"stat_sum":{"num_bytes":42828438,"num_objects":66,"num_object_clones":10,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":36,"num_read":2027,"num_read_kb":6373,"num_write":488,"num_write_kb":4767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.f","version":"121'304","reported_seq":3173,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.774467+0000","last_change":"2024-09-12T05:22:16.774467+0000","last_active":"2024-09-12T05:22:16.774467+0000","last_peered":"2024-09-12T05:22:16.774467+0000","last_clean":"2024-09-12T05:22:16.774467+0000","last_became_active":"2024-09-12T05:21:50.016404+0000","last_became_peered":"2024-09-12T05:21:50.016404+0000","last_unstale":"2024-09-12T05:22:16.774467+0000","last_undegraded":"2024-09-12T05:22:16.774467+0000","last_fullsized":"2024-09-12T05:22:16.774467+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:01.819437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004043151,"stat_sum":{"num_bytes":43715883,"num_objects":68,"num_object_clones":13,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":28,"num_read":2843,"num_read_kb":10445,"num_write":284,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1777262,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.10","version":"121'432","reported_seq":2935,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.908961+0000","last_change":"2024-09-12T05:22:16.908961+0000","last_active":"2024-09-12T05:22:16.908961+0000","last_peered":"2024-09-12T05:22:16.908961+0000","last_clean":"2024-09-12T05:22:16.908961+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:22:16.908961+0000","last_undegraded":"2024-09-12T05:22:16.908961+0000","last_fullsized":"2024-09-12T05:22:16.908961+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:27.218323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001204164,"stat_sum":{"num_bytes":79454271,"num_objects":69,"num_object_clones":12,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":34,"num_read":3160,"num_read_kb":18083,"num_write":496,"num_write_kb":5042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.11","version":"113'385","reported_seq":2549,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.772824+0000","last_change":"2024-09-12T05:22:16.773387+0000","last_active":"2024-09-12T05:22:16.772824+0000","last_peered":"2024-09-12T05:22:16.772824+0000","last_clean":"2024-09-12T05:22:16.772824+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:22:16.772824+0000","last_undegraded":"2024-09-12T05:22:16.772824+0000","last_fullsized":"2024-09-12T05:22:16.772824+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:14:16.502784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037793000000000002,"stat_sum":{"num_bytes":73849749,"num_objects":75,"num_object_clones":11,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":38,"num_read":2733,"num_read_kb":38885,"num_write":411,"num_write_kb":21145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.12","version":"121'336","reported_seq":1694,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.770813+0000","last_change":"2024-09-12T05:22:16.770813+0000","last_active":"2024-09-12T05:22:16.770813+0000","last_peered":"2024-09-12T05:22:16.770813+0000","last_clean":"2024-09-12T05:22:16.770813+0000","last_became_active":"2024-09-12T05:20:57.095147+0000","last_became_peered":"2024-09-12T05:20:57.095147+0000","last_unstale":"2024-09-12T05:22:16.770813+0000","last_undegraded":"2024-09-12T05:22:16.770813+0000","last_fullsized":"2024-09-12T05:22:16.770813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:50.642988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001391902,"stat_sum":{"num_bytes":60965382,"num_objects":63,"num_object_clones":12,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":35,"num_read":1787,"num_read_kb":36608,"num_write":373,"num_write_kb":29172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"3"}]},{"pgid":"3.13","version":"121'478","reported_seq":3517,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-12T05:22:16.770614+0000","last_change":"2024-09-12T05:22:16.770614+0000","last_active":"2024-09-12T05:22:16.770614+0000","last_peered":"2024-09-12T05:22:16.770614+0000","last_clean":"2024-09-12T05:22:16.770614+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:22:16.770614+0000","last_undegraded":"2024-09-12T05:22:16.770614+0000","last_fullsized":"2024-09-12T05:22:16.770614+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:05.895832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00122456,"stat_sum":{"num_bytes":34065962,"num_objects":78,"num_object_clones":18,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":41,"num_read":4010,"num_read_kb":18935,"num_write":465,"num_write_kb":6937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2c","length":"3"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1653208455,"num_objects":2358,"num_object_clones":422,"num_object_copies":4716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2358,"num_whiteouts":1245,"num_read":150502,"num_read_kb":922232,"num_write":21634,"num_write_kb":469970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1337,"num_bytes_recovered":99063928,"num_keys_recovered":317,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688922624,"data_stored":883690784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},"log_size":17889,"ondisk_log_size":17889,"up":64,"acting":63,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167416,"kb_used_data":118168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94204424,"statfs":{"total":96636764160,"available":96465330176,"internally_reserved":0,"allocated":121004032,"data_stored":159114281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":23492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":24055808,"data_stored":27120578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":159204,"kb_used_data":87744,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94212636,"statfs":{"total":96636764160,"available":96473739264,"internally_reserved":0,"allocated":89849856,"data_stored":97790799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271746,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146428,"kb_used_data":113580,"kb_used_omap":27,"kb_used_meta":32804,"kb_avail":94225412,"statfs":{"total":96636764160,"available":96486821888,"internally_reserved":0,"allocated":116305920,"data_stored":156370591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":33592119},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542175,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170832,"kb_used_data":121536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94201008,"statfs":{"total":96636764160,"available":96461832192,"internally_reserved":0,"allocated":124452864,"data_stored":157673524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542176,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63052,"kb_used_data":23540,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94308788,"statfs":{"total":96636764160,"available":96572198912,"internally_reserved":0,"allocated":24104960,"data_stored":24099829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119228,"kb_used_data":92192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94252612,"statfs":{"total":96636764160,"available":96514674688,"internally_reserved":0,"allocated":94404608,"data_stored":111615537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542176,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138608,"kb_used_data":107416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94233232,"statfs":{"total":96636764160,"available":96494829568,"internally_reserved":0,"allocated":109993984,"data_stored":158817459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106987520,"data_stored":156619144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92487680,"data_stored":110487441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22491136,"data_stored":23255107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":122994688,"data_stored":156978696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":115081216,"data_stored":156003977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":87957504,"data_stored":96684651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22614016,"data_stored":26438677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118308864,"data_stored":157223091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:22:19.311 INFO:tasks.thrashosds.thrasher:Setting 3.b to [0, 7, 3, 6] 2024-09-12T05:22:19.311 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.b', '0', '7', '3', '6'] 2024-09-12T05:22:19.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.b 0 7 3 6 2024-09-12T05:22:19.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:19.335+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:19.414 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:19.414+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:19.458 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:19.458 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:19.458 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:19.458 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:19.458 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:19.472 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:19.515 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:19.514+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:19.597 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.357022975, 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:22:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:22:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.356009253000003, 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:22:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:22:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.355315392000001, 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:22:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.352330549000001, 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:22:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:22:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:22:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.352089223999997, 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.351341013999999, 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:22:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.351029253, 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:22:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:22:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.350306291999999, 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:22:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.349007372999999, 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:22:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.346455618999997, 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:22:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:22:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.345677129000002, 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:22:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:22:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.345404788000003, 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:22:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:22:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.344128501999997, 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:22:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:22:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.342725885999997, 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:22:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:22:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.342010385000002, 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:22:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:22:19.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:22:19.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.340688989, 2024-09-12T05:22:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:19.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:22:19.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:22:19.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.339612344000003, 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:22:19.690 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:22:19.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.339389599999997, 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.696 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:22:19.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:22:19.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.338768561000002, 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.702 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:22:19.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:22:19.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:22:19.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.337120427999999, 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:19.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:19.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:22:19.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:22:19.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:22:19.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:22:19.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:19.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:22:19.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:22:19.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:19.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:19.716 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:19.718 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:19.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:19.719+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:19.797 INFO:teuthology.orchestra.run.smithi059.stderr:set 3.b pg_upmap_items mapping to [0->7,3->6] 2024-09-12T05:22:19.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:19.815+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:19.900 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:19.900 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:19.900 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:19.900 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:19.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:19.957 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:19.955+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:20.020 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:20.018+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:20.083 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:20.085 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:20.097 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:20.122 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:20.122+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:20.222 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:20.219+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:20.225 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.225 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:27, version: 93'412, data_included: [0~33694,1460698~7155], data_size: 40849, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:27@93'412, size: 1467853, copy_subset: [(0, 1467853)], clone_subset: {}, snapset: 27=[]:{27: [27]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1467853, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.9997248120000002, 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004462021, 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6300000000000001e-07 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224874+0000", 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2475999999999997e-05 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224892+0000", 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8433000000000001e-05 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224904+0000", 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1922e-05 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.226480+0000", 2024-09-12T05:22:20.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015764850000000001 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.226508+0000", 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7671e-05 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229283+0000", 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027747710000000001 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(osd.4.0:0 3.1a e118/117 ondisk, result = 0)", 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.225936+0000", 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.9986095209999997, 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027466809999999999, 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225936+0000", 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225936+0000", 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225937+0000", 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8999999999999996e-07 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225941+0000", 2024-09-12T05:22:20.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3309999999999997e-06 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225952+0000", 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0752e-05 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.225958+0000", 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9320000000000001e-06 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228618+0000", 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002660047 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228661+0000", 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3380000000000001e-05 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.228683+0000", 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1549e-05 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:head, version: 93'413, data_included: [0~33694], data_size: 33694, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:head@93'413, size: 524288, copy_subset: [(0, 524288)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 524288, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.9972348239999995, 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040878429999999999, 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227312+0000", 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1480000000000001e-06 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227341+0000", 2024-09-12T05:22:20.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8728e-05 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227365+0000", 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4717000000000001e-05 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227385+0000", 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9334000000000002e-05 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229393+0000", 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020081610000000001 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229417+0000", 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.231399+0000", 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019813209999999999 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.237 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head, version: 97'429, data_included: [1179648~229376,1441792~196608,1671168~163840,1867776~98304,2031616~65536,2162688~163840,2392064~98304,2555904~32768], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head@97'429, size: 6848512, copy_subset: [(0, 6848512)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2588672, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1179648, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.242908+0000", 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.9816372739999997, 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026653739999999999, 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.242908+0000", 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.242908+0000", 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.242909+0000", 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1999999999999998e-07 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243472+0000", 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00056313299999999995 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243498+0000", 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5233999999999999e-05 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243518+0000", 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0492999999999998e-05 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243664+0000", 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014582399999999999 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.243684+0000", 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0519000000000001e-05 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.245574+0000", 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001889251 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head, version: 97'429, data_included: [2588672~98304,2719744~32768,2850816~98304,2981888~32768,3080192~131072,3244032~65536,3538944~65536,3670016~65536,3768320~131072,4227072~31397,4259840~32768,4358144~65536], data_size: 850597, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head@97'429, size: 6848512, copy_subset: [(0, 6848512)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 6848512, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2588672, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.977361449, 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035447669999999999, 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:20.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247185+0000", 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0299999999999998e-07 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247574+0000", 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00038906500000000002 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247611+0000", 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6915999999999997e-05 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247649+0000", 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8053000000000003e-05 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247827+0000", 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017846499999999999 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247853+0000", 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5979999999999999e-05 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250729+0000", 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028755849999999999 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGRecoveryDelete(3.13 e118,115 3:c9b4d374:::rbd_data.111885717646.0000000000000011:head,101'441)", 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.248055+0000", 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.9764900890000003, 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027715280000000001, 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248055+0000", 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248055+0000", 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248056+0000", 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248061+0000", 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1019999999999996e-06 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248073+0000", 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1786e-05 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.248081+0000", 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.61e-06 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250756+0000", 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026750630000000001 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250763+0000", 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6000000000000001e-06 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250827+0000", 2024-09-12T05:22:20.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3643e-05 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.7.0:3085 3.e e119/118 3:76720be3:::rbd_data.1118ee77a7a.0000000000000000:2e v 119'432, mlcod=0'0)", 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.761326+0000", 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.463219509, 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027874169999999999, 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761326+0000", 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761326+0000", 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761327+0000", 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761334+0000", 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2320000000000004e-06 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761347+0000", 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2931999999999999e-05 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761358+0000", 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246999999999999e-05 2024-09-12T05:22:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761425+0000", 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6662000000000007e-05 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.761454+0000", 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8810999999999999e-05 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.764056+0000", 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026027590000000001 2024-09-12T05:22:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.764113+0000", 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7090999999999999e-05 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115942 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.838371+0000", 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.3861748580000004, 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032704019999999999, 2024-09-12T05:22:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115942 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838371+0000", 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838371+0000", 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838373+0000", 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4499999999999998e-06 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838385+0000", 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2097e-05 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838411+0000", 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5950000000000001e-05 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838433+0000", 2024-09-12T05:22:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838564+0000", 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013139900000000001 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.838790+0000", 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022540799999999999 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.839079+0000", 2024-09-12T05:22:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028977799999999998 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.840329+0000", 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012492130000000001 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.841345+0000", 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010160620000000001 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.841512+0000", 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016749899999999999 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.841641+0000", 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000129033 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115945 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.854233+0000", 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.370313007, 2024-09-12T05:22:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028734810000000002, 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115945 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854233+0000", 2024-09-12T05:22:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854233+0000", 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854235+0000", 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2469999999999998e-06 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854248+0000", 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3662999999999999e-05 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854274+0000", 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5225999999999999e-05 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854288+0000", 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4727e-05 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854386+0000", 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7608000000000005e-05 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854524+0000", 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013764300000000001 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.854812+0000", 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028875400000000001 2024-09-12T05:22:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.855861+0000", 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010484909999999999 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.856960+0000", 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010987320000000001 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.857040+0000", 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0711999999999996e-05 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.857106+0000", 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5678000000000004e-05 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115948 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.859193+0000", 2024-09-12T05:22:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.3653524360000002, 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029826280000000002, 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115948 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859193+0000", 2024-09-12T05:22:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859193+0000", 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859195+0000", 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859221+0000", 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6186e-05 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859241+0000", 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129999999999999e-05 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859252+0000", 2024-09-12T05:22:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1165999999999999e-05 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859325+0000", 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2422000000000006e-05 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859440+0000", 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115603 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.859704+0000", 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026347499999999999 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.860703+0000", 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099876499999999998 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.862039+0000", 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001336666 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.862116+0000", 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6254999999999994e-05 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.862176+0000", 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0250000000000001e-05 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115986 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_remove in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120)", 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:15.813328+0000", 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4112170810000002, 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029555689999999999, 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115986 2024-09-12T05:22:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.813328+0000", 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.813328+0000", 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.813332+0000", 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0630000000000002e-06 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.813346+0000", 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4453e-05 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.813378+0000", 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1702999999999998e-05 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.813393+0000", 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5147000000000001e-05 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.813550+0000", 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015669499999999999 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.813814+0000", 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000263968 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.814319+0000", 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00050571999999999998 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.816060+0000", 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017412020000000001 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.816113+0000", 2024-09-12T05:22:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2679999999999997e-05 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.816206+0000", 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3356000000000005e-05 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:15.816284+0000", 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7582000000000004e-05 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116419 3.1c e123/118 3:3c51c160:::rbd_header.11185331af3a:head v 123'596, mlcod=122'594)", 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4260714130000001, 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045675220000000001, 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2399999999999999e-07 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798480+0000", 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950000000000002e-06 2024-09-12T05:22:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798495+0000", 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5087e-05 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798503+0000", 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5730000000000008e-06 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798589+0000", 2024-09-12T05:22:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6067000000000001e-05 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798611+0000", 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1477000000000001e-05 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.802981+0000", 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043699740000000004 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.803042+0000", 2024-09-12T05:22:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.5.0:3830 3.1c e123/118 3:3f1622fa:::rbd_data.11185331af3a.000000000000000a:2a v 123'598, mlcod=122'594)", 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.800632+0000", 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.423913489, 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028957499999999999, 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.800632+0000", 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.800632+0000", 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.800633+0000", 2024-09-12T05:22:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6099999999999999e-07 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.800641+0000", 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9929999999999995e-06 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.800655+0000", 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3886999999999999e-05 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.800664+0000", 2024-09-12T05:22:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8480000000000007e-06 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.800715+0000", 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1362000000000001e-05 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.800736+0000", 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0443000000000001e-05 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.803478+0000", 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027422269999999999 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.803528+0000", 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0028999999999998e-05 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116482 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.880666+0000", 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3438791139999999, 2024-09-12T05:22:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024966200000000002, 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116482 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.880666+0000", 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.880666+0000", 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.880668+0000", 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.934e-06 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.880678+0000", 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6290000000000005e-06 2024-09-12T05:22:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.880703+0000", 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5188e-05 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.880716+0000", 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3043e-05 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.880855+0000", 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013836499999999999 2024-09-12T05:22:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.881054+0000", 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000199478 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.881377+0000", 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032269500000000001 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.882493+0000", 2024-09-12T05:22:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001116307 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.882963+0000", 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000470297 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.883051+0000", 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7559000000000007e-05 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.883163+0000", 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112125 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116509 3.a e123/117 3:5332fa78:::rbd_data.11185331af3a.0000000000000000:head v 123'760, mlcod=122'757)", 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3076486359999999, 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041644409999999996, 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916899+0000", 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2709999999999999e-06 2024-09-12T05:22:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916913+0000", 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4253999999999999e-05 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916951+0000", 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7891e-05 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916971+0000", 2024-09-12T05:22:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0089e-05 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917154+0000", 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018263 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917196+0000", 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1449999999999998e-05 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.920960+0000", 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003764734 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921061+0000", 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101122 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116513 3.1d e123/117 3:bd0ab837:::rbd_data.11185331af3a.0000000000000004:head v 123'660, mlcod=122'657)", 2024-09-12T05:22:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.3072715420000001, 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0042777120000000004, 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917276+0000", 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7230000000000001e-06 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917287+0000", 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1134e-05 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917311+0000", 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4579999999999998e-05 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917328+0000", 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6628000000000001e-05 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917481+0000", 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015263000000000001 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917527+0000", 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6606000000000001e-05 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921472+0000", 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039444170000000004 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921552+0000", 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9993999999999993e-05 2024-09-12T05:22:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116641 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.31908678699999998, 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039536850000000002, 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116641 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905462+0000", 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0130000000000002e-06 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905478+0000", 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5923999999999999e-05 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905508+0000", 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0145999999999999e-05 2024-09-12T05:22:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905523+0000", 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5605999999999999e-05 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905676+0000", 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015209199999999999 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905929+0000", 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025293199999999998 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.906519+0000", 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059068200000000003 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.908228+0000", 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017091960000000001 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909248+0000", 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010198690000000001 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909339+0000", 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1192000000000004e-05 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909412+0000", 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3033000000000004e-05 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116644 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:19.915762+0000", 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.30878313899999998, 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033018460000000002, 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116644 2024-09-12T05:22:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915762+0000", 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915762+0000", 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915765+0000", 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3769999999999999e-06 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915776+0000", 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1113e-05 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915804+0000", 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8016000000000001e-05 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915818+0000", 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915958+0000", 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139259 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.916212+0000", 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000254572 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.916749+0000", 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053700899999999997 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.918122+0000", 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001372456 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.919001+0000", 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00087951800000000003 2024-09-12T05:22:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.919035+0000", 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4133e-05 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.919064+0000", 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9067000000000001e-05 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116647 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:19.920054+0000", 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.30449135199999999, 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0030477799999999999, 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116647 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920054+0000", 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920054+0000", 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920055+0000", 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3e-07 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920058+0000", 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3869999999999999e-06 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920067+0000", 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1239999999999994e-06 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920072+0000", 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920185+0000", 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011278800000000001 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920423+0000", 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000238268 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.920941+0000", 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000517359 2024-09-12T05:22:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.922408+0000", 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001467508 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.923044+0000", 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00063559 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.923075+0000", 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1312000000000001e-05 2024-09-12T05:22:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.923102+0000", 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6931999999999999e-05 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116679 3.11 e124/117 3:8e704b98:::rbd_data.1118aababa9c.000000000000003a:head v 124'387, mlcod=0'0)", 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:19.956020+0000", 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.26852535700000002, 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028449119999999998, 2024-09-12T05:22:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.956020+0000", 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.956020+0000", 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.956021+0000", 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8599999999999997e-07 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.956027+0000", 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5119999999999999e-06 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.956036+0000", 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.956044+0000", 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2830000000000001e-06 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.956190+0000", 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145883 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.956208+0000", 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7655999999999998e-05 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.958787+0000", 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025789889999999998 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.958865+0000", 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8109999999999996e-05 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:20.325 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:20.323+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:20.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:20.426 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:20.426+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:20.462 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:20.462 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:20.462 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:20.462 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:20.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:20.527 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:20.527+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:20.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:20.623+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:20.647 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:20.647 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:20.647 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:20.647 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:20.647 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:20.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:20.729 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:20.730+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:20.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 80.672722462999999, 2024-09-12T05:22:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:22:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:22:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.342121392999999, 2024-09-12T05:22:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:22:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.215560955000001, 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:22:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.21503543, 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.215012881999996, 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.214991092000005, 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.214969726999996, 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:22:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:22:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.214947182000003, 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:22:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:22:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:22:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:22:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:22:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:22:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.214924947, 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:22:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.214903363000005, 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:22:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:22:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.214701964, 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:22:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.214676564000001, 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:22:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:22:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.207403287000005, 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:22:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:22:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.207380896999993, 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.207358248999995, 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:22:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:22:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.207337760000001, 2024-09-12T05:22:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:22:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.207311695000001, 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.872 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.207288477999995, 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:22:20.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.207266114000006, 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:20.877 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.878 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.878 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.878 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:22:20.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.878 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:22:20.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 66.730725738000004, 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:20.882 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:22:20.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:20.887 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:20.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:22:20.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:20.890 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:20.887+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:20.954 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:20.954 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:20.973 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:20.990 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:20.987+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:20.990 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:20.990 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:21.009 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:21.009 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:21.031 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:21.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:21.051 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:21.068 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:21.068 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:21.073 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:21.074 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:21.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:21.091 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:21.087+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:21.095 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:21.192 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:21.190+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:21.211 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:21.211 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:21.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:21.313 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:21.314+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:21.389 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:21.389 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:21.394 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:21.394+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:21.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:21.495 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:21.491+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:21.579 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:21.579 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:21.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:21.596 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:21.594+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:21.697 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:21.698+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:21.721 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:21.721 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:21.736 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:21.798 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:21.799+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:22:21.898 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:21.898+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:21.908 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:21.908 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:21.923 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:22:22.009 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:22.010+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:22.092 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:22.092 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:22.100 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:22.098+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:22.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T05:22:22.201 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:22.199+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:22.289 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:22.289 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:22.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:22.299+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:22.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T05:22:22.404 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:22.399+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:22.441 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:22.441 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:22.457 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:22.508 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:22.507+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:22.601 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:22.601 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:22.606 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:22.606+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:22.619 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:22.707 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:22.706+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:22.789 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:22.790 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:22.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:22.852 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:22.851+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:22.909 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:22.910+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:22.935 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:22.936 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:22.950 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:23.010 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:23.010+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:23.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:23.107+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:23.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:23.116 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:23.116 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:23.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:23.213 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:23.214+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:23.274 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:23.275 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:23.292 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:23.292 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:23.297 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:23.297 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:23.312 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:23.313 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:23.314+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:23.414 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:22:23.414+0000 7f9301af7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26385) UID: 0 2024-09-12T05:22:23.436 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:23.436 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:23.450 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:23.515 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:23.514+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:23.521 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:23.551 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-09-12T05:22:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T05:22:23.568 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:23.568 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:23.581 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:23.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:23.613 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:23.628 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:23.627+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:23.643 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:23.671 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:23.671 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:23.701 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:23.702 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:23.702 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:23.702 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:23.702 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:23.716 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:23.745 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:23.746+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:23.817 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:23.818+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:23.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:22:23.900 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:23.900 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:23.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:23.900 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:23.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.900 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.900 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:23.900 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.658935341999999, 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:22:23.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:22:23.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:22:23.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.657921620000003, 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.906 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:22:23.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:22:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.657227759000001, 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:22:23.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:22:23.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.654242916000001, 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.918 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:22:23.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.654001590999997, 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.924 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.929 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.653253380999999, 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:22:23.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:22:23.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.65294162, 2024-09-12T05:22:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:23.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:22:23.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.652218658999999, 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:22:23.941 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:22:23.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:22:23.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.650919739999999, 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.947 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:22:23.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.648367985999997, 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:22:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.958 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.647589496000002, 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:22:23.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:22:23.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:22:23.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.647317155000003, 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.964 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:22:23.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:22:23.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:22:23.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.646040868999997, 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:22:23.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:22:23.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:22:23.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.644638252999997, 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.976 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:22:23.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:22:23.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:23.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.643922752000002, 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.983 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:22:23.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.642601356, 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.989 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:23.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:23.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.641524711000002, 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:23.995 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:23.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:24.000 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.641301966999997, 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:22:24.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:22:24.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:22:24.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:24.006 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.640680928000002, 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:24.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:22:24.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.639032794999999, 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:22:24.012 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:22:24.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.019 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:24.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:24.021 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:24.015+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:24.121 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:24.122+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:24.191 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:24.192 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:24.206 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:24.222 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:24.222+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:24.323 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:24.323 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:24.323 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:24.323 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:24.323 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:24.323 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:24.319+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:24.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:24.423 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:24.422+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:24.507 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.534 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:27, version: 93'412, data_included: [0~33694,1460698~7155], data_size: 40849, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:27@93'412, size: 1467853, copy_subset: [(0, 1467853)], clone_subset: {}, snapset: 27=[]:{27: [27]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1467853, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.281746729, 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004462021, 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6300000000000001e-07 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224874+0000", 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2475999999999997e-05 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224892+0000", 2024-09-12T05:22:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8433000000000001e-05 2024-09-12T05:22:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224904+0000", 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1922e-05 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.226480+0000", 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015764850000000001 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.226508+0000", 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7671e-05 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229283+0000", 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027747710000000001 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:head, version: 93'413, data_included: [0~33694], data_size: 33694, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:head@93'413, size: 524288, copy_subset: [(0, 524288)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 524288, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.279256740999999, 2024-09-12T05:22:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040878429999999999, 2024-09-12T05:22:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:24.541 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227312+0000", 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1480000000000001e-06 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227341+0000", 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8728e-05 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227365+0000", 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4717000000000001e-05 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227385+0000", 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9334000000000002e-05 2024-09-12T05:22:24.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229393+0000", 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020081610000000001 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229417+0000", 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.231399+0000", 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019813209999999999 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head, version: 97'429, data_included: [2588672~98304,2719744~32768,2850816~98304,2981888~32768,3080192~131072,3244032~65536,3538944~65536,3670016~65536,3768320~131072,4227072~31397,4259840~32768,4358144~65536], data_size: 850597, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head@97'429, size: 6848512, copy_subset: [(0, 6848512)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 6848512, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2588672, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:24.546 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.259383366, 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035447669999999999, 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247184+0000", 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247185+0000", 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0299999999999998e-07 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247574+0000", 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00038906500000000002 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247611+0000", 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6915999999999997e-05 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247649+0000", 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8053000000000003e-05 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247827+0000", 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017846499999999999 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.247853+0000", 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5979999999999999e-05 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.250729+0000", 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028755849999999999 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.550 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116419 3.1c e123/118 3:3c51c160:::rbd_header.11185331af3a:head v 123'596, mlcod=122'594)", 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7080933299999996, 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045675220000000001, 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2399999999999999e-07 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798480+0000", 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950000000000002e-06 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798495+0000", 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5087e-05 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798503+0000", 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5730000000000008e-06 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798589+0000", 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6067000000000001e-05 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798611+0000", 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1477000000000001e-05 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.802981+0000", 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043699740000000004 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.803042+0000", 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116509 3.a e123/117 3:5332fa78:::rbd_data.11185331af3a.0000000000000000:head v 123'760, mlcod=122'757)", 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5896705530000004, 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041644409999999996, 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916899+0000", 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2709999999999999e-06 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916913+0000", 2024-09-12T05:22:24.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4253999999999999e-05 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916951+0000", 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7891e-05 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916971+0000", 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0089e-05 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917154+0000", 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018263 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917196+0000", 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1449999999999998e-05 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.920960+0000", 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003764734 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921061+0000", 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101122 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.559 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116513 3.1d e123/117 3:bd0ab837:::rbd_data.11185331af3a.0000000000000004:head v 123'660, mlcod=122'657)", 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5892934590000003, 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0042777120000000004, 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917276+0000", 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7230000000000001e-06 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917287+0000", 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1134e-05 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917311+0000", 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4579999999999998e-05 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917328+0000", 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6628000000000001e-05 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917481+0000", 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015263000000000001 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917527+0000", 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6606000000000001e-05 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921472+0000", 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039444170000000004 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921552+0000", 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9993999999999993e-05 2024-09-12T05:22:24.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116641 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6011087039999996, 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039536850000000002, 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116641 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905462+0000", 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0130000000000002e-06 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905478+0000", 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5923999999999999e-05 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905508+0000", 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0145999999999999e-05 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905523+0000", 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5605999999999999e-05 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905676+0000", 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015209199999999999 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905929+0000", 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025293199999999998 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.906519+0000", 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059068200000000003 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.908228+0000", 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017091960000000001 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909248+0000", 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010198690000000001 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909339+0000", 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1192000000000004e-05 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909412+0000", 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3033000000000004e-05 2024-09-12T05:22:24.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116644 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:19.915762+0000", 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.5908050559999998, 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033018460000000002, 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116644 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915762+0000", 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915762+0000", 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915765+0000", 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3769999999999999e-06 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915776+0000", 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1113e-05 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915804+0000", 2024-09-12T05:22:24.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8016000000000001e-05 2024-09-12T05:22:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915818+0000", 2024-09-12T05:22:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:24.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.915958+0000", 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139259 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.916212+0000", 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000254572 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.916749+0000", 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053700899999999997 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.918122+0000", 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001372456 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.919001+0000", 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00087951800000000003 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.919035+0000", 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4133e-05 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.919064+0000", 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9067000000000001e-05 2024-09-12T05:22:24.576 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116749 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.833271+0000", 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.6732962310000001, 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005388131, 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.577 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116749 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833271+0000", 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833271+0000", 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833275+0000", 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3739999999999998e-06 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833287+0000", 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2599000000000001e-05 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833318+0000", 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1192999999999998e-05 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833336+0000", 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7929999999999999e-05 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833500+0000", 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000163976 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833532+0000", 2024-09-12T05:22:24.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.137e-05 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.838322+0000", 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047899049999999997 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.838496+0000", 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174045 2024-09-12T05:22:24.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.838659+0000", 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016373900000000001 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116840 3.1a 3:582e491b:::rbd_data.111846fb6c83.0000000000000009:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.5645239360000001, 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0078812729999999994, 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116840 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942046+0000", 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7700000000000002e-06 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942061+0000", 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4413000000000001e-05 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942100+0000", 2024-09-12T05:22:24.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8982e-05 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942125+0000", 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5384e-05 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942295+0000", 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017022200000000001 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942570+0000", 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027470100000000003 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942807+0000", 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023657800000000001 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946714+0000", 2024-09-12T05:22:24.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003907265 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949653+0000", 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029390470000000002 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949796+0000", 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000143456 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949925+0000", 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128455 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116836 3.13 e125/119 3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head v 125'479, mlcod=120'477)", 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.5631931570000002, 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012590459999999999, 2024-09-12T05:22:24.590 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:24.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943375+0000", 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.33e-07 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943385+0000", 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:22:24.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943421+0000", 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6340000000000001e-05 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943439+0000", 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7943000000000001e-05 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946692+0000", 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032526640000000002 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946753+0000", 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0736000000000003e-05 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955859+0000", 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091062309999999994 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955965+0000", 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010594600000000001 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116832 3.1c e125/118 3:3f748428:::rbd_data.111846fb6c83.0000000000000001:head v 125'618, mlcod=124'616)", 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.945598+0000", 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.5609695189999999, 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055007629999999997, 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945598+0000", 2024-09-12T05:22:24.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945598+0000", 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945600+0000", 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2869999999999999e-06 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945615+0000", 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5087e-05 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945658+0000", 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2830000000000002e-05 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945678+0000", 2024-09-12T05:22:24.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9792999999999998e-05 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946054+0000", 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037558399999999999 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946111+0000", 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7592e-05 2024-09-12T05:22:24.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.950978+0000", 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048663539999999998 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951099+0000", 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121236 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116834 3.a e125/117 3:523d80f0:::rbd_data.111846fb6c83.0000000000000003:head v 125'763, mlcod=123'761)", 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.5607989299999998, 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097679289999999998, 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0699999999999996e-07 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945778+0000", 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945800+0000", 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1886999999999999e-05 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945815+0000", 2024-09-12T05:22:24.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4555999999999999e-05 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946808+0000", 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0009934220000000001 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946859+0000", 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1075999999999997e-05 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955438+0000", 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0085788310000000003 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955536+0000", 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8517000000000006e-05 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.605 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116843 3.14 3:2957f86d:::rbd_data.111846fb6c83.000000000000000c:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.5549630260000002, 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006987966, 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116843 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:24.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951608+0000", 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0400000000000001e-06 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951620+0000", 2024-09-12T05:22:24.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2446000000000001e-05 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951655+0000", 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5142999999999999e-05 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951677+0000", 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2144e-05 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951842+0000", 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016452200000000001 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.952429+0000", 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058674499999999995 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.952714+0000", 2024-09-12T05:22:24.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028506799999999998 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955997+0000", 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032838770000000002 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958320+0000", 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023223060000000001 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958457+0000", 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013729000000000001 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958592+0000", 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013538499999999999 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116845 3.14 3:2a145e74:::rbd_data.111846fb6c83.000000000000000e:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.552770905, 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0059322539999999997, 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116845 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953799+0000", 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3970000000000001e-06 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953809+0000", 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0506000000000001e-05 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953848+0000", 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8705000000000003e-05 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953869+0000", 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0449e-05 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954142+0000", 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027315199999999998 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954438+0000", 2024-09-12T05:22:24.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000295791 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954726+0000", 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028802400000000001 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.957230+0000", 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025042739999999999 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959533+0000", 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002303158 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959665+0000", 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013202299999999999 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959729+0000", 2024-09-12T05:22:24.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3775000000000005e-05 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116853 3.1a 3:595731ba:::rbd_data.111846fb6c83.0000000000000017:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.958603+0000", 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.5479649420000001, 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053220309999999996, 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.620 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116853 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958603+0000", 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958603+0000", 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958605+0000", 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8270000000000002e-06 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958618+0000", 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2583e-05 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958651+0000", 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3167000000000003e-05 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958676+0000", 2024-09-12T05:22:24.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4973e-05 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958820+0000", 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000144239 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959108+0000", 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028747199999999999 2024-09-12T05:22:24.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959370+0000", 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026202300000000001 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.962589+0000", 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032191749999999999 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.963801+0000", 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001212227 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.963869+0000", 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8225000000000005e-05 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.963925+0000", 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5120000000000001e-05 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117176 3.1a 3:5dbbe14f:::rbd_data.1118e5d0fec8.0000000000000043:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.54364890600000004, 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0090363549999999994, 2024-09-12T05:22:24.627 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117176 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962920+0000", 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4339999999999999e-06 2024-09-12T05:22:24.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962925+0000", 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4149999999999998e-06 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962941+0000", 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5308e-05 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962952+0000", 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1715999999999999e-05 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963039+0000", 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6458000000000005e-05 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963208+0000", 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016904499999999999 2024-09-12T05:22:24.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963341+0000", 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013301400000000001 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.965163+0000", 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018218679999999999 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971869+0000", 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067059950000000002 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971913+0000", 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3707e-05 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971955+0000", 2024-09-12T05:22:24.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2395000000000003e-05 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117179 3.1a 3:5a61d20b:::rbd_data.1118e5d0fec8.0000000000000061:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.54037670800000004, 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0060640249999999998, 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.634 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117179 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966192+0000", 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966196+0000", 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8530000000000002e-06 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966208+0000", 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2616000000000001e-05 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966219+0000", 2024-09-12T05:22:24.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0175e-05 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966406+0000", 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187324 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966771+0000", 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036500399999999999 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.967053+0000", 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028252099999999999 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968181+0000", 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001128062 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972051+0000", 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038696350000000002 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972148+0000", 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7005999999999999e-05 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972255+0000", 2024-09-12T05:22:24.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106729 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117185 3.1a 3:5bcb3af8:::rbd_data.1118e5d0fec8.00000000000000da:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.968400+0000", 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.53816789200000004, 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039726609999999997, 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.641 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117185 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968400+0000", 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968400+0000", 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968402+0000", 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.446e-06 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968412+0000", 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8300000000000008e-06 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968436+0000", 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3957000000000001e-05 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968452+0000", 2024-09-12T05:22:24.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6206e-05 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968509+0000", 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6572e-05 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968593+0000", 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4719e-05 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968659+0000", 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5857000000000003e-05 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.969504+0000", 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00084461900000000001 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:24.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972295+0000", 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027914770000000001 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972346+0000", 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0217999999999999e-05 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972372+0000", 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6760000000000001e-05 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:117240 3.e e128/118 3:73ef882f:::rbd_object_map.11181f89f1e6:head v 128'436, mlcod=125'434)", 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:24.025766+0000", 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.48080122199999997, 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036033929999999999, 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:24.648 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.025766+0000", 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.025766+0000", 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.025768+0000", 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.753e-06 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.025778+0000", 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0414000000000001e-05 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.025803+0000", 2024-09-12T05:22:24.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4142999999999999e-05 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.025816+0000", 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2999999999999999e-05 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.025940+0000", 2024-09-12T05:22:24.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124797 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.025997+0000", 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6357000000000003e-05 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.029274+0000", 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032773500000000001 2024-09-12T05:22:24.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.029370+0000", 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5579000000000001e-05 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:24.653 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:24.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:24.656 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:24.654+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:24.756 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:22:24.757 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:24.751+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:24.800 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:24.800 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:24.800 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:24.800 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:24.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:24.826 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-12T05:22:24.826 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:22:24.826 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-12T05:22:24.827 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T05:22:24.827 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:22:24.862 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:24.862+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:24.957 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:24.958+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:24.985 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:24.985 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:24.985 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:24.986 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:24.986 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:25.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:25.057 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:25.055+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:25.158 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:25.158+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:25.172 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:25.172 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:25.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 85.053270179999998, 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.173 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:22:25.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:22:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.722669109999998, 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.179 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:22:25.182 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.596108672, 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:25.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:22:25.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595583146999999, 2024-09-12T05:22:25.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.191 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595560598999995, 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.192 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:22:25.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595538809000004, 2024-09-12T05:22:25.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:22:25.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595517443999995, 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.201 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:22:25.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595494899000002, 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:22:25.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595472663999999, 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.210 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:22:25.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595451080000004, 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.215 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:22:25.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595249680999999, 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.219 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:22:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.595224281, 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:22:25.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:22:25.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.587951004000004, 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.228 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:25.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:22:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:22:25.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.587928614000006, 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.234 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:22:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.238 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.587905965999994, 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:22:25.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:22:25.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.587885477, 2024-09-12T05:22:25.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.247 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.587859412, 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:22:25.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.587836194999994, 2024-09-12T05:22:25.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:22:25.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.256 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.587813831000005, 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.257 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 71.111273455000003, 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.261 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:22:25.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:22:25.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.266 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:25.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:25.268 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:25.266+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:25.369 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:25.370+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:25.439 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:25.439 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:25.439 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:25.439 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:25.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:25.501 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:25.502+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:25.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:25.567+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:25.628 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:25.628 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:25.628 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:25.628 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:25.628 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:25.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:25.689 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:25.690+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:25.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:25.772 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:25.770+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:25.773 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.773 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.354418601999996, 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:25.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:22:25.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.342970393000002, 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:22:25.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255355488000006, 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:22:25.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:22:25.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:22:25.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255312384000007, 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.787 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:22:25.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:22:25.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255285135999998, 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:22:25.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255258855999998, 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.795 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:25.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255236245000006, 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:22:25.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:22:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255208416000002, 2024-09-12T05:22:25.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:22:25.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:22:25.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255185996999998, 2024-09-12T05:22:25.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:25.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.811 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255164864999998, 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255076231000004, 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:22:25.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:22:25.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255045296999995, 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:22:25.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:22:25.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.255019134999998, 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:22:25.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.254996961000003, 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:22:25.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.254975846999997, 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:22:25.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.254954209999994, 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.254789294999995, 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 72.254761579000004, 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:22:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:22:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:22:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.169233683000002, 2024-09-12T05:22:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:22:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:103340 3.0 3:06fad095:::rbd_data.1118e5d0fec8.00000000000000e6:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 124922~6150] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.801240749999998, 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95737219699999998, 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 103340 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972843+0000", 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5469999999999999e-06 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972859+0000", 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5625999999999999e-05 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972881+0000", 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.262e-05 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972893+0000", 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1866e-05 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972961+0000", 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8208999999999997e-05 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972973+0000", 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1425e-05 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.927928+0000", 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95495565000000004 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928050+0000", 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012213799999999999 2024-09-12T05:22:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928260+0000", 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000209626 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.929880+0000", 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016203019999999999 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930114+0000", 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023339699999999999 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930171+0000", 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7697e-05 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930213+0000", 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1094000000000003e-05 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:25.860 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:25.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:25.862 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:25.862 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:25.869 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:25.869 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:25.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:25.871+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:25.886 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:25.886 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:25.974 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:25.971+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:25.986 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:25.986 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:26.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:26.089 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:26.090+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:26.173 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:26.173 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:26.176 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:26.174+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:26.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:26.277 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:26.279+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:26.353 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:26.353 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:26.369 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:26.417 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:26.415+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:26.479 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:26.478+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:26.500 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:26.500 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:26.501 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:26.501 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:26.514 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:26.601 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:26.599+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:26.679 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:26.680 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:26.680 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:26.680 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:26.680 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:26.680 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:26.675+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:26.693 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:26.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:22:26.781 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:26.782+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:26.861 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:26.861 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:26.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:26.861 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:26.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.861 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.861 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.358270261999998, 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.865 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.358238612999997, 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:22:26.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:22:26.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:22:26.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:22:26.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:22:26.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:22:26.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.870 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.358202470000002, 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:22:26.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:22:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.358171659999996, 2024-09-12T05:22:26.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:26.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.881 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.358141101000001, 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:26.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:22:26.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.358111205, 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:22:26.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:22:26.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.356354261999996, 2024-09-12T05:22:26.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.892 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:22:26.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:22:26.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.896 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.356310692999998, 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:22:26.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:22:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:22:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:22:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:22:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.356078803000003, 2024-09-12T05:22:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:22:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.903 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:22:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.904 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:22:26.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:22:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:22:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:22:26.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:22:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:22:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:22:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:22:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:22:26.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.355957891999999, 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:22:26.911 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:22:26.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:22:26.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.916 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.355840854, 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:22:26.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:22:26.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:22:26.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.921 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.355721246000002, 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.922 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:22:26.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.352742519000003, 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:22:26.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.931 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.352708213, 2024-09-12T05:22:26.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:26.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:22:26.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:22:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:22:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.352676037000002, 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.938 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:22:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:22:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:22:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:22:26.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:22:26.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.943 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.352614420999998, 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.944 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.352559065000001, 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:22:26.949 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:22:26.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:22:26.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.954 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.352504259, 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:22:26.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:22:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:22:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.959 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.352344584999997, 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:22:26.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115892 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_name in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118)", 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.637163058000001, 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.54022301299999997, 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:26.964 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115892 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223292+0000", 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2639999999999998e-06 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223302+0000", 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8959999999999998e-06 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223325+0000", 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-05 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223459+0000", 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013345300000000001 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223539+0000", 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0346000000000006e-05 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:26.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223552+0000", 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3264e-05 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763244+0000", 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.53969141899999995 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763377+0000", 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013312999999999999 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763513+0000", 2024-09-12T05:22:26.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013600099999999999 2024-09-12T05:22:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:26.969 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:26.969 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:26.970 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:26.971 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:26.970+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:27.071 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:27.067+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:27.099 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:27.099 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:27.100 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:27.100 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:27.113 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:27.201 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:27.199+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:27.273 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:27.271+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:27.278 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:27.278 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:27.278 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:27.278 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:27.278 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:27.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:27.380 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:27.379+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:27.462 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.291871134, 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:22:27.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.291169614, 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.468 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.29104688, 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.474 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:22:27.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.474 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:27.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:22:27.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.290984667, 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.478 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:22:27.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.29091785, 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:22:27.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.290857817, 2024-09-12T05:22:27.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:22:27.489 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.489 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.489 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:22:27.493 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.290777881, 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:22:27.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.498 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.29071832, 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:22:27.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.290643531, 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:22:27.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.507 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.290506131, 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:22:27.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:22:27.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.290354396, 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.512 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:22:27.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:22:27.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.290291422, 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:22:27.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:22:27.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.29015553000001, 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:22:27.521 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:22:27.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.525 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.29009157, 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.526 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.530 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.290007317, 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:22:27.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.289947957, 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.536 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:22:27.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.28988769, 2024-09-12T05:22:27.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:27.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:22:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:22:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.289824697, 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.546 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:22:27.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:22:27.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:22:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:22:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.289664089, 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:27.551 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:22:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:22:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:22:27.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:22:27.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.846432374999999, 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:22:27.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:22:27.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:22:27.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:22:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:27.560 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:27.560 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:27.562 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:27.562 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:27.562+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:27.662 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:27.659+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:27.730 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:27.730 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:27.730 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:27.730 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:27.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:27.764 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:27.762+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:27.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:27.863+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:27.867 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:22:27.918 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:27.918 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:27.918 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:27.934 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:27.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:27.979+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:28.067 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:28.066+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:28.109 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:28.109 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:28.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:28.109 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:28.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.109 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.109 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:28.109 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.870087890000001, 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:22:28.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:22:28.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:22:28.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:22:28.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:22:28.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:22:28.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:22:28.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:22:28.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:22:28.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:22:28.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:22:28.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:22:28.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:22:28.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:22:28.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:22:28.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:22:28.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:28.119 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.869074167999997, 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:22:28.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.125 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.868380307000002, 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:22:28.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:22:28.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.865395464000002, 2024-09-12T05:22:28.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:22:28.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.865154138999998, 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:22:28.137 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:22:28.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:22:28.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.864405929, 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:22:28.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:22:28.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:22:28.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:22:28.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:22:28.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:22:28.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.864094168000001, 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:28.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:22:28.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.863371207, 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.155 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.862072288, 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.162 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:22:28.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:22:28.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:22:28.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:22:28.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.168 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.859520533999998, 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.169 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:28.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:22:28.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:22:28.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:22:28.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.858742044000003, 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.176 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:22:28.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:28.182 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.858469702999997, 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:22:28.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:22:28.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:22:28.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:22:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.857193416999998, 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.189 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:22:28.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:22:28.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:22:28.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:22:28.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.195 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.855790800999998, 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:22:28.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:22:28.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.202 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.855075300000003, 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:22:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:28.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:28.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:22:28.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.853753904000001, 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:22:28.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.215 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.852677259000004, 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.216 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:22:28.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.221 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.852454514999998, 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:22:28.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:22:28.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:22:28.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.851833476000003, 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.228 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:22:28.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:22:28.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.850185343, 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:22:28.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.240 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:28.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:28.242 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:28.242+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:28.343 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:28.342+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:28.368 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:28.368 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:28.368 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:28.368 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:28.383 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:28.443 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:28.439+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:28.506 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:28.507 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:28.507 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:28.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:28.545 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:28.546+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:28.645 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:28.643+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:27, version: 93'412, data_included: [0~33694,1460698~7155], data_size: 40849, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:27@93'412, size: 1467853, copy_subset: [(0, 1467853)], clone_subset: {}, snapset: 27=[]:{27: [27]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1467853, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.461337628000001, 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004462021, 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224821+0000", 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6300000000000001e-07 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224874+0000", 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2475999999999997e-05 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224892+0000", 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8433000000000001e-05 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.224904+0000", 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1922e-05 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.226480+0000", 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015764850000000001 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.226508+0000", 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7671e-05 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229283+0000", 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027747710000000001 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "MOSDPGPush(3.13 118/115 [PushOp(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:head, version: 93'413, data_included: [0~33694], data_size: 33694, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c96e49b5:::rbd_data.1118fc825ed.0000000000000007:head@93'413, size: 524288, copy_subset: [(0, 524288)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 524288, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.45884764, 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040878429999999999, 2024-09-12T05:22:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227311+0000", 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227312+0000", 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1480000000000001e-06 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227341+0000", 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8728e-05 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227365+0000", 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4717000000000001e-05 2024-09-12T05:22:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.227385+0000", 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9334000000000002e-05 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229393+0000", 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020081610000000001 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.229417+0000", 2024-09-12T05:22:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4434e-05 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.231399+0000", 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019813209999999999 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116419 3.1c e123/118 3:3c51c160:::rbd_header.11185331af3a:head v 123'596, mlcod=122'594)", 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.8876842289999995, 2024-09-12T05:22:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045675220000000001, 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798474+0000", 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2399999999999999e-07 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798480+0000", 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950000000000002e-06 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798495+0000", 2024-09-12T05:22:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5087e-05 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798503+0000", 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5730000000000008e-06 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798589+0000", 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6067000000000001e-05 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.798611+0000", 2024-09-12T05:22:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1477000000000001e-05 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.802981+0000", 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043699740000000004 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.803042+0000", 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116509 3.a e123/117 3:5332fa78:::rbd_data.11185331af3a.0000000000000000:head v 123'760, mlcod=122'757)", 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7692614520000003, 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041644409999999996, 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916897+0000", 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916899+0000", 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2709999999999999e-06 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916913+0000", 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4253999999999999e-05 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916951+0000", 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7891e-05 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.916971+0000", 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0089e-05 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917154+0000", 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018263 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917196+0000", 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1449999999999998e-05 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.920960+0000", 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003764734 2024-09-12T05:22:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921061+0000", 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101122 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116513 3.1d e123/117 3:bd0ab837:::rbd_data.11185331af3a.0000000000000004:head v 123'660, mlcod=122'657)", 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7688843579999993, 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0042777120000000004, 2024-09-12T05:22:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917274+0000", 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917276+0000", 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7230000000000001e-06 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917287+0000", 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1134e-05 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917311+0000", 2024-09-12T05:22:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4579999999999998e-05 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917328+0000", 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6628000000000001e-05 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917481+0000", 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015263000000000001 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.917527+0000", 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6606000000000001e-05 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921472+0000", 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039444170000000004 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:18.921552+0000", 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9993999999999993e-05 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116641 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.7806996030000004, 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039536850000000002, 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116641 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905459+0000", 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905462+0000", 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0130000000000002e-06 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905478+0000", 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5923999999999999e-05 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905508+0000", 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0145999999999999e-05 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905523+0000", 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5605999999999999e-05 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905676+0000", 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015209199999999999 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.905929+0000", 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025293199999999998 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.906519+0000", 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059068200000000003 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.908228+0000", 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017091960000000001 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909248+0000", 2024-09-12T05:22:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010198690000000001 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909339+0000", 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1192000000000004e-05 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:19.909412+0000", 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3033000000000004e-05 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116749 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.833271+0000", 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.85288713, 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005388131, 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116749 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833271+0000", 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833271+0000", 2024-09-12T05:22:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833275+0000", 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3739999999999998e-06 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833287+0000", 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2599000000000001e-05 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833318+0000", 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1192999999999998e-05 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833336+0000", 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7929999999999999e-05 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833500+0000", 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000163976 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.833532+0000", 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.137e-05 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.838322+0000", 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047899049999999997 2024-09-12T05:22:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.838496+0000", 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000174045 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.838659+0000", 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016373900000000001 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116840 3.1a 3:582e491b:::rbd_data.111846fb6c83.0000000000000009:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7441148349999995, 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0078812729999999994, 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116840 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942046+0000", 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7700000000000002e-06 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942061+0000", 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4413000000000001e-05 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942100+0000", 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8982e-05 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942125+0000", 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5384e-05 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942295+0000", 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017022200000000001 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942570+0000", 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027470100000000003 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942807+0000", 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023657800000000001 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946714+0000", 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003907265 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949653+0000", 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029390470000000002 2024-09-12T05:22:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949796+0000", 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000143456 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949925+0000", 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128455 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116836 3.13 e125/119 3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head v 125'479, mlcod=120'477)", 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7427840559999996, 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012590459999999999, 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943375+0000", 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.33e-07 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943385+0000", 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:22:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943421+0000", 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6340000000000001e-05 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943439+0000", 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7943000000000001e-05 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946692+0000", 2024-09-12T05:22:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032526640000000002 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946753+0000", 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0736000000000003e-05 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955859+0000", 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091062309999999994 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955965+0000", 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010594600000000001 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116832 3.1c e125/118 3:3f748428:::rbd_data.111846fb6c83.0000000000000001:head v 125'618, mlcod=124'616)", 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.945598+0000", 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7405604180000003, 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055007629999999997, 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945598+0000", 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945598+0000", 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945600+0000", 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2869999999999999e-06 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945615+0000", 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5087e-05 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945658+0000", 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2830000000000002e-05 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945678+0000", 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9792999999999998e-05 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946054+0000", 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037558399999999999 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946111+0000", 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7592e-05 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.950978+0000", 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048663539999999998 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951099+0000", 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121236 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116834 3.a e125/117 3:523d80f0:::rbd_data.111846fb6c83.0000000000000003:head v 125'763, mlcod=123'761)", 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7403898289999997, 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097679289999999998, 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0699999999999996e-07 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945778+0000", 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945800+0000", 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1886999999999999e-05 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945815+0000", 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4555999999999999e-05 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946808+0000", 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0009934220000000001 2024-09-12T05:22:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946859+0000", 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1075999999999997e-05 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955438+0000", 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0085788310000000003 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955536+0000", 2024-09-12T05:22:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8517000000000006e-05 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116843 3.14 3:2957f86d:::rbd_data.111846fb6c83.000000000000000c:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7345539250000002, 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006987966, 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116843 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951608+0000", 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0400000000000001e-06 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951620+0000", 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2446000000000001e-05 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951655+0000", 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5142999999999999e-05 2024-09-12T05:22:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951677+0000", 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2144e-05 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951842+0000", 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016452200000000001 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.952429+0000", 2024-09-12T05:22:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058674499999999995 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.952714+0000", 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028506799999999998 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955997+0000", 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032838770000000002 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958320+0000", 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023223060000000001 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958457+0000", 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013729000000000001 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958592+0000", 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013538499999999999 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116845 3.14 3:2a145e74:::rbd_data.111846fb6c83.000000000000000e:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7323618039999999, 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0059322539999999997, 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116845 2024-09-12T05:22:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953799+0000", 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3970000000000001e-06 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953809+0000", 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0506000000000001e-05 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953848+0000", 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8705000000000003e-05 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953869+0000", 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0449e-05 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954142+0000", 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027315199999999998 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954438+0000", 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000295791 2024-09-12T05:22:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954726+0000", 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028802400000000001 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.957230+0000", 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025042739999999999 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959533+0000", 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002303158 2024-09-12T05:22:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959665+0000", 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013202299999999999 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959729+0000", 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3775000000000005e-05 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116853 3.1a 3:595731ba:::rbd_data.111846fb6c83.0000000000000017:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.958603+0000", 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.727555841, 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053220309999999996, 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116853 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958603+0000", 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958603+0000", 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958605+0000", 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8270000000000002e-06 2024-09-12T05:22:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958618+0000", 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2583e-05 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958651+0000", 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3167000000000003e-05 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958676+0000", 2024-09-12T05:22:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4973e-05 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958820+0000", 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000144239 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959108+0000", 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028747199999999999 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959370+0000", 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026202300000000001 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.962589+0000", 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032191749999999999 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.963801+0000", 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001212227 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.963869+0000", 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8225000000000005e-05 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.963925+0000", 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5120000000000001e-05 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117176 3.1a 3:5dbbe14f:::rbd_data.1118e5d0fec8.0000000000000043:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.7232398050000004, 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0090363549999999994, 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117176 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962920+0000", 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4339999999999999e-06 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962925+0000", 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4149999999999998e-06 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962941+0000", 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5308e-05 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962952+0000", 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1715999999999999e-05 2024-09-12T05:22:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963039+0000", 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6458000000000005e-05 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963208+0000", 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016904499999999999 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963341+0000", 2024-09-12T05:22:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013301400000000001 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.965163+0000", 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018218679999999999 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971869+0000", 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067059950000000002 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971913+0000", 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3707e-05 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971955+0000", 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2395000000000003e-05 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117179 3.1a 3:5a61d20b:::rbd_data.1118e5d0fec8.0000000000000061:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.7199676070000001, 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0060640249999999998, 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117179 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966192+0000", 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966196+0000", 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8530000000000002e-06 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966208+0000", 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2616000000000001e-05 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966219+0000", 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0175e-05 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966406+0000", 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187324 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966771+0000", 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036500399999999999 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.967053+0000", 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028252099999999999 2024-09-12T05:22:28.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968181+0000", 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001128062 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972051+0000", 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038696350000000002 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972148+0000", 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7005999999999999e-05 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972255+0000", 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106729 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117185 3.1a 3:5bcb3af8:::rbd_data.1118e5d0fec8.00000000000000da:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.968400+0000", 2024-09-12T05:22:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.7177587909999996, 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039726609999999997, 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117185 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968400+0000", 2024-09-12T05:22:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968400+0000", 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968402+0000", 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.446e-06 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968412+0000", 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8300000000000008e-06 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968436+0000", 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3957000000000001e-05 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968452+0000", 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6206e-05 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968509+0000", 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6572e-05 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968593+0000", 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4719e-05 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968659+0000", 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5857000000000003e-05 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.969504+0000", 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00084461900000000001 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972295+0000", 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027914770000000001 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972346+0000", 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0217999999999999e-05 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972372+0000", 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6760000000000001e-05 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117334 3.14 3:28739b8b:::rbd_data.11181f89f1e6.0000000000000001:head [delete] snapc 25=[] ondisk+write+known_if_redirected+supports_pool_eio e129)", 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:24.917715+0000", 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.768443574, 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055280199999999998, 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.776 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117334 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917715+0000", 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917715+0000", 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917717+0000", 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917729+0000", 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.168e-05 2024-09-12T05:22:28.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917768+0000", 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8825999999999997e-05 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917789+0000", 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1466000000000001e-05 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917957+0000", 2024-09-12T05:22:28.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000167529 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.918279+0000", 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032227699999999999 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.918563+0000", 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028402199999999999 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.922703+0000", 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041403339999999999 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.923040+0000", 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00033696699999999997 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.923139+0000", 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8358999999999998e-05 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.923243+0000", 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104113 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117339 3.14 3:2c025806:::rbd_data.11181f89f1e6.000000000000000d:head [delete] snapc 25=[] ondisk+write+known_if_redirected+supports_pool_eio e129)", 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:24.917932+0000", 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.7682262089999998, 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055474360000000002, 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.782 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117339 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917932+0000", 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917932+0000", 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917934+0000", 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917941+0000", 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9330000000000004e-06 2024-09-12T05:22:28.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917967+0000", 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5697000000000001e-05 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.917985+0000", 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8399000000000001e-05 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.920444+0000", 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024588740000000002 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.920641+0000", 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019696199999999999 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.920894+0000", 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025293800000000002 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.923270+0000", 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002376108 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.923341+0000", 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0857000000000003e-05 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.923421+0000", 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0791999999999995e-05 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.923480+0000", 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8176e-05 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:117338 3.a e129/117 3:548be07c:::rbd_data.11181f89f1e6.000000000000000a:head v 129'769, mlcod=127'767)", 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:24.921252+0000", 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.7649063620000001, 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043833989999999996, 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:28.788 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.921252+0000", 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.921252+0000", 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.921253+0000", 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.54e-07 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.921262+0000", 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5030000000000003e-06 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.921291+0000", 2024-09-12T05:22:28.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8575999999999999e-05 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.921309+0000", 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8077e-05 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.921455+0000", 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146102 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:28.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.921493+0000", 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7700000000000002e-05 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.925545+0000", 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040518580000000002 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:24.925635+0000", 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729000000000005e-05 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.792 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:28.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:28.793 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:28.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:28.795 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:28.791+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:28.896 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:28.891+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:28.940 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:28.940 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:28.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:28.997 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:28.995+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:29.089 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:29.089 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:29.097 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:29.095+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:29.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:29.198 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:29.198+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:29.232 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:29.232 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:29.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:29.299 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:29.295+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:29.400 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:29.399+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:29.417 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:29.417 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:29.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:29.501 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:29.503+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:29.560 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:29.560 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:29.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:29.621 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:29.622+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:29.703 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:29.703 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:29.703 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:29.702+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:29.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:29.804 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:29.803+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:29.887 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:29.887 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:29.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:22:29.905 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:29.906+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:29.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:30.006 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:30.006+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:30.092 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:30.092 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:30.107 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:30.106+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:30.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:30.208 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:30.207+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:30.264 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:30.264 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:30.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:30.329 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:30.327+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:30.409 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:30.410 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:30.410 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:30.410 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:30.410 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:30.407+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:30.424 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:30.511 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:30.510+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:30.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-12T05:22:30.593 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:30.593 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:30.593 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:30.593 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:30.593 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:30.607 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:30.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:30.651+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:30.713 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:30.711+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.224602877000002, 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:22:30.727 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:22:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:22:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.224571228000002, 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.224535084999999, 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.740 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.224504275000001, 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:22:30.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:22:30.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.224473715999999, 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.745 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:30.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.749 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.224443819999998, 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.222686877000001, 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.754 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:22:30.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.222643308000002, 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:22:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:22:30.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.222411418, 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:22:30.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:22:30.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.222290506999997, 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:22:30.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.222173468999998, 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:22:30.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.222053860999999, 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:30.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:22:30.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:22:30.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.219075134000001, 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:22:30.780 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:22:30.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.219040827999997, 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:30.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:22:30.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.219008651999999, 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:30.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.218947036000003, 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.218891679999999, 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.798 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.218836873999997, 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.802 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.806 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.218677200000002, 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:30.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:22:30.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115892 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_name in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118)", 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 16.503495673, 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.54022301299999997, 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:30.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115892 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:30.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223292+0000", 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2639999999999998e-06 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223302+0000", 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8959999999999998e-06 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:30.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223325+0000", 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-05 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223459+0000", 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013345300000000001 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223539+0000", 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0346000000000006e-05 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:30.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223552+0000", 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3264e-05 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763244+0000", 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.53969141899999995 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763377+0000", 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013312999999999999 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:30.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763513+0000", 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013600099999999999 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:30.816 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:30.817 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:30.818 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:30.818+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:30.858 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:22:30.900 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:30.918 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:30.915+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:30.927 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T05:22:30.927 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.3 2024-09-12T05:22:30.927 INFO:tasks.thrashosds.thrasher:remote for osd 3 is ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:22:30.927 DEBUG:teuthology.orchestra.run.smithi059:> type ceph-objectstore-tool 2024-09-12T05:22:30.930 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:30.930 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:30.934 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T05:22:30.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --op list-pgs 2024-09-12T05:22:30.959 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:30.964 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:30.964 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:31.003 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:31.004 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:31.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:31.015+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:31.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:31.120 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:31.115+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:31.187 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:31.187 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:31.202 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:31.245 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:31.243+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:31.321 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:31.319+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:31.367 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:31.367 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:31.381 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:31.425 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:31.427+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:31.455 INFO:teuthology.orchestra.run.smithi059.stdout:3.c 2024-09-12T05:22:31.455 INFO:teuthology.orchestra.run.smithi059.stdout:3.7 2024-09-12T05:22:31.455 INFO:teuthology.orchestra.run.smithi059.stdout:3.2 2024-09-12T05:22:31.455 INFO:teuthology.orchestra.run.smithi059.stdout:3.8 2024-09-12T05:22:31.455 INFO:teuthology.orchestra.run.smithi059.stdout:3.1e 2024-09-12T05:22:31.455 INFO:teuthology.orchestra.run.smithi059.stdout:3.19 2024-09-12T05:22:31.455 INFO:teuthology.orchestra.run.smithi059.stdout:3.5 2024-09-12T05:22:31.455 INFO:teuthology.orchestra.run.smithi059.stdout:3.18 2024-09-12T05:22:31.523 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:31.519+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:31.549 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:31.549 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:31.563 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:31.623 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:31.622+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:31.725 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:31.726+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:31.729 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:31.729 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:31.743 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:31.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --op export --pgid 3.1e --file /var/log/ceph/exp.3.1e.3 2024-09-12T05:22:31.826 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:31.823+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:31.863 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:31.863 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:31.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:31.965 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:31.963+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:32.027 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:32.023+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:32.045 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:32.045 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:32.061 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:32.148 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:32.147+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:32.229 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:32.229 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:32.229 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:32.227+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:32.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:32.313 INFO:teuthology.orchestra.run.smithi059.stderr:Exporting 3.1e info 3.1e( v 127'340 (0'0,127'340] local-lis/les=42/43 n=62 ec=23/23 lis/c=42/42 les/c/f=43/43/0 sis=42) 2024-09-12T05:22:32.315 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:784d8f1f:::rbd_data.1118b49023bd.0000000000000165:head# 2024-09-12T05:22:32.316 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:78abed38:::rbd_data.1118a362a851.0000000000000000:6# 2024-09-12T05:22:32.319 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:78abed38:::rbd_data.1118a362a851.0000000000000000:head# 2024-09-12T05:22:32.319 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:78b8908d:::rbd_data.11187bfcbd74.000000000000017f:head# 2024-09-12T05:22:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:78cd2ec8:::rbd_data.11187bfcbd74.00000000000002a6:head# 2024-09-12T05:22:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:78d16ec8:::rbd_data.1118d53b39e7.0000000000000016:head# 2024-09-12T05:22:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:78ec9b11:::rbd_data.11187bfcbd74.000000000000033f:head# 2024-09-12T05:22:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:791926e4:::rbd_data.11187bfcbd74.00000000000002ad:head# 2024-09-12T05:22:32.320 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:794a5eb5:::rbd_data.1118e5842253.000000000000004e:7# 2024-09-12T05:22:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:794a5eb5:::rbd_data.1118e5842253.000000000000004e:head# 2024-09-12T05:22:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:79653ab6:::rbd_data.1118b49023bd.0000000000000178:head# 2024-09-12T05:22:32.321 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:796f25c2:::rbd_data.11182c6d9c71.000000000000000b:a# 2024-09-12T05:22:32.322 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:796f25c2:::rbd_data.11182c6d9c71.000000000000000b:head# 2024-09-12T05:22:32.323 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:79a9f4e2:::rbd_data.1118c64990c9.0000000000000002:head# 2024-09-12T05:22:32.329 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:32.330+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:32.336 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:79bf2c09:::rbd_data.1118d53b39e7.0000000000000041:head# 2024-09-12T05:22:32.336 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:head# 2024-09-12T05:22:32.344 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7a296cda:::rbd_data.111860f58c0c.0000000000000005:head# 2024-09-12T05:22:32.353 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7a2fac55:::rbd_data.11185d53c886.0000000000000038:head# 2024-09-12T05:22:32.354 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7a5a9167:::rbd_data.1118e5842253.0000000000000007:head# 2024-09-12T05:22:32.354 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7a6b822e:::rbd_id.image_client.0-clone15:head# 2024-09-12T05:22:32.354 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7a78e6e0:::rbd_data.1118a2459872.00000000000000ba:17# 2024-09-12T05:22:32.354 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7a78e6e0:::rbd_data.1118a2459872.00000000000000ba:head# 2024-09-12T05:22:32.355 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7a9eb054:::rbd_data.11187bfcbd74.0000000000000199:head# 2024-09-12T05:22:32.355 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7aeed1d8:::rbd_data.1118a362a851.0000000000000010:head# 2024-09-12T05:22:32.355 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7b56ed0f:::rbd_data.1118b56d3449.0000000000000000:head# 2024-09-12T05:22:32.362 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7b88a26b:::rbd_data.111887da7c95.000000000000037d:f# 2024-09-12T05:22:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7b88a26b:::rbd_data.111887da7c95.000000000000037d:head# 2024-09-12T05:22:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7ba3fba4:::rbd_id.image_client.0-clone24:head# 2024-09-12T05:22:32.363 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7bb79bfc:::rbd_data.111887da7c95.000000000000007e:f# 2024-09-12T05:22:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7bb79bfc:::rbd_data.111887da7c95.000000000000007e:head# 2024-09-12T05:22:32.364 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7c0c020d:::rbd_data.11187bfcbd74.000000000000001f:head# 2024-09-12T05:22:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7c0c7487:::rbd_data.11187bfcbd74.0000000000000269:head# 2024-09-12T05:22:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7c24103d:::rbd_data.11187bfcbd74.00000000000001f8:head# 2024-09-12T05:22:32.365 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7c46dec9:::rbd_data.111887da7c95.000000000000037f:f# 2024-09-12T05:22:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7c46dec9:::rbd_data.111887da7c95.000000000000037f:head# 2024-09-12T05:22:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7c6b77fc:::rbd_object_map.11182d2a28db.0000000000000010:head# 2024-09-12T05:22:32.366 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7caf0d00:::rbd_data.11187bfcbd74.00000000000002b6:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7d017c99:::rbd_data.11187bfcbd74.000000000000028d:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7d2fa007:::rbd_data.11187bfcbd74.0000000000000137:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7d42aa04:::rbd_data.11187bfcbd74.000000000000032f:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7d65dfca:::rbd_data.11187bfcbd74.0000000000000289:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7d724224:::rbd_data.11187bfcbd74.00000000000002dc:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7d7ec841:::rbd_data.1118b49023bd.0000000000000146:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7d8cf209:::rbd_data.11187bfcbd74.00000000000001d2:11# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7d8cf209:::rbd_data.11187bfcbd74.00000000000001d2:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7e09798b:::rbd_data.1118b49023bd.0000000000000120:head# 2024-09-12T05:22:32.367 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7e4a5550:::rbd_data.11185d53c886.000000000000003c:head# 2024-09-12T05:22:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7e4aee8d:::rbd_data.1118bf17036a.0000000000000007:12# 2024-09-12T05:22:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7e4aee8d:::rbd_data.1118bf17036a.0000000000000007:head# 2024-09-12T05:22:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7e58b7c2:::rbd_data.11186ec76cc4.0000000000000000:head# 2024-09-12T05:22:32.373 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7e7d490f:::rbd_data.11187bfcbd74.000000000000020b:head# 2024-09-12T05:22:32.373 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7eb6cbd2:::rbd_data.1118d53b39e7.0000000000000043:head# 2024-09-12T05:22:32.373 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7eed9c89:::rbd_data.11187bfcbd74.00000000000002f3:head# 2024-09-12T05:22:32.373 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7f377129:::rbd_data.11187bfcbd74.000000000000024e:head# 2024-09-12T05:22:32.373 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7f52c724:::rbd_data.1118f6d14695.0000000000000003:9# 2024-09-12T05:22:32.381 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7f52c724:::rbd_data.1118f6d14695.0000000000000003:head# 2024-09-12T05:22:32.388 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7f599d49:::rbd_data.11187bfcbd74.0000000000000234:head# 2024-09-12T05:22:32.388 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7f6437c3:::rbd_data.1118e5842253.0000000000000061:7# 2024-09-12T05:22:32.388 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7f6437c3:::rbd_data.1118e5842253.0000000000000061:head# 2024-09-12T05:22:32.388 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7f77eab9:::rbd_data.11187bfcbd74.000000000000014c:head# 2024-09-12T05:22:32.388 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7fe6bb71:::rbd_data.1118a2459872.000000000000008e:17# 2024-09-12T05:22:32.389 INFO:teuthology.orchestra.run.smithi059.stderr:Read #3:7fe6bb71:::rbd_data.1118a2459872.000000000000008e:head# 2024-09-12T05:22:32.390 INFO:teuthology.orchestra.run.smithi059.stderr:Export successful 2024-09-12T05:22:32.406 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:32.406 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:32.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:32.430 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:32.427+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:32.531 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:32.531+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:32.551 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:32.552 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:32.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:32.632 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:32.630+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:32.687 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:32.687 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:32.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:32.733 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:32.735+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:32.834 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:32.834+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:32.871 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:32.871 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:32.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:32.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:22:32.935 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:32.931+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:32.954 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --force --op remove --pgid 3.1e 2024-09-12T05:22:32.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:33.036 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:33.035+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:33.062 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:33.062 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:33.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:33.137 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:33.135+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:33.152 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:33.152 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:33.169 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:33.169 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:33.186 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:33.187 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:33.187 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:33.208 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:33.208 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:33.229 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:33.229 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:33.238 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:33.235+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:33.249 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:33.249 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:33.249 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:33.249 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:33.250 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:33.250 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:33.251 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:33.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:33.272 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:33.272 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:33.275 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:33.276 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:33.339 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:33.338+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:33.392 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:33.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.971932729000002, 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.393 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:22:33.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.397 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.960484519999994, 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:33.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:22:33.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872869614999999, 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:22:33.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.406 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872826511, 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.407 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:33.411 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872799263000005, 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:22:33.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:22:33.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872772983000004, 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:22:33.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:22:33.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:22:33.419 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872750371999999, 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.420 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:22:33.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872722542999995, 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:22:33.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:22:33.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:22:33.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872700124000005, 2024-09-12T05:22:33.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:33.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:33.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872678992000004, 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.434 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872590357999997, 2024-09-12T05:22:33.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:33.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:22:33.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872559424000002, 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:22:33.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:22:33.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:22:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872533262000005, 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.447 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872511087999996, 2024-09-12T05:22:33.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:22:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.452 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:33.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:22:33.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872489974000004, 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:22:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:22:33.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:33.461 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872468337000001, 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872303422000002, 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.466 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:22:33.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:33.470 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.872275705999996, 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:22:33.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:22:33.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.474 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 69.786747809999994, 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.475 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:22:33.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:22:33.481 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.481 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.481 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.481 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:103340 3.0 3:06fad095:::rbd_data.1118e5d0fec8.00000000000000e6:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 124922~6150] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-12T05:22:33.481 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:33.481 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 51.418754876999998, 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95737219699999998, 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 103340 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972843+0000", 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5469999999999999e-06 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972859+0000", 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5625999999999999e-05 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972881+0000", 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.262e-05 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972893+0000", 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1866e-05 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972961+0000", 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8208999999999997e-05 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972973+0000", 2024-09-12T05:22:33.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1425e-05 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.927928+0000", 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95495565000000004 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928050+0000", 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012213799999999999 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928260+0000", 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000209626 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.929880+0000", 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016203019999999999 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930114+0000", 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023339699999999999 2024-09-12T05:22:33.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930171+0000", 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7697e-05 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930213+0000", 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1094000000000003e-05 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.488 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.489 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.489 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:33.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:33.491 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:33.490+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:33.590 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:33.591+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:33.651 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:33.651 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:33.651 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:33.651 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:33.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:33.709 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:33.710+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:33.777 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:33.777 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:33.777 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:33.777 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:33.777 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:33.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:33.833 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:33.834+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:33.892 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:33.894+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:33.923 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:22:33.960 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:33.960 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:33.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:33.960 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:33.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 132.98203434600001, 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:22:33.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:22:33.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 128.07040202900001, 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.965 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:22:33.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.969 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 127.687701545, 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:33.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:22:33.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:22:33.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.973 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 127.453657898, 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:22:33.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 127.42353356700001, 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:22:33.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:22:33.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 126.861445786, 2024-09-12T05:22:33.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:22:33.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:33.988 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 126.859491568, 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:22:33.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 117.91818283400001, 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:22:33.993 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:22:33.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:22:33.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:33.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 117.901586241, 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:22:33.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:22:34.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 116.731246801, 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.002 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:22:34.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:22:34.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 108.852792549, 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:22:34.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 108.852747455, 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.011 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:22:34.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:22:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 108.84418589400001, 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.016 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:22:34.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:22:34.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 104.042147735, 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:22:34.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:22:34.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.528024297000002, 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:22:34.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:22:34.029 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.519938205000003, 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:22:34.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 84.617751957999999, 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.034 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:22:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:34.039 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 80.640352037, 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.044 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 79.888205056999993, 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:22:34.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 74.528955326000002, 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:22:34.049 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:34.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:22:34.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:34.055 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:34.056 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:34.057 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:34.055+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:34.157 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:34.155+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:34.193 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:34.193 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:34.193 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:34.193 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:34.207 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:34.258 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:34.258+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:34.359 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:34.358+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:34.375 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:34.375 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:34.376 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:34.376 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:34.376 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:34.389 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:34.460 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:34.455+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:34.509 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.007359880999999, 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.007328231999999, 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:22:34.518 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.007292089000003, 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.519 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:22:34.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.007261278999998, 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:22:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:22:34.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:22:34.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.007230720000003, 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:34.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:22:34.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.532 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.007200824000002, 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:22:34.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:22:34.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.005443880999998, 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:22:34.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:34.541 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.005400311999999, 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:22:34.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.005168421999997, 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.546 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:22:34.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:22:34.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.005047511000001, 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.551 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:22:34.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.004930473000002, 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:22:34.555 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:22:34.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:22:34.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.004810865000003, 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.001832137999997, 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:22:34.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.001797832000001, 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.001765656000003, 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.572 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:22:34.576 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.00170404, 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:22:34.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:22:34.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.001648684000003, 2024-09-12T05:22:34.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:22:34.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.585 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.001593878000001, 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.586 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:22:34.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.001434203999999, 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.591 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:22:34.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115892 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_name in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118)", 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.286252677, 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.54022301299999997, 2024-09-12T05:22:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115892 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223292+0000", 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2639999999999998e-06 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223302+0000", 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8959999999999998e-06 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223325+0000", 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-05 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223459+0000", 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013345300000000001 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223539+0000", 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0346000000000006e-05 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223552+0000", 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3264e-05 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763244+0000", 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.53969141899999995 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763377+0000", 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013312999999999999 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763513+0000", 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013600099999999999 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:34.600 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:34.602 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:34.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:34.603+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:34.706 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:34.699+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:34.780 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:34.781 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:34.781 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:34.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:34.804 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:34.806+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:34.906 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:34.906+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:34.943 INFO:teuthology.orchestra.run.smithi059.stdout: marking collection for removal 2024-09-12T05:22:34.952 INFO:teuthology.orchestra.run.smithi059.stdout:setting '_remove' omap key 2024-09-12T05:22:34.952 INFO:teuthology.orchestra.run.smithi059.stdout:finish_remove_pgs 3.1e_head removing 3.1e 2024-09-12T05:22:34.962 INFO:teuthology.orchestra.run.smithi059.stdout:Remove successful 2024-09-12T05:22:34.965 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:34.965 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:34.966 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:34.966 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:34.966 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:34.981 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:35.007 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:35.006+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:35.100 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.929750375, 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:22:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:22:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.929048855, 2024-09-12T05:22:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:22:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.928926121, 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:22:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:22:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.928863908, 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.92879709100001, 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.928737058, 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.928657122, 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.928597561, 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.92852277199999, 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:22:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.92838537199999, 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.92823363700001, 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:22:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.928170663, 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:22:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:22:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:22:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.928034771, 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:22:35.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.92797081099999, 2024-09-12T05:22:35.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:22:35.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:22:35.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.927886558, 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:22:35.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.927827198, 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:35.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:22:35.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:35.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.92776693099999, 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:22:35.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.92770393799999, 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:22:35.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:35.179 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 114.92754333000001, 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:22:35.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:22:35.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.484311615999999, 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:22:35.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:22:35.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:22:35.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:22:35.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.188 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:35.188 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:35.188 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:35.189 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:35.190 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:35.191+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:35.277 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:35.290 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:35.291+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:35.359 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:35.359 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:35.359 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:35.359 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:35.375 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:35.417 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:35.415+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:35.437 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:35.437 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:35.456 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:35.456 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:35.474 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:35.475 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:35.475 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:35.491 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:35.487+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:35.495 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:35.495 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:35.516 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:35.517 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:35.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.1e.3 2024-09-12T05:22:35.539 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:35.540 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:35.540 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:35.540 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:35.540 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:35.540 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:35.540 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:35.554 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:35.562 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:35.562 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:35.566 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:35.567 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:35.609 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:35.610+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:35.693 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:35.691+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:35.720 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:35.720 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:35.735 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:35.794 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:35.794+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:35.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:35.891+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:35.904 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:35.904 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:35.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:35.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:22:36.008 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:36.011+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:36.088 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:36.088 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:36.097 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:36.095+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:36.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:36.197 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:36.195+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:36.270 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:36.270 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:36.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:36.329 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:36.331+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:36.402 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:36.402+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:36.417 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:36.417 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:36.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:36.521 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:36.522+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:36.594 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:36.595 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:36.606 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:36.603+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:36.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:36.709 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:36.710+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:36.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-12T05:22:36.781 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:36.782 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:36.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:36.841 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:36.842+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:36.913 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:36.914+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:22:36.966 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:36.966 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:36.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:37.014 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:37.011+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:37.095 INFO:teuthology.orchestra.run.smithi059.stdout:get_pg_num_history pg_num_history pg_num_history(e129 pg_nums {1={16=1},2={19=8},3={23=32}} deleted_pools ) 2024-09-12T05:22:37.095 INFO:teuthology.orchestra.run.smithi059.stdout:Importing pgid 3.1e 2024-09-12T05:22:37.101 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:784d8f1f:::rbd_data.1118b49023bd.0000000000000165:head# 2024-09-12T05:22:37.101 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 18=[]:{} 2024-09-12T05:22:37.106 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:78abed38:::rbd_data.1118a362a851.0000000000000000:6# 2024-09-12T05:22:37.116 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:37.118+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:37.118 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:78abed38:::rbd_data.1118a362a851.0000000000000000:head# 2024-09-12T05:22:37.118 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 6=[]:{6=[6]} 2024-09-12T05:22:37.118 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:78b8908d:::rbd_data.11187bfcbd74.000000000000017f:head# 2024-09-12T05:22:37.118 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.119 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:78cd2ec8:::rbd_data.11187bfcbd74.00000000000002a6:head# 2024-09-12T05:22:37.119 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.120 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:78d16ec8:::rbd_data.1118d53b39e7.0000000000000016:head# 2024-09-12T05:22:37.120 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.124 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:78ec9b11:::rbd_data.11187bfcbd74.000000000000033f:head# 2024-09-12T05:22:37.124 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.124 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:791926e4:::rbd_data.11187bfcbd74.00000000000002ad:head# 2024-09-12T05:22:37.124 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.125 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:794a5eb5:::rbd_data.1118e5842253.000000000000004e:7# 2024-09-12T05:22:37.127 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:794a5eb5:::rbd_data.1118e5842253.000000000000004e:head# 2024-09-12T05:22:37.127 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 7=[]:{7=[7]} 2024-09-12T05:22:37.128 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:79653ab6:::rbd_data.1118b49023bd.0000000000000178:head# 2024-09-12T05:22:37.128 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 18=[]:{} 2024-09-12T05:22:37.128 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:796f25c2:::rbd_data.11182c6d9c71.000000000000000b:a# 2024-09-12T05:22:37.131 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:796f25c2:::rbd_data.11182c6d9c71.000000000000000b:head# 2024-09-12T05:22:37.131 INFO:teuthology.orchestra.run.smithi059.stdout:snapset a=[]:{a=[a]} 2024-09-12T05:22:37.132 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:79a9f4e2:::rbd_data.1118c64990c9.0000000000000002:head# 2024-09-12T05:22:37.141 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.174 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:37.174 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:37.179 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:79bf2c09:::rbd_data.1118d53b39e7.0000000000000041:head# 2024-09-12T05:22:37.179 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 23=[]:{} 2024-09-12T05:22:37.182 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7a1ff559:::rbd_data.11184141c2e2.0000000000000005:head# 2024-09-12T05:22:37.184 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:37.201 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7a296cda:::rbd_data.111860f58c0c.0000000000000005:head# 2024-09-12T05:22:37.204 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.217 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:37.218+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:37.226 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7a2fac55:::rbd_data.11185d53c886.0000000000000038:head# 2024-09-12T05:22:37.226 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.227 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7a5a9167:::rbd_data.1118e5842253.0000000000000007:head# 2024-09-12T05:22:37.227 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 7=[]:{} 2024-09-12T05:22:37.228 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7a6b822e:::rbd_id.image_client.0-clone15:head# 2024-09-12T05:22:37.228 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.228 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7a78e6e0:::rbd_data.1118a2459872.00000000000000ba:17# 2024-09-12T05:22:37.229 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7a78e6e0:::rbd_data.1118a2459872.00000000000000ba:head# 2024-09-12T05:22:37.230 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 17=[]:{17=[17]} 2024-09-12T05:22:37.230 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7a9eb054:::rbd_data.11187bfcbd74.0000000000000199:head# 2024-09-12T05:22:37.230 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.231 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7aeed1d8:::rbd_data.1118a362a851.0000000000000010:head# 2024-09-12T05:22:37.231 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 6=[]:{} 2024-09-12T05:22:37.231 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7b56ed0f:::rbd_data.1118b56d3449.0000000000000000:head# 2024-09-12T05:22:37.232 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.244 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7b88a26b:::rbd_data.111887da7c95.000000000000037d:f# 2024-09-12T05:22:37.246 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7b88a26b:::rbd_data.111887da7c95.000000000000037d:head# 2024-09-12T05:22:37.246 INFO:teuthology.orchestra.run.smithi059.stdout:snapset f=[]:{f=[f]} 2024-09-12T05:22:37.246 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7ba3fba4:::rbd_id.image_client.0-clone24:head# 2024-09-12T05:22:37.246 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.247 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7bb79bfc:::rbd_data.111887da7c95.000000000000007e:f# 2024-09-12T05:22:37.248 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7bb79bfc:::rbd_data.111887da7c95.000000000000007e:head# 2024-09-12T05:22:37.248 INFO:teuthology.orchestra.run.smithi059.stdout:snapset f=[]:{f=[f]} 2024-09-12T05:22:37.248 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7c0c020d:::rbd_data.11187bfcbd74.000000000000001f:head# 2024-09-12T05:22:37.248 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.250 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7c0c7487:::rbd_data.11187bfcbd74.0000000000000269:head# 2024-09-12T05:22:37.250 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.250 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7c24103d:::rbd_data.11187bfcbd74.00000000000001f8:head# 2024-09-12T05:22:37.251 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.251 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7c46dec9:::rbd_data.111887da7c95.000000000000037f:f# 2024-09-12T05:22:37.252 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7c46dec9:::rbd_data.111887da7c95.000000000000037f:head# 2024-09-12T05:22:37.253 INFO:teuthology.orchestra.run.smithi059.stdout:snapset f=[]:{f=[f]} 2024-09-12T05:22:37.253 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7c6b77fc:::rbd_object_map.11182d2a28db.0000000000000010:head# 2024-09-12T05:22:37.253 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.254 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7caf0d00:::rbd_data.11187bfcbd74.00000000000002b6:head# 2024-09-12T05:22:37.254 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.255 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7d017c99:::rbd_data.11187bfcbd74.000000000000028d:head# 2024-09-12T05:22:37.255 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.256 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7d2fa007:::rbd_data.11187bfcbd74.0000000000000137:head# 2024-09-12T05:22:37.256 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.257 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7d42aa04:::rbd_data.11187bfcbd74.000000000000032f:head# 2024-09-12T05:22:37.257 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.259 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7d65dfca:::rbd_data.11187bfcbd74.0000000000000289:head# 2024-09-12T05:22:37.260 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.262 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7d724224:::rbd_data.11187bfcbd74.00000000000002dc:head# 2024-09-12T05:22:37.262 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.263 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7d7ec841:::rbd_data.1118b49023bd.0000000000000146:head# 2024-09-12T05:22:37.263 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 18=[]:{} 2024-09-12T05:22:37.263 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7d8cf209:::rbd_data.11187bfcbd74.00000000000001d2:11# 2024-09-12T05:22:37.264 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7d8cf209:::rbd_data.11187bfcbd74.00000000000001d2:head# 2024-09-12T05:22:37.264 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{11=[11]} 2024-09-12T05:22:37.265 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7e09798b:::rbd_data.1118b49023bd.0000000000000120:head# 2024-09-12T05:22:37.265 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 18=[]:{} 2024-09-12T05:22:37.267 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7e4a5550:::rbd_data.11185d53c886.000000000000003c:head# 2024-09-12T05:22:37.267 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.268 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7e4aee8d:::rbd_data.1118bf17036a.0000000000000007:12# 2024-09-12T05:22:37.271 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7e4aee8d:::rbd_data.1118bf17036a.0000000000000007:head# 2024-09-12T05:22:37.272 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 12=[]:{12=[12]} 2024-09-12T05:22:37.272 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7e58b7c2:::rbd_data.11186ec76cc4.0000000000000000:head# 2024-09-12T05:22:37.273 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 0=[]:{} 2024-09-12T05:22:37.277 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7e7d490f:::rbd_data.11187bfcbd74.000000000000020b:head# 2024-09-12T05:22:37.277 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.278 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7eb6cbd2:::rbd_data.1118d53b39e7.0000000000000043:head# 2024-09-12T05:22:37.278 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 23=[]:{} 2024-09-12T05:22:37.279 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7eed9c89:::rbd_data.11187bfcbd74.00000000000002f3:head# 2024-09-12T05:22:37.279 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.280 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7f377129:::rbd_data.11187bfcbd74.000000000000024e:head# 2024-09-12T05:22:37.280 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.280 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7f52c724:::rbd_data.1118f6d14695.0000000000000003:9# 2024-09-12T05:22:37.290 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7f52c724:::rbd_data.1118f6d14695.0000000000000003:head# 2024-09-12T05:22:37.291 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 9=[]:{9=[9]} 2024-09-12T05:22:37.300 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7f599d49:::rbd_data.11187bfcbd74.0000000000000234:head# 2024-09-12T05:22:37.300 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.302 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7f6437c3:::rbd_data.1118e5842253.0000000000000061:7# 2024-09-12T05:22:37.303 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7f6437c3:::rbd_data.1118e5842253.0000000000000061:head# 2024-09-12T05:22:37.303 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 7=[]:{7=[7]} 2024-09-12T05:22:37.303 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7f77eab9:::rbd_data.11187bfcbd74.000000000000014c:head# 2024-09-12T05:22:37.304 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 11=[]:{} 2024-09-12T05:22:37.304 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7fe6bb71:::rbd_data.1118a2459872.000000000000008e:17# 2024-09-12T05:22:37.306 INFO:teuthology.orchestra.run.smithi059.stdout:Write #3:7fe6bb71:::rbd_data.1118a2459872.000000000000008e:head# 2024-09-12T05:22:37.306 INFO:teuthology.orchestra.run.smithi059.stdout:snapset 17=[]:{17=[17]} 2024-09-12T05:22:37.307 INFO:teuthology.orchestra.run.smithi059.stdout:write_pg epoch 129 info 3.1e( v 127'340 (0'0,127'340] local-lis/les=42/43 n=62 ec=23/23 lis/c=42/42 les/c/f=43/43/0 sis=42) 2024-09-12T05:22:37.309 INFO:teuthology.orchestra.run.smithi059.stdout:Import successful 2024-09-12T05:22:37.318 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:37.319+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:37.331 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:37.331 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:37.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:37.419 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:37.419+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:37.514 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:37.514 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:37.520 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:37.519+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:37.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:37.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:37.621 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:37.623+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:37.650 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:37.650 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:37.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:37.722 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:37.722+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:37.724 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:37.724 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:37.741 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:37.741 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:37.760 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:37.760 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:37.780 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 136.81643369299999, 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:22:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 131.90480137599999, 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:22:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 131.522100892, 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:22:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:22:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:22:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 131.288057245, 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:22:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:22:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 131.25793291400001, 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:22:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 130.69584513300001, 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:22:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 130.693890915, 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:22:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 121.75258218099999, 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:22:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:22:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19619 3.9 e43/23 3:963deddc:::rbd_data.1118d7e09baf.00000000000000ea:head v 43'89, mlcod=43'86)", 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 121.73598558800001, 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053469199999999998, 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059709+0000", 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059710+0000", 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0500000000000002e-07 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059716+0000", 2024-09-12T05:22:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059729+0000", 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3269e-05 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059737+0000", 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6389999999999992e-06 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059794+0000", 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7030000000000001e-05 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.059817+0000", 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3459999999999999e-05 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065001+0000", 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051837819999999996 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.065056+0000", 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4802999999999997e-05 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 120.565646148, 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:22:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 112.687191896, 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:22:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 112.687146802, 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:22:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 112.67858524099999, 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:22:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 107.876547082, 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:22:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.362423644, 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:22:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.354337552, 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:22:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:22:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.452151305000001, 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:22:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:75257 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 84.474751384000001, 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054068670000000001, 2024-09-12T05:22:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 75257 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320943+0000", 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320944+0000", 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.879999999999999e-07 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320951+0000", 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4219999999999997e-06 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320968+0000", 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7081000000000001e-05 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.320979+0000", 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1219999999999999e-05 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321082+0000", 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103353 2024-09-12T05:22:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.321087+0000", 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326088+0000", 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050014209999999998 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326160+0000", 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1921999999999993e-05 2024-09-12T05:22:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.326350+0000", 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018963199999999999 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 83.722604403999995, 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:22:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:22:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 78.363354673000003, 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:22:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:22:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:37.886 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:37.887 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:37.887 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:37.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:37.888 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:37.889 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:37.889 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:37.889 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:37.890 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:37.890 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:37.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /var/log/ceph/exp.3.1e.3 2024-09-12T05:22:37.891 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:37.886+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:37.989 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:37.991+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:38.041 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:38.041 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:38.041 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:38.041 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:38.055 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:38.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:38.099+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:38.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:38.191+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:38.232 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:38.233 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:38.247 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:38.290 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:38.290+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:38.391 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:38.390+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:38.414 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:38.414 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:38.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:38.414 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:38.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.414 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.414 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.911432892999997, 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.418 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.911401243999997, 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.419 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.911365101000001, 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.423 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:38.427 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.911334291000003, 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:38.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.431 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.911303732, 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:22:38.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.911273835999999, 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.436 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:38.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.909516893000003, 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:22:38.444 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.909473323999997, 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.445 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:22:38.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:22:38.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.909241434000002, 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:22:38.449 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.453 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.909120522999999, 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:22:38.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.909003485, 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:22:38.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:22:38.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.908883877000001, 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:22:38.462 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.466 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.905905150000002, 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.905870843999999, 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:22:38.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.905838668000001, 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:38.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:22:38.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.905777051999998, 2024-09-12T05:22:38.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:22:38.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:22:38.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.905721696000001, 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:22:38.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:22:38.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.905666889999999, 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:22:38.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:22:38.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:22:38.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.905507215999997, 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:22:38.493 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:22:38.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115892 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_name in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118)", 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 24.190325689000002, 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.54022301299999997, 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115892 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223292+0000", 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2639999999999998e-06 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223302+0000", 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8959999999999998e-06 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223325+0000", 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-05 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223459+0000", 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013345300000000001 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223539+0000", 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0346000000000006e-05 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223552+0000", 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3264e-05 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763244+0000", 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.53969141899999995 2024-09-12T05:22:38.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763377+0000", 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013312999999999999 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763513+0000", 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013600099999999999 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:38.502 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:38.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:38.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:38.503+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:38.604 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:38.606+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:38.675 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:38.675 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:38.689 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:38.736 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:38.739+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:38.807 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:38.807 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:38.807 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:38.807 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:38.807 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:38.808 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:38.807+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:38.821 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:38.908 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:38.911+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:38.987 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:22:38.998 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:38.998 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.82483838900001, 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:38.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:39.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:22:39.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.003 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.824136869, 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:22:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:22:39.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.009 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.824014135, 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.010 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:22:39.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.82395192200001, 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.015 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:22:39.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823885105, 2024-09-12T05:22:39.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:22:39.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:22:39.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:22:39.025 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.82382507200001, 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.026 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:39.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:22:39.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:22:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823745136, 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:22:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823685575, 2024-09-12T05:22:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:22:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823610786, 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823473386, 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:22:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:22:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823321651, 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:22:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:22:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:22:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823258677, 2024-09-12T05:22:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:22:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823122785, 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.823058825, 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:22:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.82297457200001, 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:22:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:22:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.822915212, 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.822854945, 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:22:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:22:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.822791952, 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:22:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 118.822631344, 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:22:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:22:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.379399629999995, 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:22:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:22:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:22:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.099 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:39.101 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:39.101 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:39.103+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:39.201 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:39.203+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:39.282 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:39.282 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:39.282 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:39.282 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:39.296 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:39.303 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:39.302+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:39.403 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:39.403+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:39.461 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:39.461 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:39.462 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:39.475 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:39.504 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:39.502+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:39.605 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:39.607+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:39.636 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:39.636 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:39.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.396511396999998, 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:22:39.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:22:39.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:22:39.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.395497675000001, 2024-09-12T05:22:39.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:39.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:22:39.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.394803813999999, 2024-09-12T05:22:39.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:39.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:22:39.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.391818970999999, 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.391577646000002, 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:22:39.660 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:22:39.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:22:39.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.390829435999997, 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.666 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:22:39.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:22:39.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.390517674999998, 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:22:39.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.389794713999997, 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.677 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:22:39.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:22:39.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.388495794999997, 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:22:39.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:22:39.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.385944041000002, 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.689 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:22:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:22:39.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.385165551, 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:39.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:22:39.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.384893210000001, 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.701 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:22:39.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:22:39.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.383616924000002, 2024-09-12T05:22:39.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:22:39.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:22:39.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.382214308000002, 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:39.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:22:39.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:22:39.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.381498807, 2024-09-12T05:22:39.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:22:39.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.724 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.380177410999998, 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:22:39.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:22:39.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.379100766000001, 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:22:39.730 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:22:39.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:22:39.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.378878022000002, 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:22:39.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:22:39.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.378256983, 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:22:39.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.376608849999997, 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:39.747 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:22:39.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:39.753 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:39.755 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:39.755 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:39.754+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:39.855 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:39.854+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:39.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:39.923 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:39.923 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:39.924 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:39.924 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:39.937 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:22:39.988 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:39.991+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:40.057 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:40.058+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:40.059 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:40.071 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:40.072 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:40.072 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:40.072 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:40.072 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:40.076 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:40.076 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:40.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:40.095 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:40.095 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:40.095 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:40.116 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:40.137 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:40.157 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:40.158 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:40.158+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:40.176 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:40.181 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:40.181 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:40.256 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:40.256 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:40.258 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:40.259+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:40.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:40.360 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:40.358+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:40.402 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:40.402 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:40.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:40.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:40.463+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:40.562 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:40.563+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:40.581 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:40.581 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:40.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:40.662 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:40.662+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:40.721 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:40.722 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:40.736 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:40.777 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:40.778+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:40.864 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:40.862+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:40.907 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:40.907 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:40.922 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:40.965 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:40.967+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:41.067 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:41.066+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:41.097 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:41.097 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:41.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:41.205 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:41.206+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:41.268 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:41.271+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:41.285 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:41.285 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:41.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:41.369 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:41.371+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:41.470 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:41.470+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:41.474 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:41.474 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:41.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:41.572 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:41.571+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:41.660 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:41.660 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:41.673 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:41.674+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:41.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:41.773 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:41.774+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:41.843 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:41.860 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:41.901 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:41.902+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:41.975 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:41.975+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:41.993 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:41.993 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:42.010 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:42.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:22:42.075 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:42.074+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:42.176 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:42.179+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:42.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:42.192 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:42.193 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:42.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:42.296 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:42.299+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:42.326 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:42.326 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:42.343 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:42.360 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:42.361 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:42.361 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:42.375 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:42.375 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:42.378 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:42.378+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:42.381 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:42.381 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:42.389 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:42.402 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:42.402 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:42.420 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:42.420 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:42.440 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:42.440 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:42.444 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:42.445 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:42.480 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:42.483+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:42.554 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:42.554 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:42.554 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:42.554 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:42.568 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:42.580 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:42.578+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:42.681 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:42.682+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:42.735 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:42.735 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:42.736 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:42.736 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:42.736 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:42.750 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:42.782 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:42.782+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:42.881 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:42.881 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:42.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:42.881 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:42.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.881 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.705941305, 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:22:42.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:22:42.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:42.886 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.705239785, 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:42.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:22:42.890 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.705117051, 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:22:42.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:42.895 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.705054838, 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.899 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.70498802100001, 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:22:42.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.70492798799999, 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:22:42.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:42.909 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.704848052, 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:22:42.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.704788491, 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.914 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:22:42.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:22:42.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.70471370200001, 2024-09-12T05:22:42.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:42.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:22:42.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.70457630200001, 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:22:42.924 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:22:42.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:22:42.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.928 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.704424567, 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.704361593, 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:22:42.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.704225701, 2024-09-12T05:22:42.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:22:42.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:22:42.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:22:42.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:22:42.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:22:42.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.943 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.70416174099999, 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:22:42.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.949 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.949 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:42.949 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.704077488, 2024-09-12T05:22:42.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:22:42.949 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.949 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:22:42.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:22:42.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:22:42.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:22:42.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:22:42.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:22:42.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:22:42.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:22:42.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:22:42.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:22:42.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.956 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.704018128, 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:22:42.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:22:42.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:22:42.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.961 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.70395786100001, 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:22:42.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:22:42.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:22:42.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:22:42.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:22:42.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:22:42.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:42.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:22:42.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:22:42.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:22:42.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:22:42.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:22:42.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:22:42.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.968 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.969 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.969 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:42.969 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.70389486800001, 2024-09-12T05:22:42.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:22:42.969 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.970 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.970 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.970 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:22:42.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.971 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:42.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:42.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:22:42.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:22:42.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:22:42.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:22:42.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:22:42.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:22:42.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:22:42.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:22:42.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:22:42.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:22:42.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:22:42.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:22:42.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:22:42.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:22:42.978 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.978 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.979 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.979 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:42.979 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:42.979 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 122.70373426, 2024-09-12T05:22:42.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:22:42.980 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.980 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.980 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:42.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:42.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:42.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:42.981 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:22:42.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.981 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:42.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:42.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:22:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.260502545999998, 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:22:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:42.990 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:42.991 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6, 2] out_osds: [] dead_osds: [3] live_osds: [0, 1, 2, 5, 6, 7, 4] 2024-09-12T05:22:42.991 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:22:42.991 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T05:22:42.991 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T05:22:42.993 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:42.990+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:42.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:22:43.092 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:43.095+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:43.137 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:43.137 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:43.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.138 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:119979 3.b e147/127 3:d4d4bddd:::rbd_header.11185d53c886:head v 147'450, mlcod=147'448)", 2024-09-12T05:22:43.138 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:43.139342+0000", 2024-09-12T05:22:43.138 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.000273322, 2024-09-12T05:22:43.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000301668, 2024-09-12T05:22:43.138 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.138 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.139 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:43.139 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.139342+0000", 2024-09-12T05:22:43.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.139342+0000", 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.139344+0000", 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7430000000000001e-06 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.139354+0000", 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0557000000000001e-05 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.139380+0000", 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5969000000000002e-05 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.139393+0000", 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2207e-05 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.139469+0000", 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6210000000000004e-05 2024-09-12T05:22:43.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.139496+0000", 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7152e-05 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-09-12T05:22:43.143 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:43.156 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:43.200 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:43.203+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:43.293 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:43.294+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:43.323 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:43.323 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:43.323 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:43.323 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:43.323 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:43.327 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:22:43.327 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:43.327 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 147, 2024-09-12T05:22:43.327 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "68a6e7bb-cbcb-48c0-a793-81ba84559d97", 2024-09-12T05:22:43.327 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2024-09-12T05:19:39.984405+0000", 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2024-09-12T05:22:43.003290+0000", 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2024-09-12T05:22:25.840900+0000", 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2024-09-12T05:21:38.885631+0000", 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5799936, 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2024-09-12T05:22:43.328 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2024-09-12T05:22:43.329 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:43.329 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 6, 2024-09-12T05:22:43.329 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T05:22:43.329 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T05:22:43.329 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T05:22:43.329 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2024-09-12T05:22:43.329 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 3, 2024-09-12T05:22:43.329 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 8, 2024-09-12T05:22:43.330 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "luminous", 2024-09-12T05:22:43.330 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "luminous", 2024-09-12T05:22:43.330 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "squid", 2024-09-12T05:22:43.330 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2024-09-12T05:22:43.330 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2024-09-12T05:22:43.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.330 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2024-09-12T05:22:43.331 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2024-09-12T05:22:43.331 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:52.945109+0000", 2024-09-12T05:22:43.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-12T05:22:43.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2024-09-12T05:22:43.331 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:22:43.331 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:22:43.331 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:22:43.332 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:22:43.332 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:22:43.332 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:22:43.332 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:22:43.332 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:22:43.332 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:22:43.333 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:22:43.333 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:22:43.333 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2024-09-12T05:22:43.333 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2024-09-12T05:22:43.333 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2024-09-12T05:22:43.334 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2024-09-12T05:22:43.334 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2024-09-12T05:22:43.334 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:22:43.334 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:22:43.334 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:22:43.334 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:22:43.335 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:22:43.335 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:22:43.335 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:22:43.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.336 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "18", 2024-09-12T05:22:43.336 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:22:43.336 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:22:43.336 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:22:43.336 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:22:43.336 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:22:43.337 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2024-09-12T05:22:43.337 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2024-09-12T05:22:43.337 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:22:43.337 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:22:43.337 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:22:43.337 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:22:43.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:22:43.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:22:43.338 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:22:43.338 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:22:43.338 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:22:43.338 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:22:43.339 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:22:43.339 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:22:43.339 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:22:43.339 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:22:43.339 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:22:43.340 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:22:43.340 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:22:43.340 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:22:43.340 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:22:43.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.341 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:22:43.341 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:22:43.341 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:22:43.342 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:22:43.342 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:22:43.342 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:22:43.342 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:22:43.343 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:22:43.343 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:22:43.343 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:22:43.343 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:22:43.344 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2024-09-12T05:22:43.344 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2024-09-12T05:22:43.345 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2024-09-12T05:22:43.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.345 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:22:43.345 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {} 2024-09-12T05:22:43.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.346 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:22:43.346 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:22:43.346 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 8, 2024-09-12T05:22:43.346 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 8, 2024-09-12T05:22:43.346 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.25, 2024-09-12T05:22:43.346 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2024-09-12T05:22:43.347 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2024-09-12T05:22:43.347 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:22:43.347 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:22:43.347 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:22:43.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.348 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2024-09-12T05:22:43.348 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2024-09-12T05:22:43.348 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:19:58.280650+0000", 2024-09-12T05:22:43.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:22:43.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:22:43.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:22:43.349 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:22:43.349 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:22:43.349 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:22:43.350 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:22:43.350 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:22:43.350 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:22:43.350 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:22:43.351 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:22:43.351 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:22:43.351 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:22:43.351 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2024-09-12T05:22:43.351 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2024-09-12T05:22:43.351 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2024-09-12T05:22:43.352 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2024-09-12T05:22:43.352 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2024-09-12T05:22:43.352 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:22:43.352 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:22:43.352 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:22:43.352 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:22:43.353 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:22:43.353 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:22:43.353 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:22:43.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.353 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "22", 2024-09-12T05:22:43.353 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:22:43.354 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:22:43.354 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:22:43.354 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:22:43.354 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:22:43.354 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 2, 2024-09-12T05:22:43.355 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 22, 2024-09-12T05:22:43.355 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:22:43.356 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:22:43.356 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:22:43.356 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:22:43.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:22:43.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:22:43.356 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:22:43.356 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:22:43.357 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:22:43.357 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:22:43.357 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:22:43.357 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:22:43.357 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:22:43.357 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:22:43.358 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:22:43.358 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:22:43.358 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:22:43.358 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:22:43.358 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:22:43.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.358 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:22:43.359 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:22:43.360 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:22:43.360 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:22:43.360 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:22:43.360 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:22:43.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.360 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.9900000095367432, 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.9900000095367432, 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "pool_client.0", 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2024-09-12T05:20:08.800004+0000", 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 8193, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T05:22:43.362 INFO:teuthology.orchestra.run.smithi059.stdout: "is_stretch_pool": false, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2024-09-12T05:22:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "147", 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 46, 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 147, 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2024-09-12T05:22:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2024-09-12T05:22:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2024-09-12T05:22:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "score_type": "Fair distribution", 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.9900000095367432, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.9900000095367432, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.87999999523162842, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.75, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.75, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 0.97544097900390625, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-12T05:22:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "7c94de5b-39f6-4915-ba6c-e8cccd9102af", 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 0.80352783203125, 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 130, 2024-09-12T05:22:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6816", 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6817", 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6818", 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6819", 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6822", 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6823", 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6820", 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6821", 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3837229352 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6817/3837229352", 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6819/3837229352", 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6823/3837229352", 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6821/3837229352", 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "42bc191c-bc62-4ba4-a60c-609e883f33bb", 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 130, 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1576154773 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6801/1576154773", 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6803/1576154773", 2024-09-12T05:22:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/1576154773", 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6805/1576154773", 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0ce3483f-c255-4b55-bc06-cd54783301c8", 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 106, 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6824", 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6825", 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6826", 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6827", 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6830", 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6831", 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6828", 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6829", 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3725088694 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6825/3725088694", 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6827/3725088694", 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6831/3725088694", 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6829/3725088694", 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "0b8c307c-b876-4aa3-82a6-f5e63033e353", 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 0, 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 74, 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 130, 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 167605601 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6809/167605601", 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6811/167605601", 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/167605601", 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6813/167605601", 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "exists" 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "592feb7f-d1f9-420a-9fef-7110c6ac9882", 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 14, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 58, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 114, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 118, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 60, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6824", 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6825", 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6826", 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6827", 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6830", 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6831", 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6828", 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6829", 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1662122460 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6825/1662122460", 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6827/1662122460", 2024-09-12T05:22:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1662122460", 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6829/1662122460", 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fb43b395-e414-42b5-8c6c-4cd0926662c0", 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 130, 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6800", 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6801", 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6802", 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6803", 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6806", 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6807", 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6804", 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6805", 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1911143418 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6801/1911143418", 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6803/1911143418", 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6807/1911143418", 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6805/1911143418", 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fd8d0fb3-58c5-43dc-bdce-6505505e3491", 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 130, 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6816", 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6817", 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6818", 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6819", 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6822", 2024-09-12T05:22:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6823", 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6820", 2024-09-12T05:22:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6821", 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 90490456 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6817/90490456", 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6819/90490456", 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6823/90490456", 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6821/90490456", 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "dd5da5cd-7d54-4812-b630-23ccf2c82c8e", 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 0, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 0, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 14, 2024-09-12T05:22:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 130, 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 0, 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6808", 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6809", 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6810", 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6811", 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6814", 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6815", 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6812", 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.194:6813", 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2109956055 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.194:6809/2109956055", 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.194:6811/2109956055", 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2109956055", 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2109956055", 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2024-09-12T05:22:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.291372+0000", 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.699928+0000", 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.078333+0000", 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.878139+0000", 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 130 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 4, 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.129610+0000", 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 60 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 5, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.515195+0000", 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 6, 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:49.266450+0000", 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 7, 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540719139924082687, 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2024-09-12T05:19:48.961964+0000", 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [ 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.9", 2024-09-12T05:22:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: 0, 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: 2 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [ 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.1", 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 6 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "2.4", 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 0, 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 4 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.b", 2024-09-12T05:22:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 0, 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 7 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 6 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.f", 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 4, 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "3.15", 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 1 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [], 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": {}, 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2024-09-12T05:22:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [ 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "snaps": [ 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "begin": 21, 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "length": 16 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [ 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "snaps": [ 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "begin": 21, 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "length": 1 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2024-09-12T05:22:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2024-09-12T05:22:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2024-09-12T05:22:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2024-09-12T05:22:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2024-09-12T05:22:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2024-09-12T05:22:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2024-09-12T05:22:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2024-09-12T05:22:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:43.428 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:43.430 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:43.431 INFO:tasks.thrashosds.thrasher:j is {'epoch': 147, 'fsid': '68a6e7bb-cbcb-48c0-a793-81ba84559d97', 'created': '2024-09-12T05:19:39.984405+0000', 'modified': '2024-09-12T05:22:43.003290+0000', 'last_up_change': '2024-09-12T05:22:25.840900+0000', 'last_in_change': '2024-09-12T05:21:38.885631+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T05:19:52.945109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T05:19:58.280650+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-12T05:20:08.800004+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 46, 'snap_epoch': 147, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9754409790039062, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': '7c94de5b-39f6-4915-ba6c-e8cccd9102af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.80352783203125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6816', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3837229352}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6818', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6819', 'nonce': 3837229352}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6822', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6823', 'nonce': 3837229352}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6820', 'nonce': 3837229352}, {'type': 'v1', 'addr': '172.21.15.59:6821', 'nonce': 3837229352}]}, 'public_addr': '172.21.15.59:6817/3837229352', 'cluster_addr': '172.21.15.59:6819/3837229352', 'heartbeat_back_addr': '172.21.15.59:6823/3837229352', 'heartbeat_front_addr': '172.21.15.59:6821/3837229352', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '42bc191c-bc62-4ba4-a60c-609e883f33bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6801', 'nonce': 1576154773}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6803', 'nonce': 1576154773}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6807', 'nonce': 1576154773}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 1576154773}, {'type': 'v1', 'addr': '172.21.15.59:6805', 'nonce': 1576154773}]}, 'public_addr': '172.21.15.59:6801/1576154773', 'cluster_addr': '172.21.15.59:6803/1576154773', 'heartbeat_back_addr': '172.21.15.59:6807/1576154773', 'heartbeat_front_addr': '172.21.15.59:6805/1576154773', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ce3483f-c255-4b55-bc06-cd54783301c8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6824', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6825', 'nonce': 3725088694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6826', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6827', 'nonce': 3725088694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6830', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6831', 'nonce': 3725088694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6828', 'nonce': 3725088694}, {'type': 'v1', 'addr': '172.21.15.59:6829', 'nonce': 3725088694}]}, 'public_addr': '172.21.15.59:6825/3725088694', 'cluster_addr': '172.21.15.59:6827/3725088694', 'heartbeat_back_addr': '172.21.15.59:6831/3725088694', 'heartbeat_front_addr': '172.21.15.59:6829/3725088694', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b8c307c-b876-4aa3-82a6-f5e63033e353', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 74, 'down_at': 130, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6809', 'nonce': 167605601}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6811', 'nonce': 167605601}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6815', 'nonce': 167605601}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 167605601}, {'type': 'v1', 'addr': '172.21.15.59:6813', 'nonce': 167605601}]}, 'public_addr': '172.21.15.59:6809/167605601', 'cluster_addr': '172.21.15.59:6811/167605601', 'heartbeat_back_addr': '172.21.15.59:6815/167605601', 'heartbeat_front_addr': '172.21.15.59:6813/167605601', 'state': ['exists']}, {'osd': 4, 'uuid': '592feb7f-d1f9-420a-9fef-7110c6ac9882', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 58, 'up_from': 114, 'up_thru': 118, 'down_at': 60, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 1662122460}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 1662122460}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 1662122460}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 1662122460}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 1662122460}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 1662122460}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 1662122460}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 1662122460}]}, 'public_addr': '172.21.15.194:6825/1662122460', 'cluster_addr': '172.21.15.194:6827/1662122460', 'heartbeat_back_addr': '172.21.15.194:6831/1662122460', 'heartbeat_front_addr': '172.21.15.194:6829/1662122460', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'fb43b395-e414-42b5-8c6c-4cd0926662c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 1911143418}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 1911143418}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 1911143418}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 1911143418}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 1911143418}]}, 'public_addr': '172.21.15.194:6801/1911143418', 'cluster_addr': '172.21.15.194:6803/1911143418', 'heartbeat_back_addr': '172.21.15.194:6807/1911143418', 'heartbeat_front_addr': '172.21.15.194:6805/1911143418', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'fd8d0fb3-58c5-43dc-bdce-6505505e3491', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 90490456}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 90490456}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 90490456}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 90490456}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 90490456}]}, 'public_addr': '172.21.15.194:6817/90490456', 'cluster_addr': '172.21.15.194:6819/90490456', 'heartbeat_back_addr': '172.21.15.194:6823/90490456', 'heartbeat_front_addr': '172.21.15.194:6821/90490456', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dd5da5cd-7d54-4812-b630-23ccf2c82c8e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2109956055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2109956055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2109956055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2109956055}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2109956055}]}, 'public_addr': '172.21.15.194:6809/2109956055', 'cluster_addr': '172.21.15.194:6811/2109956055', 'heartbeat_back_addr': '172.21.15.194:6815/2109956055', 'heartbeat_front_addr': '172.21.15.194:6813/2109956055', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.291372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.699928+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.078333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.878139+0000', 'dead_epoch': 130}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.129610+0000', 'dead_epoch': 60}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.515195+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:49.266450+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T05:19:48.961964+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.9', 'osds': [0, 2]}], 'pg_upmap_items': [{'pgid': '2.1', 'mappings': [{'from': 3, 'to': 6}]}, {'pgid': '2.4', 'mappings': [{'from': 0, 'to': 4}]}, {'pgid': '3.b', 'mappings': [{'from': 0, 'to': 7}, {'from': 3, 'to': 6}]}, {'pgid': '3.f', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '3.15', 'mappings': [{'from': 3, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 21, 'length': 16}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 21, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T05:22:43.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:22:43.432 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:43.430+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:43.530 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:43.530+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:43.563 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.323812156999999, 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.564 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:43.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.322798435000003, 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.570 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:43.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:22:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.322104574000001, 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:22:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.319119731000001, 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:22:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.318878406000003, 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:22:43.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:22:43.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.318130195999998, 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.592 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.317818435, 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:22:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:22:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.317095473999998, 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:22:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:22:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.315796554999999, 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.609 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:22:43.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:22:43.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.313244801000003, 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.614 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:43.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.619 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.312466311000001, 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:22:43.624 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.312193970000003, 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:22:43.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:22:43.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.310917684000003, 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:22:43.630 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:22:43.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.309515068000003, 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:22:43.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:22:43.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.641 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.308799567000001, 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:22:43.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.307478171, 2024-09-12T05:22:43.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:22:43.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:22:43.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.306401526000002, 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:22:43.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:22:43.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.306178782000003, 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:43.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.663 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.305557743000001, 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:22:43.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:22:43.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 57.303909609999998, 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:43.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:43.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:22:43.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:43.675 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:43.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:43.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:43.679+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:43.778 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:43.778+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:43.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:22:43.792 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:22:43.811 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-09-12T05:22:43.009405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":688537165,"num_objects":1828,"num_object_clones":297,"num_object_copies":3656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":456,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1828,"num_whiteouts":1161,"num_read":155889,"num_read_kb":926840,"num_write":22792,"num_write_kb":471881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1524,"num_bytes_recovered":122842216,"num_keys_recovered":328,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19339,"ondisk_log_size":19339,"up":74,"acting":74,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":785260,"kb_used_data":414352,"kb_used_omap":38,"kb_used_meta":366169,"kb_avail":754189460,"statfs":{"total":773094113280,"available":772290007040,"internally_reserved":0,"allocated":424296448,"data_stored":529434117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39006,"internal_metadata":374957986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-283962123,"num_objects":-119,"num_object_clones":-31,"num_object_copies":-238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-119,"num_whiteouts":-27,"num_read":1280,"num_read_kb":1089,"num_write":211,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.037052"},"pg_stats":[{"pgid":"3.1f","version":"145'422","reported_seq":8840,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.000696+0000","last_change":"2024-09-12T05:22:42.002527+0000","last_active":"2024-09-12T05:22:42.000696+0000","last_peered":"2024-09-12T05:22:42.000696+0000","last_clean":"2024-09-12T05:22:42.000696+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:22:42.000696+0000","last_undegraded":"2024-09-12T05:22:42.000696+0000","last_fullsized":"2024-09-12T05:22:42.000696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.646499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032158759999999999,"stat_sum":{"num_bytes":21647380,"num_objects":69,"num_object_clones":15,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":41,"num_read":9337,"num_read_kb":33713,"num_write":402,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.1e","version":"141'344","reported_seq":7612,"reported_epoch":146,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:22:41.995766+0000","last_change":"2024-09-12T05:22:26.871885+0000","last_active":"2024-09-12T05:22:41.995766+0000","last_peered":"2024-09-12T05:22:41.995766+0000","last_clean":"2024-09-12T05:22:23.087865+0000","last_became_active":"2024-09-12T05:22:26.871885+0000","last_became_peered":"2024-09-12T05:22:26.871885+0000","last_unstale":"2024-09-12T05:22:41.995766+0000","last_undegraded":"2024-09-12T05:22:26.869943+0000","last_fullsized":"2024-09-12T05:22:26.869812+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":15,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:11.525595+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.022968591999999999,"stat_sum":{"num_bytes":49883194,"num_objects":58,"num_object_clones":12,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":58,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":36,"num_read":7022,"num_read_kb":84717,"num_write":376,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":58}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"145'693","reported_seq":3712,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.038176+0000","last_change":"2024-09-12T05:22:42.038176+0000","last_active":"2024-09-12T05:22:42.038176+0000","last_peered":"2024-09-12T05:22:42.038176+0000","last_clean":"2024-09-12T05:22:42.038176+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:22:42.038176+0000","last_undegraded":"2024-09-12T05:22:42.038176+0000","last_fullsized":"2024-09-12T05:22:42.038176+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:12:28.656408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090475099999999997,"stat_sum":{"num_bytes":3720258,"num_objects":56,"num_object_clones":9,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":34,"num_read":4986,"num_read_kb":8692,"num_write":816,"num_write_kb":5145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.1c","version":"145'670","reported_seq":5274,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.075163+0000","last_change":"2024-09-12T05:22:42.038000+0000","last_active":"2024-09-12T05:22:42.075163+0000","last_peered":"2024-09-12T05:22:42.075163+0000","last_clean":"2024-09-12T05:22:42.075163+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:22:42.075163+0000","last_undegraded":"2024-09-12T05:22:42.075163+0000","last_fullsized":"2024-09-12T05:22:42.075163+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:20.085061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187649,"stat_sum":{"num_bytes":12341810,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":38,"num_read":6277,"num_read_kb":39459,"num_write":725,"num_write_kb":9581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.1b","version":"145'677","reported_seq":3812,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.000182+0000","last_change":"2024-09-12T05:22:42.000182+0000","last_active":"2024-09-12T05:22:42.000182+0000","last_peered":"2024-09-12T05:22:42.000182+0000","last_clean":"2024-09-12T05:22:42.000182+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:22:42.000182+0000","last_undegraded":"2024-09-12T05:22:42.000182+0000","last_fullsized":"2024-09-12T05:22:42.000182+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:43.662822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038153309999999999,"stat_sum":{"num_bytes":14432248,"num_objects":58,"num_object_clones":8,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":42,"num_read":4932,"num_read_kb":38662,"num_write":717,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.1a","version":"143'391","reported_seq":5255,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-12T05:22:39.205124+0000","last_change":"2024-09-12T05:22:38.997766+0000","last_active":"2024-09-12T05:22:39.205124+0000","last_peered":"2024-09-12T05:22:39.205124+0000","last_clean":"2024-09-12T05:22:39.205124+0000","last_became_active":"2024-09-12T05:22:14.218619+0000","last_became_peered":"2024-09-12T05:22:14.218619+0000","last_unstale":"2024-09-12T05:22:39.205124+0000","last_undegraded":"2024-09-12T05:22:39.205124+0000","last_fullsized":"2024-09-12T05:22:39.205124+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:02.286946+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.022979737,"stat_sum":{"num_bytes":5293669,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":38,"num_read":5588,"num_read_kb":30802,"num_write":353,"num_write_kb":18470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":16982768,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"c"}]},{"pgid":"3.19","version":"144'418","reported_seq":3835,"reported_epoch":146,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:22:41.997105+0000","last_change":"2024-09-12T05:22:26.863666+0000","last_active":"2024-09-12T05:22:41.997105+0000","last_peered":"2024-09-12T05:22:41.997105+0000","last_clean":"2024-09-12T05:22:24.794820+0000","last_became_active":"2024-09-12T05:22:26.863666+0000","last_became_peered":"2024-09-12T05:22:26.863666+0000","last_unstale":"2024-09-12T05:22:41.997105+0000","last_undegraded":"2024-09-12T05:22:26.861926+0000","last_fullsized":"2024-09-12T05:22:26.861818+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":15,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:09.026324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001214873,"stat_sum":{"num_bytes":11250332,"num_objects":58,"num_object_clones":6,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":58,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":38,"num_read":3853,"num_read_kb":33304,"num_write":380,"num_write_kb":5072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":58}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"145'601","reported_seq":3412,"reported_epoch":146,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:22:41.995672+0000","last_change":"2024-09-12T05:22:26.869921+0000","last_active":"2024-09-12T05:22:41.995672+0000","last_peered":"2024-09-12T05:22:41.995672+0000","last_clean":"2024-09-12T05:22:22.848317+0000","last_became_active":"2024-09-12T05:22:26.869921+0000","last_became_peered":"2024-09-12T05:22:26.869921+0000","last_unstale":"2024-09-12T05:22:41.995672+0000","last_undegraded":"2024-09-12T05:22:26.868759+0000","last_fullsized":"2024-09-12T05:22:26.868495+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":15,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:37.940356+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.016838002000000001,"stat_sum":{"num_bytes":15551264,"num_objects":59,"num_object_clones":13,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":59,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":38,"num_read":4728,"num_read_kb":22406,"num_write":566,"num_write_kb":11877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":59}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"144'628","reported_seq":2178,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.002295+0000","last_change":"2024-09-12T05:22:42.003866+0000","last_active":"2024-09-12T05:22:42.002295+0000","last_peered":"2024-09-12T05:22:42.002295+0000","last_clean":"2024-09-12T05:22:42.002295+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:22:42.002295+0000","last_undegraded":"2024-09-12T05:22:42.002295+0000","last_fullsized":"2024-09-12T05:22:42.002295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:39.100637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041816350000000004,"stat_sum":{"num_bytes":22316032,"num_objects":51,"num_object_clones":9,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":35,"num_read":3168,"num_read_kb":14871,"num_write":784,"num_write_kb":7475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.16","version":"144'521","reported_seq":6120,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.036969+0000","last_change":"2024-09-12T05:22:42.037477+0000","last_active":"2024-09-12T05:22:42.036969+0000","last_peered":"2024-09-12T05:22:42.036969+0000","last_clean":"2024-09-12T05:22:42.036969+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:22:42.036969+0000","last_undegraded":"2024-09-12T05:22:42.036969+0000","last_fullsized":"2024-09-12T05:22:42.036969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:52.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069359900000000004,"stat_sum":{"num_bytes":30761389,"num_objects":56,"num_object_clones":9,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":37,"num_read":6272,"num_read_kb":69644,"num_write":510,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.15","version":"145'383","reported_seq":2057,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.012796+0000","last_change":"2024-09-12T05:22:42.014403+0000","last_active":"2024-09-12T05:22:42.012796+0000","last_peered":"2024-09-12T05:22:42.012796+0000","last_clean":"2024-09-12T05:22:42.012796+0000","last_became_active":"2024-09-12T05:20:49.041294+0000","last_became_peered":"2024-09-12T05:20:49.041294+0000","last_unstale":"2024-09-12T05:22:42.012796+0000","last_undegraded":"2024-09-12T05:22:42.012796+0000","last_fullsized":"2024-09-12T05:22:42.012796+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:09.874922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024382129999999998,"stat_sum":{"num_bytes":15206597,"num_objects":53,"num_object_clones":11,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":29,"num_read":1771,"num_read_kb":12775,"num_write":421,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.14","version":"143'1173","reported_seq":5062,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-12T05:22:38.992751+0000","last_change":"2024-09-12T05:22:38.992751+0000","last_active":"2024-09-12T05:22:38.992751+0000","last_peered":"2024-09-12T05:22:38.992751+0000","last_clean":"2024-09-12T05:22:38.992751+0000","last_became_active":"2024-09-12T05:22:14.756246+0000","last_became_peered":"2024-09-12T05:22:14.756246+0000","last_unstale":"2024-09-12T05:22:38.992751+0000","last_undegraded":"2024-09-12T05:22:38.992751+0000","last_fullsized":"2024-09-12T05:22:38.992751+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:51.733796+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.018132586999999999,"stat_sum":{"num_bytes":18375916,"num_objects":65,"num_object_clones":6,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":38,"num_read":8366,"num_read_kb":38640,"num_write":1745,"num_write_kb":25337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":17251748,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"c"}]},{"pgid":"2.7","version":"0'0","reported_seq":216,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.995665+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:22:41.995665+0000","last_peered":"2024-09-12T05:22:41.995665+0000","last_clean":"2024-09-12T05:22:41.995665+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:22:41.995665+0000","last_undegraded":"2024-09-12T05:22:41.995665+0000","last_fullsized":"2024-09-12T05:22:41.995665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"145'748","reported_seq":2365,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.997192+0000","last_change":"2024-09-12T05:22:41.999543+0000","last_active":"2024-09-12T05:22:41.997192+0000","last_peered":"2024-09-12T05:22:41.997192+0000","last_clean":"2024-09-12T05:22:41.997192+0000","last_became_active":"2024-09-12T05:20:09.741300+0000","last_became_peered":"2024-09-12T05:20:09.741300+0000","last_unstale":"2024-09-12T05:22:41.997192+0000","last_undegraded":"2024-09-12T05:22:41.997192+0000","last_fullsized":"2024-09-12T05:22:41.997192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:47.831208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034301790000000002,"stat_sum":{"num_bytes":3161381,"num_objects":64,"num_object_clones":7,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":48,"num_read":2699,"num_read_kb":14087,"num_write":827,"num_write_kb":22025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"2.6","version":"0'0","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.998360+0000","last_change":"2024-09-12T05:20:33.943660+0000","last_active":"2024-09-12T05:22:41.998360+0000","last_peered":"2024-09-12T05:22:41.998360+0000","last_clean":"2024-09-12T05:22:41.998360+0000","last_became_active":"2024-09-12T05:20:33.943030+0000","last_became_peered":"2024-09-12T05:20:33.943030+0000","last_unstale":"2024-09-12T05:22:41.998360+0000","last_undegraded":"2024-09-12T05:22:41.998360+0000","last_fullsized":"2024-09-12T05:22:41.998360+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:11.076201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"145'402","reported_seq":3258,"reported_epoch":146,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:22:42.012366+0000","last_change":"2024-09-12T05:22:26.872718+0000","last_active":"2024-09-12T05:22:42.012366+0000","last_peered":"2024-09-12T05:22:42.012366+0000","last_clean":"2024-09-12T05:22:23.965639+0000","last_became_active":"2024-09-12T05:22:26.872718+0000","last_became_peered":"2024-09-12T05:22:26.872718+0000","last_unstale":"2024-09-12T05:22:42.012366+0000","last_undegraded":"2024-09-12T05:22:26.871109+0000","last_fullsized":"2024-09-12T05:22:26.871012+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":15,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:35.233547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040423619999999999,"stat_sum":{"num_bytes":39377365,"num_objects":54,"num_object_clones":11,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":54,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":32,"num_read":2842,"num_read_kb":54236,"num_write":447,"num_write_kb":24596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":54}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":266,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.012166+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:22:42.012166+0000","last_peered":"2024-09-12T05:22:42.012166+0000","last_clean":"2024-09-12T05:22:42.012166+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:22:42.012166+0000","last_undegraded":"2024-09-12T05:22:42.012166+0000","last_fullsized":"2024-09-12T05:22:42.012166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"140'691","reported_seq":3712,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.999456+0000","last_change":"2024-09-12T05:22:42.000898+0000","last_active":"2024-09-12T05:22:41.999456+0000","last_peered":"2024-09-12T05:22:41.999456+0000","last_clean":"2024-09-12T05:22:41.999456+0000","last_became_active":"2024-09-12T05:21:42.927006+0000","last_became_peered":"2024-09-12T05:21:42.927006+0000","last_unstale":"2024-09-12T05:22:41.999456+0000","last_undegraded":"2024-09-12T05:22:41.999456+0000","last_fullsized":"2024-09-12T05:22:41.999456+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:29.684183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025163609999999999,"stat_sum":{"num_bytes":23928913,"num_objects":55,"num_object_clones":8,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":34,"num_read":5058,"num_read_kb":22641,"num_write":757,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":11476389,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"2.4","version":"0'0","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.998754+0000","last_change":"2024-09-12T05:22:12.172861+0000","last_active":"2024-09-12T05:22:41.998754+0000","last_peered":"2024-09-12T05:22:41.998754+0000","last_clean":"2024-09-12T05:22:41.998754+0000","last_became_active":"2024-09-12T05:22:12.172516+0000","last_became_peered":"2024-09-12T05:22:12.172516+0000","last_unstale":"2024-09-12T05:22:41.998754+0000","last_undegraded":"2024-09-12T05:22:41.998754+0000","last_fullsized":"2024-09-12T05:22:41.998754+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:56.896612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"141'457","reported_seq":2538,"reported_epoch":146,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:22:42.037659+0000","last_change":"2024-09-12T05:22:26.873472+0000","last_active":"2024-09-12T05:22:42.037659+0000","last_peered":"2024-09-12T05:22:42.037659+0000","last_clean":"2024-09-12T05:22:24.767525+0000","last_became_active":"2024-09-12T05:22:26.873472+0000","last_became_peered":"2024-09-12T05:22:26.873472+0000","last_unstale":"2024-09-12T05:22:42.037659+0000","last_undegraded":"2024-09-12T05:22:26.871276+0000","last_fullsized":"2024-09-12T05:22:26.871017+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":15,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:18.893872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003022102,"stat_sum":{"num_bytes":17664010,"num_objects":40,"num_object_clones":5,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":40,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":26,"num_read":2585,"num_read_kb":20421,"num_write":578,"num_write_kb":10557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":40}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"143'562","reported_seq":4611,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-12T05:22:39.205672+0000","last_change":"2024-09-12T05:22:38.998143+0000","last_active":"2024-09-12T05:22:39.205672+0000","last_peered":"2024-09-12T05:22:39.205672+0000","last_clean":"2024-09-12T05:22:39.205672+0000","last_became_active":"2024-09-12T05:22:14.219295+0000","last_became_peered":"2024-09-12T05:22:14.219295+0000","last_unstale":"2024-09-12T05:22:39.205672+0000","last_undegraded":"2024-09-12T05:22:39.205672+0000","last_fullsized":"2024-09-12T05:22:39.205672+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:31.511097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022963218000000001,"stat_sum":{"num_bytes":11955144,"num_objects":73,"num_object_clones":11,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":46,"num_read":4717,"num_read_kb":18289,"num_write":544,"num_write_kb":26278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"c"}]},{"pgid":"2.2","version":"22'2","reported_seq":271,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.036747+0000","last_change":"2024-09-12T05:20:01.936281+0000","last_active":"2024-09-12T05:22:42.036747+0000","last_peered":"2024-09-12T05:22:42.036747+0000","last_clean":"2024-09-12T05:22:42.036747+0000","last_became_active":"2024-09-12T05:19:59.910376+0000","last_became_peered":"2024-09-12T05:19:59.910376+0000","last_unstale":"2024-09-12T05:22:42.036747+0000","last_undegraded":"2024-09-12T05:22:42.036747+0000","last_fullsized":"2024-09-12T05:22:42.036747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:17.282087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"145'955","reported_seq":10162,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.999048+0000","last_change":"2024-09-12T05:22:42.000415+0000","last_active":"2024-09-12T05:22:41.999048+0000","last_peered":"2024-09-12T05:22:41.999048+0000","last_clean":"2024-09-12T05:22:41.999048+0000","last_became_active":"2024-09-12T05:21:42.927073+0000","last_became_peered":"2024-09-12T05:21:42.927073+0000","last_unstale":"2024-09-12T05:22:41.999048+0000","last_undegraded":"2024-09-12T05:22:41.999048+0000","last_fullsized":"2024-09-12T05:22:41.999048+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:43.135398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028182569999999998,"stat_sum":{"num_bytes":32220035,"num_objects":60,"num_object_clones":11,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":37,"num_read":11795,"num_read_kb":54513,"num_write":1317,"num_write_kb":21754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":13855336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-12T05:22:40.999205+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:22:40.999205+0000","last_peered":"2024-09-12T05:22:40.999205+0000","last_clean":"2024-09-12T05:22:40.999205+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:22:40.999205+0000","last_undegraded":"2024-09-12T05:22:40.999205+0000","last_fullsized":"2024-09-12T05:22:40.999205+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"145'578","reported_seq":2358,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.000537+0000","last_change":"2024-09-12T05:22:42.002114+0000","last_active":"2024-09-12T05:22:42.000537+0000","last_peered":"2024-09-12T05:22:42.000537+0000","last_clean":"2024-09-12T05:22:42.000537+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:22:42.000537+0000","last_undegraded":"2024-09-12T05:22:42.000537+0000","last_fullsized":"2024-09-12T05:22:42.000537+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:20.329895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054147869999999999,"stat_sum":{"num_bytes":25883482,"num_objects":52,"num_object_clones":7,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":38,"num_read":2615,"num_read_kb":16060,"num_write":714,"num_write_kb":5680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"2.0","version":"0'0","reported_seq":266,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.011635+0000","last_change":"2024-09-12T05:20:02.152862+0000","last_active":"2024-09-12T05:22:42.011635+0000","last_peered":"2024-09-12T05:22:42.011635+0000","last_clean":"2024-09-12T05:22:42.011635+0000","last_became_active":"2024-09-12T05:19:59.918711+0000","last_became_peered":"2024-09-12T05:19:59.918711+0000","last_unstale":"2024-09-12T05:22:42.011635+0000","last_undegraded":"2024-09-12T05:22:42.011635+0000","last_fullsized":"2024-09-12T05:22:42.011635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:03.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"135'476","reported_seq":3449,"reported_epoch":146,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:22:42.037071+0000","last_change":"2024-09-12T05:22:26.873180+0000","last_active":"2024-09-12T05:22:42.037071+0000","last_peered":"2024-09-12T05:22:42.037071+0000","last_clean":"2024-09-12T05:22:23.966086+0000","last_became_active":"2024-09-12T05:22:26.873180+0000","last_became_peered":"2024-09-12T05:22:26.873180+0000","last_unstale":"2024-09-12T05:22:42.037071+0000","last_undegraded":"2024-09-12T05:22:26.870416+0000","last_fullsized":"2024-09-12T05:22:26.870148+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":15,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:50:31.513236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044948080000000003,"stat_sum":{"num_bytes":84010093,"num_objects":67,"num_object_clones":13,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":67,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":40,"num_read":3388,"num_read_kb":46309,"num_write":559,"num_write_kb":32831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":67}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":290,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.036599+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:22:42.036599+0000","last_peered":"2024-09-12T05:22:42.036599+0000","last_clean":"2024-09-12T05:22:42.036599+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:22:42.036599+0000","last_undegraded":"2024-09-12T05:22:42.036599+0000","last_fullsized":"2024-09-12T05:22:42.036599+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":358,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.011641+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:22:42.011641+0000","last_peered":"2024-09-12T05:22:42.011641+0000","last_clean":"2024-09-12T05:22:42.011641+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:22:42.011641+0000","last_undegraded":"2024-09-12T05:22:42.011641+0000","last_fullsized":"2024-09-12T05:22:42.011641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"143'627","reported_seq":4788,"reported_epoch":146,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:22:41.996988+0000","last_change":"2024-09-12T05:22:26.862499+0000","last_active":"2024-09-12T05:22:41.996988+0000","last_peered":"2024-09-12T05:22:41.996988+0000","last_clean":"2024-09-12T05:22:20.955298+0000","last_became_active":"2024-09-12T05:22:26.862499+0000","last_became_peered":"2024-09-12T05:22:26.862499+0000","last_unstale":"2024-09-12T05:22:41.996988+0000","last_undegraded":"2024-09-12T05:22:26.861560+0000","last_fullsized":"2024-09-12T05:22:26.861384+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":15,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:20:20.818981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090494200000000005,"stat_sum":{"num_bytes":27155177,"num_objects":68,"num_object_clones":13,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":68,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":40,"num_read":6823,"num_read_kb":35259,"num_write":628,"num_write_kb":24677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":68}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"145'518","reported_seq":2423,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.997026+0000","last_change":"2024-09-12T05:22:41.998425+0000","last_active":"2024-09-12T05:22:41.997026+0000","last_peered":"2024-09-12T05:22:41.997026+0000","last_clean":"2024-09-12T05:22:41.997026+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:22:41.997026+0000","last_undegraded":"2024-09-12T05:22:41.997026+0000","last_fullsized":"2024-09-12T05:22:41.997026+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:22.998124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025554330000000002,"stat_sum":{"num_bytes":3001332,"num_objects":64,"num_object_clones":10,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":45,"num_read":2769,"num_read_kb":4260,"num_write":585,"num_write_kb":2182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.a","version":"145'842","reported_seq":3155,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.995847+0000","last_change":"2024-09-12T05:22:41.996408+0000","last_active":"2024-09-12T05:22:41.995847+0000","last_peered":"2024-09-12T05:22:41.995847+0000","last_clean":"2024-09-12T05:22:41.995847+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:22:41.995847+0000","last_undegraded":"2024-09-12T05:22:41.995847+0000","last_fullsized":"2024-09-12T05:22:41.995847+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:18.468716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084984500000000001,"stat_sum":{"num_bytes":21465904,"num_objects":54,"num_object_clones":11,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":33,"num_read":4819,"num_read_kb":21189,"num_write":1026,"num_write_kb":9442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.b","version":"145'432","reported_seq":4788,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.996380+0000","last_change":"2024-09-12T05:22:41.996692+0000","last_active":"2024-09-12T05:22:41.996380+0000","last_peered":"2024-09-12T05:22:41.996380+0000","last_clean":"2024-09-12T05:22:41.996380+0000","last_became_active":"2024-09-12T05:22:23.848062+0000","last_became_peered":"2024-09-12T05:22:23.848062+0000","last_unstale":"2024-09-12T05:22:41.996380+0000","last_undegraded":"2024-09-12T05:22:41.996380+0000","last_fullsized":"2024-09-12T05:22:41.996380+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:23.230978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089400600000000003,"stat_sum":{"num_bytes":13716056,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":35,"num_read":4888,"num_read_kb":16251,"num_write":386,"num_write_kb":9182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":6526540,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.c","version":"144'1748","reported_seq":4290,"reported_epoch":146,"state":"active+undersized+degraded","last_fresh":"2024-09-12T05:22:42.037094+0000","last_change":"2024-09-12T05:22:26.873180+0000","last_active":"2024-09-12T05:22:42.037094+0000","last_peered":"2024-09-12T05:22:42.037094+0000","last_clean":"2024-09-12T05:22:24.765400+0000","last_became_active":"2024-09-12T05:22:26.873180+0000","last_became_peered":"2024-09-12T05:22:26.873180+0000","last_unstale":"2024-09-12T05:22:42.037094+0000","last_undegraded":"2024-09-12T05:22:26.870671+0000","last_fullsized":"2024-09-12T05:22:26.870585+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":15,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:06.878533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016474409999999999,"stat_sum":{"num_bytes":4365490,"num_objects":52,"num_object_clones":6,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":52,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":37,"num_read":10179,"num_read_kb":16120,"num_write":2984,"num_write_kb":7446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":52}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"145'678","reported_seq":5777,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.015057+0000","last_change":"2024-09-12T05:22:42.015492+0000","last_active":"2024-09-12T05:22:42.015057+0000","last_peered":"2024-09-12T05:22:42.015057+0000","last_clean":"2024-09-12T05:22:42.015057+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:22:42.015057+0000","last_undegraded":"2024-09-12T05:22:42.015057+0000","last_fullsized":"2024-09-12T05:22:42.015057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:02.322298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034195129999999999,"stat_sum":{"num_bytes":13560761,"num_objects":59,"num_object_clones":10,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":36,"num_read":6609,"num_read_kb":29138,"num_write":833,"num_write_kb":11107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.e","version":"145'491","reported_seq":1971,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.015553+0000","last_change":"2024-09-12T05:22:42.016124+0000","last_active":"2024-09-12T05:22:42.015553+0000","last_peered":"2024-09-12T05:22:42.015553+0000","last_clean":"2024-09-12T05:22:42.015553+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:22:42.015553+0000","last_undegraded":"2024-09-12T05:22:42.015553+0000","last_fullsized":"2024-09-12T05:22:42.015553+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:50:58.360566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038377730000000001,"stat_sum":{"num_bytes":6031046,"num_objects":52,"num_object_clones":8,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":35,"num_read":2271,"num_read_kb":6576,"num_write":541,"num_write_kb":4783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.f","version":"145'345","reported_seq":3460,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.016197+0000","last_change":"2024-09-12T05:22:42.016674+0000","last_active":"2024-09-12T05:22:42.016197+0000","last_peered":"2024-09-12T05:22:42.016197+0000","last_clean":"2024-09-12T05:22:42.016197+0000","last_became_active":"2024-09-12T05:21:50.016404+0000","last_became_peered":"2024-09-12T05:21:50.016404+0000","last_unstale":"2024-09-12T05:22:42.016197+0000","last_undegraded":"2024-09-12T05:22:42.016197+0000","last_fullsized":"2024-09-12T05:22:42.016197+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:26.697564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042916279999999996,"stat_sum":{"num_bytes":7580688,"num_objects":49,"num_object_clones":11,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":27,"num_read":3057,"num_read_kb":10628,"num_write":316,"num_write_kb":8973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":1777262,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.10","version":"145'481","reported_seq":3156,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:41.995905+0000","last_change":"2024-09-12T05:22:41.996325+0000","last_active":"2024-09-12T05:22:41.995905+0000","last_peered":"2024-09-12T05:22:41.995905+0000","last_clean":"2024-09-12T05:22:41.995905+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:22:41.995905+0000","last_undegraded":"2024-09-12T05:22:41.995905+0000","last_fullsized":"2024-09-12T05:22:41.995905+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:26.999061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076416699999999995,"stat_sum":{"num_bytes":47633452,"num_objects":42,"num_object_clones":5,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":27,"num_read":3230,"num_read_kb":18134,"num_write":534,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.11","version":"146'421","reported_seq":2824,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.087895+0000","last_change":"2024-09-12T05:22:42.016012+0000","last_active":"2024-09-12T05:22:42.087895+0000","last_peered":"2024-09-12T05:22:42.087895+0000","last_clean":"2024-09-12T05:22:42.087895+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:22:42.087895+0000","last_undegraded":"2024-09-12T05:22:42.087895+0000","last_fullsized":"2024-09-12T05:22:42.087895+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:37.424902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037327860000000001,"stat_sum":{"num_bytes":36553959,"num_objects":53,"num_object_clones":5,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":32,"num_read":2970,"num_read_kb":39089,"num_write":434,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.12","version":"145'354","reported_seq":1871,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.012726+0000","last_change":"2024-09-12T05:22:42.014038+0000","last_active":"2024-09-12T05:22:42.012726+0000","last_peered":"2024-09-12T05:22:42.012726+0000","last_clean":"2024-09-12T05:22:42.012726+0000","last_became_active":"2024-09-12T05:20:57.095147+0000","last_became_peered":"2024-09-12T05:20:57.095147+0000","last_unstale":"2024-09-12T05:22:42.012726+0000","last_undegraded":"2024-09-12T05:22:42.012726+0000","last_fullsized":"2024-09-12T05:22:42.012726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:12.622782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021662980000000001,"stat_sum":{"num_bytes":36897313,"num_objects":46,"num_object_clones":6,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":30,"num_read":1787,"num_read_kb":36608,"num_write":379,"num_write_kb":29172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"f"}]},{"pgid":"3.13","version":"145'537","reported_seq":3902,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-12T05:22:42.015858+0000","last_change":"2024-09-12T05:22:42.016466+0000","last_active":"2024-09-12T05:22:42.015858+0000","last_peered":"2024-09-12T05:22:42.015858+0000","last_clean":"2024-09-12T05:22:42.015858+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:22:42.015858+0000","last_undegraded":"2024-09-12T05:22:42.015858+0000","last_fullsized":"2024-09-12T05:22:42.015858+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:42.767426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004245179,"stat_sum":{"num_bytes":11005088,"num_objects":64,"num_object_clones":14,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":39,"num_read":4422,"num_read_kb":19292,"num_write":505,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"16","length":"f"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":687946778,"num_objects":1824,"num_object_clones":297,"num_object_copies":3648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":456,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1824,"num_whiteouts":1161,"num_read":155823,"num_read_kb":926785,"num_write":22689,"num_write_kb":470251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1522,"num_bytes_recovered":122842216,"num_keys_recovered":328,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360480768,"data_stored":445494068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},"log_size":19264,"ondisk_log_size":19264,"up":56,"acting":56,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118104,"kb_used_data":64700,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94253736,"statfs":{"total":96636764160,"available":96515825664,"internally_reserved":0,"allocated":66252800,"data_stored":75224686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51908,"kb_used_data":16552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319932,"statfs":{"total":96636764160,"available":96583610368,"internally_reserved":0,"allocated":16949248,"data_stored":19569748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126856,"kb_used_data":55408,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94244984,"statfs":{"total":96636764160,"available":96506863616,"internally_reserved":0,"allocated":56737792,"data_stored":62738901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271751,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124196,"kb_used_data":91332,"kb_used_omap":27,"kb_used_meta":32804,"kb_avail":94247644,"statfs":{"total":96636764160,"available":96509587456,"internally_reserved":0,"allocated":93523968,"data_stored":129628992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":33592119},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160148,"kb_used_data":107972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94211692,"statfs":{"total":96636764160,"available":96472772608,"internally_reserved":0,"allocated":110563328,"data_stored":142548700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45336,"kb_used_data":5828,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326504,"statfs":{"total":96636764160,"available":96590340096,"internally_reserved":0,"allocated":5967872,"data_stored":5909956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70012,"kb_used_data":38040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94301828,"statfs":{"total":96636764160,"available":96565071872,"internally_reserved":0,"allocated":38952960,"data_stored":41923026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88700,"kb_used_data":34520,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94283140,"statfs":{"total":96636764160,"available":96545935360,"internally_reserved":0,"allocated":35348480,"data_stored":51890108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33013760,"data_stored":50464698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37212160,"data_stored":41088003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":5074952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":109060096,"data_stored":141835094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":42835968,"data_stored":52593449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":54996992,"data_stored":61903878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15208448,"data_stored":18734680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63922176,"data_stored":73799314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:22:43.813 INFO:tasks.thrashosds.thrasher:Setting 2.6 to [3, 7, 5, 4] 2024-09-12T05:22:43.813 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.6', '3', '7', '5', '4'] 2024-09-12T05:22:43.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.6 3 7 5 4 2024-09-12T05:22:43.849 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:43.850 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:43.864 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:43.897 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:43.898+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:43.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:43.979+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:43.982 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:43.982 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:43.982 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:43.982 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:43.983 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:43.997 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:44.080 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:44.078+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:44.173 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116840 3.1a 3:582e491b:::rbd_data.111846fb6c83.0000000000000009:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.231618167000001, 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0078812729999999994, 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.174 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116840 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942046+0000", 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7700000000000002e-06 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942061+0000", 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4413000000000001e-05 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942100+0000", 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8982e-05 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942125+0000", 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5384e-05 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942295+0000", 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017022200000000001 2024-09-12T05:22:44.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942570+0000", 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027470100000000003 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942807+0000", 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023657800000000001 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946714+0000", 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003907265 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949653+0000", 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029390470000000002 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949796+0000", 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000143456 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949925+0000", 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128455 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116836 3.13 e125/119 3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head v 125'479, mlcod=120'477)", 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.230287388000001, 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012590459999999999, 2024-09-12T05:22:44.180 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943375+0000", 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.33e-07 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943385+0000", 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943421+0000", 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6340000000000001e-05 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943439+0000", 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7943000000000001e-05 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946692+0000", 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032526640000000002 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946753+0000", 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0736000000000003e-05 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955859+0000", 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091062309999999994 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955965+0000", 2024-09-12T05:22:44.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010594600000000001 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116834 3.a e125/117 3:523d80f0:::rbd_data.111846fb6c83.0000000000000003:head v 125'763, mlcod=123'761)", 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.227893161000001, 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097679289999999998, 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.185 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0699999999999996e-07 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945778+0000", 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945800+0000", 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1886999999999999e-05 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945815+0000", 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4555999999999999e-05 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946808+0000", 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0009934220000000001 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946859+0000", 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1075999999999997e-05 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955438+0000", 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0085788310000000003 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955536+0000", 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8517000000000006e-05 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116843 3.14 3:2957f86d:::rbd_data.111846fb6c83.000000000000000c:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.222057256999999, 2024-09-12T05:22:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006987966, 2024-09-12T05:22:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116843 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:44.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951608+0000", 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0400000000000001e-06 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951620+0000", 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2446000000000001e-05 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951655+0000", 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5142999999999999e-05 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951677+0000", 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2144e-05 2024-09-12T05:22:44.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951842+0000", 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016452200000000001 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.952429+0000", 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058674499999999995 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.952714+0000", 2024-09-12T05:22:44.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028506799999999998 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955997+0000", 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032838770000000002 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958320+0000", 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023223060000000001 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958457+0000", 2024-09-12T05:22:44.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013729000000000001 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958592+0000", 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013538499999999999 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116845 3.14 3:2a145e74:::rbd_data.111846fb6c83.000000000000000e:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:44.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.219865135999999, 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0059322539999999997, 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116845 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:44.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953797+0000", 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953799+0000", 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3970000000000001e-06 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953809+0000", 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0506000000000001e-05 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953848+0000", 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8705000000000003e-05 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.953869+0000", 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0449e-05 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954142+0000", 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027315199999999998 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954438+0000", 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000295791 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.954726+0000", 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028802400000000001 2024-09-12T05:22:44.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.957230+0000", 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025042739999999999 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959533+0000", 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002303158 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959665+0000", 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013202299999999999 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.959729+0000", 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3775000000000005e-05 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117176 3.1a 3:5dbbe14f:::rbd_data.1118e5d0fec8.0000000000000043:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:44.202 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.210743137000001, 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0090363549999999994, 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117176 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962920+0000", 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4339999999999999e-06 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962925+0000", 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4149999999999998e-06 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962941+0000", 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5308e-05 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962952+0000", 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1715999999999999e-05 2024-09-12T05:22:44.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963039+0000", 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6458000000000005e-05 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963208+0000", 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016904499999999999 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963341+0000", 2024-09-12T05:22:44.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013301400000000001 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.965163+0000", 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018218679999999999 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971869+0000", 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067059950000000002 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971913+0000", 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3707e-05 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971955+0000", 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2395000000000003e-05 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117179 3.1a 3:5a61d20b:::rbd_data.1118e5d0fec8.0000000000000061:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:44.208 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.207470939, 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0060640249999999998, 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117179 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966191+0000", 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966192+0000", 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966196+0000", 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8530000000000002e-06 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966208+0000", 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2616000000000001e-05 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966219+0000", 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0175e-05 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966406+0000", 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187324 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.966771+0000", 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036500399999999999 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.967053+0000", 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028252099999999999 2024-09-12T05:22:44.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.968181+0000", 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001128062 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972051+0000", 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038696350000000002 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972148+0000", 2024-09-12T05:22:44.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7005999999999999e-05 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.972255+0000", 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106729 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.5.0:3931 3.1c e133/118 3:3a01373d:::rbd_data.1118d53b39e7.0000000000000048:23 v 133'625, mlcod=129'622)", 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:28.902882+0000", 2024-09-12T05:22:44.214 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.270779641000001, 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0060428019999999999, 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.902882+0000", 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.902882+0000", 2024-09-12T05:22:44.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.902883+0000", 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.093e-06 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.902894+0000", 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1077000000000001e-05 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.902928+0000", 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3726000000000002e-05 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.902949+0000", 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.052e-05 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.903345+0000", 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000396456 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.903401+0000", 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6493999999999998e-05 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908797+0000", 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053953869999999998 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908925+0000", 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012804900000000001 2024-09-12T05:22:44.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.5.0:3932 3.1d e133/117 3:bd3bcbf7:::rbd_data.1118d53b39e7.000000000000002d:23 v 133'686, mlcod=124'683)", 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:28.908687+0000", 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.264974314, 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0060811909999999997, 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.219 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908687+0000", 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908687+0000", 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908689+0000", 2024-09-12T05:22:44.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2699999999999999e-06 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908705+0000", 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6486000000000001e-05 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908728+0000", 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3102999999999999e-05 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908744+0000", 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5262999999999999e-05 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.908988+0000", 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024453499999999999 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909042+0000", 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3900000000000002e-05 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.914664+0000", 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005621862 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.914769+0000", 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010477200000000001 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.6.0:1075 3.a e133/117 3:5680af87:::rbd_data.1118d53b39e7.0000000000000047:23 v 133'773, mlcod=127'768)", 2024-09-12T05:22:44.223 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:28.909598+0000", 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.264063502000001, 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0076469490000000001, 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909598+0000", 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909598+0000", 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909600+0000", 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1229999999999998e-06 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909615+0000", 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4443999999999999e-05 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909648+0000", 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2725999999999998e-05 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909666+0000", 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8167000000000001e-05 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.910284+0000", 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00061834499999999996 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.910344+0000", 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0299e-05 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.917120+0000", 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067759430000000004 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.917245+0000", 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124902 2024-09-12T05:22:44.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117683 3.14 3:2bb7c124:::rbd_data.1118d53b39e7.000000000000002c:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e133)", 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.127327026, 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0079451109999999995, 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117683 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046337+0000", 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7439999999999999e-06 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046350+0000", 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2976000000000001e-05 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046395+0000", 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4087e-05 2024-09-12T05:22:44.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046423+0000", 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8873e-05 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046740+0000", 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031646099999999998 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046966+0000", 2024-09-12T05:22:44.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022639099999999999 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.047294+0000", 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000328241 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.053674+0000", 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0063794890000000003 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054066+0000", 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039221299999999998 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054213+0000", 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147312 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054280+0000", 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6323999999999997e-05 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.233 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:119075 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:38.093016+0000", 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.0806453109999996, 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055994419999999996, 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.234 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 119075 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093016+0000", 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093016+0000", 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093019+0000", 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2069999999999998e-06 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093031+0000", 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2255999999999999e-05 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093060+0000", 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.953e-05 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093077+0000", 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6986e-05 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093233+0000", 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156033 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093376+0000", 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014261499999999999 2024-09-12T05:22:44.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.093706+0000", 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000329687 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.094951+0000", 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001245534 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.098446+0000", 2024-09-12T05:22:44.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034944389999999998 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.098546+0000", 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9926000000000005e-05 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.098616+0000", 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0228999999999995e-05 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:119099 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [delete] snapc 1a=[] ondisk+write+known_if_redirected+supports_pool_eio e142)", 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:38.126905+0000", 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.0467567149999999, 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056253129999999998, 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 119099 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.126905+0000", 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.126905+0000", 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.126907+0000", 2024-09-12T05:22:44.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.863e-06 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.126915+0000", 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8180000000000004e-06 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.126936+0000", 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1432000000000001e-05 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.126948+0000", 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1768e-05 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.127029+0000", 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0914999999999994e-05 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.127240+0000", 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000210996 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.127381+0000", 2024-09-12T05:22:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000141166 2024-09-12T05:22:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.129747+0000", 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002365827 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.132442+0000", 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026951940000000001 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.132481+0000", 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9313000000000001e-05 2024-09-12T05:22:44.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.132530+0000", 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9020999999999997e-05 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.7.0:3327 3.11 e143/117 3:8e65ebd0:::rbd_data.11185a81880a.0000000000000005:19 v 143'398, mlcod=135'393)", 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1908044249999996, 2024-09-12T05:22:44.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0084248250000000004, 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982859+0000", 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1229999999999998e-06 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982875+0000", 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5143999999999999e-05 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982904+0000", 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9620000000000001e-05 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982923+0000", 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9276e-05 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982984+0000", 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0324e-05 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.983004+0000", 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0531e-05 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.991208+0000", 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0082034389999999999 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.991282+0000", 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4368000000000004e-05 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.0.0:3384 3.1b e143/118 3:de2cf152:::rbd_data.11185a81880a.0000000000000002:19 v 143'674, mlcod=138'671)", 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.186633488, 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011964226, 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987029+0000", 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.223e-06 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987040+0000", 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0994e-05 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987063+0000", 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2368999999999999e-05 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987085+0000", 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1685999999999999e-05 2024-09-12T05:22:44.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987165+0000", 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0945999999999994e-05 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987189+0000", 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4039000000000001e-05 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.998964+0000", 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011774420000000001 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.998992+0000", 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8549000000000001e-05 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:119306 3.14 3:2c49c427:::rbd_data.11185a81880a.0000000000000003:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:22:44.255 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0303641170000004, 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022063445000000001, 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 119306 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:22:44.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143300+0000", 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143329+0000", 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9539999999999998e-05 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143365+0000", 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6123e-05 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143386+0000", 2024-09-12T05:22:44.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999998e-05 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143550+0000", 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164098 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143821+0000", 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027084800000000002 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.144179+0000", 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035827 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.161097+0000", 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016918182 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165221+0000", 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041235320000000001 2024-09-12T05:22:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165288+0000", 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7333000000000001e-05 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165361+0000", 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2694999999999994e-05 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:119305 3.1b e143/118 3:de2cf152:::rbd_data.11185a81880a.0000000000000002:head v 143'675, mlcod=140'672)", 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0300641649999998, 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020708957, 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143600+0000", 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.26e-06 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143614+0000", 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3716e-05 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143645+0000", 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0987e-05 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143657+0000", 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2216e-05 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143792+0000", 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013486600000000001 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143867+0000", 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5803000000000006e-05 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.164252+0000", 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02038442 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.164307+0000", 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4688999999999998e-05 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:119499 3.1d e144/117 3:b9157439:::rbd_data.1118b49023bd.00000000000000c9:head v 144'691, mlcod=142'689)", 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:40.095903+0000", 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0777586960000001, 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005900934, 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.095903+0000", 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.095903+0000", 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.095904+0000", 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.142e-06 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.095911+0000", 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.494e-06 2024-09-12T05:22:44.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.095929+0000", 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.857e-05 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.095939+0000", 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5670000000000001e-06 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.096067+0000", 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012807300000000001 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.096119+0000", 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1891000000000002e-05 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.101754+0000", 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056353449999999999 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:40.101804+0000", 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9852000000000003e-05 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:119999 3.14 3:28da1689:::rbd_data.11185d53c886.0000000000000021:head [delete] snapc 15=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-12T05:22:44.271 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:43.151044+0000", 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.022617476, 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062482320000000003, 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 119999 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151044+0000", 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151044+0000", 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151047+0000", 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2929999999999999e-06 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151056+0000", 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3130000000000004e-06 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151073+0000", 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7133999999999999e-05 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151086+0000", 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2666999999999999e-05 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151156+0000", 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0162999999999999e-05 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151291+0000", 2024-09-12T05:22:44.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013504599999999999 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151399+0000", 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010791899999999999 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.156898+0000", 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054995620000000004 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.157007+0000", 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010847400000000001 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.157164+0000", 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156992 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.157292+0000", 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012866900000000001 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:119996 3.13 e147/119 3:cc408429:::rbd_data.11185d53c886.0000000000000008:head v 147'538, mlcod=143'535)", 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:43.151198+0000", 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.022463473, 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058206280000000004, 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:44.278 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151198+0000", 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151198+0000", 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151199+0000", 2024-09-12T05:22:44.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151221+0000", 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2583999999999999e-05 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151231+0000", 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0166000000000001e-05 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151238+0000", 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9999999999999999e-06 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151550+0000", 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031119200000000001 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151601+0000", 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1759999999999999e-05 2024-09-12T05:22:44.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.156923+0000", 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053215140000000003 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.157019+0000", 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5963000000000003e-05 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:44.283 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:44.283 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:44.284 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:44.287+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:44.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:44.385 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:44.387+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:44.413 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:44.413 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:44.413 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:44.413 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:44.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:44.445 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:44.521 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:44.522+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:44.549 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:44.549 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:44.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:44.604 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:44.604 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:44.605 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:44.602+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:44.620 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:44.620 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:44.637 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:44.658 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:44.659 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:44.679 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:44.679 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:44.686 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:44.687+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:44.701 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:44.701 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:44.717 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:44.717 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:44.723 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:44.727 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:44.728 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:44.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:44.821 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:44.822+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:44.889 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:44.890+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:44.893 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:44.893 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:44.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:44.990 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:44.991+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:45.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:22:45.049 INFO:teuthology.orchestra.run.smithi059.stderr:set 2.6 pg_upmap_items mapping to [3->7,5->4] 2024-09-12T05:22:45.090 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:45.090 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:45.090 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:45.091+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:45.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:45.197 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:45.198+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:45.268 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:45.268 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:45.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:45.293 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:45.295+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:45.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:45.395+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:45.437 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:45.437 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:45.451 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:45.494 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:45.495+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:45.571 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:45.571 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:45.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:45.594 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:45.595+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:45.695 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:45.694+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:45.708 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:45.708 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:45.723 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:45.796 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:45.794+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:45.855 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:45.855 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:45.869 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:45.897 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:45.898+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:45.988 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:45.988 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:45.997 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:45.999+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:46.002 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:46.051 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:22:46.121 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:46.122+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:46.173 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:46.173 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:46.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:46.236 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:46.239+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:46.300 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:46.298+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:46.312 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:46.312 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:46.326 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:46.401 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:46.402+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:46.491 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:46.491 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:46.502 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:46.503+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:46.505 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:46.602 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:46.603+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:46.670 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:46.670 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:46.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:46.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:46.729 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:46.731+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:46.804 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:46.803+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:46.852 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:46.852 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:46.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:46.889 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:46.889 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:46.906 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:46.906 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:46.908 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:46.911+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:46.923 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:46.945 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:46.945 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:46.966 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:46.966 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:46.988 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:46.988 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:47.005 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:47.006+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:47.012 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:47.012 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:47.016 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:47.016 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:47.026 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:47.027 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:47.027 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:47.027 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:47.027 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:47.041 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:47.107 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:47.106+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:47.189 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.947690266000002, 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:22:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.946676543999999, 2024-09-12T05:22:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:22:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.945982682999997, 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:22:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.942997839999997, 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:22:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:22:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.942756514999999, 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:22:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.942008305000002, 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:22:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:22:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:22:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:22:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:22:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:22:47.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:47.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.941696544000003, 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:22:47.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:22:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:22:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:22:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.233 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.940973583000002, 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:22:47.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:22:47.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.939674664000002, 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:22:47.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:22:47.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:22:47.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:22:47.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:22:47.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:22:47.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.937122909999999, 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:22:47.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:22:47.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:22:47.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:22:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:47.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.936344419999998, 2024-09-12T05:22:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:22:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:22:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:22:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:22:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:22:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:22:47.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:22:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:22:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:22:47.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:22:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:22:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:22:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:22:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:22:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.936072078999999, 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:22:47.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.934795792999999, 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:22:47.269 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.270 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:22:47.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:22:47.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.933393176999999, 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:22:47.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:22:47.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.932677675999997, 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:47.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:22:47.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:22:47.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.288 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.931356280000003, 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:22:47.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:22:47.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.930279634999998, 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:22:47.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:22:47.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.930056891, 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:22:47.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:22:47.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.306 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.929435851999997, 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:22:47.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.312 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.927787719000001, 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:22:47.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.319 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:47.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:47.321 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:47.322+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:47.422 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:47.422+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:47.450 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:47.450 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:47.464 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:47.523 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:47.523+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:47.585 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:47.585 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:47.599 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:47.640 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:47.643+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:47.724 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:47.727+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:47.770 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:47.770 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:47.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:47.770 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:47.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.770 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116840 3.1a 3:582e491b:::rbd_data.111846fb6c83.0000000000000009:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:47.770 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.827651313, 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0078812729999999994, 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116840 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942046+0000", 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7700000000000002e-06 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942061+0000", 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4413000000000001e-05 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942100+0000", 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8982e-05 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942125+0000", 2024-09-12T05:22:47.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5384e-05 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942295+0000", 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017022200000000001 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942570+0000", 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027470100000000003 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942807+0000", 2024-09-12T05:22:47.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023657800000000001 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946714+0000", 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003907265 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949653+0000", 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029390470000000002 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949796+0000", 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000143456 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949925+0000", 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128455 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116836 3.13 e125/119 3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head v 125'479, mlcod=120'477)", 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.826320534000001, 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012590459999999999, 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943375+0000", 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.33e-07 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943385+0000", 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943421+0000", 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6340000000000001e-05 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943439+0000", 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7943000000000001e-05 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946692+0000", 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032526640000000002 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946753+0000", 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0736000000000003e-05 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955859+0000", 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091062309999999994 2024-09-12T05:22:47.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955965+0000", 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010594600000000001 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116834 3.a e125/117 3:523d80f0:::rbd_data.111846fb6c83.0000000000000003:head v 125'763, mlcod=123'761)", 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.823926307000001, 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097679289999999998, 2024-09-12T05:22:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0699999999999996e-07 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945778+0000", 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945800+0000", 2024-09-12T05:22:47.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1886999999999999e-05 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945815+0000", 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4555999999999999e-05 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946808+0000", 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0009934220000000001 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946859+0000", 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1075999999999997e-05 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955438+0000", 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0085788310000000003 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955536+0000", 2024-09-12T05:22:47.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8517000000000006e-05 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116843 3.14 3:2957f86d:::rbd_data.111846fb6c83.000000000000000c:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.818090402999999, 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006987966, 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.786 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116843 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951604+0000", 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951608+0000", 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0400000000000001e-06 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951620+0000", 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2446000000000001e-05 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951655+0000", 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5142999999999999e-05 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951677+0000", 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2144e-05 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.951842+0000", 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016452200000000001 2024-09-12T05:22:47.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.952429+0000", 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058674499999999995 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.952714+0000", 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028506799999999998 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955997+0000", 2024-09-12T05:22:47.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032838770000000002 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958320+0000", 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023223060000000001 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958457+0000", 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013729000000000001 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.958592+0000", 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013538499999999999 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117176 3.1a 3:5dbbe14f:::rbd_data.1118e5d0fec8.0000000000000043:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.806776283000001, 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0090363549999999994, 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.792 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117176 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962920+0000", 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4339999999999999e-06 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962925+0000", 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4149999999999998e-06 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962941+0000", 2024-09-12T05:22:47.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5308e-05 2024-09-12T05:22:47.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962952+0000", 2024-09-12T05:22:47.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1715999999999999e-05 2024-09-12T05:22:47.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963039+0000", 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6458000000000005e-05 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963208+0000", 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016904499999999999 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963341+0000", 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013301400000000001 2024-09-12T05:22:47.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.965163+0000", 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018218679999999999 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971869+0000", 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067059950000000002 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971913+0000", 2024-09-12T05:22:47.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3707e-05 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971955+0000", 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2395000000000003e-05 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.6.0:1075 3.a e133/117 3:5680af87:::rbd_data.1118d53b39e7.0000000000000047:23 v 133'773, mlcod=127'768)", 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:28.909598+0000", 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.860096647999999, 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0076469490000000001, 2024-09-12T05:22:47.799 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909598+0000", 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909598+0000", 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909600+0000", 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1229999999999998e-06 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909615+0000", 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4443999999999999e-05 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909648+0000", 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2725999999999998e-05 2024-09-12T05:22:47.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.909666+0000", 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8167000000000001e-05 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.910284+0000", 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00061834499999999996 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.910344+0000", 2024-09-12T05:22:47.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0299e-05 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.917120+0000", 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067759430000000004 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:28.917245+0000", 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124902 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117683 3.14 3:2bb7c124:::rbd_data.1118d53b39e7.000000000000002c:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e133)", 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.723360172, 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0079451109999999995, 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117683 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046337+0000", 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7439999999999999e-06 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046350+0000", 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2976000000000001e-05 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046395+0000", 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4087e-05 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046423+0000", 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8873e-05 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046740+0000", 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031646099999999998 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046966+0000", 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022639099999999999 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:47.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.047294+0000", 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000328241 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.053674+0000", 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0063794890000000003 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054066+0000", 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039221299999999998 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054213+0000", 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147312 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054280+0000", 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6323999999999997e-05 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.7.0:3327 3.11 e143/117 3:8e65ebd0:::rbd_data.11185a81880a.0000000000000005:19 v 143'398, mlcod=135'393)", 2024-09-12T05:22:47.809 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.7868375709999995, 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0084248250000000004, 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:22:47.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982859+0000", 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1229999999999998e-06 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982875+0000", 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5143999999999999e-05 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982904+0000", 2024-09-12T05:22:47.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9620000000000001e-05 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982923+0000", 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9276e-05 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982984+0000", 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0324e-05 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.983004+0000", 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0531e-05 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.991208+0000", 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0082034389999999999 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.991282+0000", 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4368000000000004e-05 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.0.0:3384 3.1b e143/118 3:de2cf152:::rbd_data.11185a81880a.0000000000000002:19 v 143'674, mlcod=138'671)", 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.7826666339999999, 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011964226, 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:22:47.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987029+0000", 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.223e-06 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987040+0000", 2024-09-12T05:22:47.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0994e-05 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987063+0000", 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2368999999999999e-05 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987085+0000", 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1685999999999999e-05 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987165+0000", 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0945999999999994e-05 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987189+0000", 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4039000000000001e-05 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.998964+0000", 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011774420000000001 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.998992+0000", 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8549000000000001e-05 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:119306 3.14 3:2c49c427:::rbd_data.11185a81880a.0000000000000003:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.6263972629999994, 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022063445000000001, 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.818 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 119306 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143300+0000", 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143329+0000", 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9539999999999998e-05 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143365+0000", 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6123e-05 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143386+0000", 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999998e-05 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143550+0000", 2024-09-12T05:22:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164098 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143821+0000", 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027084800000000002 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.144179+0000", 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035827 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.161097+0000", 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016918182 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165221+0000", 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041235320000000001 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165288+0000", 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7333000000000001e-05 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165361+0000", 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2694999999999994e-05 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:119305 3.1b e143/118 3:de2cf152:::rbd_data.11185a81880a.0000000000000002:head v 143'675, mlcod=140'672)", 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.6260973110000005, 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020708957, 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143600+0000", 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.26e-06 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143614+0000", 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3716e-05 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143645+0000", 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0987e-05 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143657+0000", 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2216e-05 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143792+0000", 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013486600000000001 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143867+0000", 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5803000000000006e-05 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.164252+0000", 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02038442 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.164307+0000", 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4688999999999998e-05 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.828 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:119999 3.14 3:28da1689:::rbd_data.11185d53c886.0000000000000021:head [delete] snapc 15=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:43.151044+0000", 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6186506219999997, 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062482320000000003, 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 119999 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151044+0000", 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151044+0000", 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151047+0000", 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2929999999999999e-06 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151056+0000", 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3130000000000004e-06 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151073+0000", 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7133999999999999e-05 2024-09-12T05:22:47.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151086+0000", 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2666999999999999e-05 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151156+0000", 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0162999999999999e-05 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151291+0000", 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013504599999999999 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.151399+0000", 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010791899999999999 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.156898+0000", 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054995620000000004 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.157007+0000", 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010847400000000001 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.157164+0000", 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000156992 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:43.157292+0000", 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012866900000000001 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.7.0:3405 3.e e151/118 3:77b0b111:::rbd_data.11187bfcbd74.00000000000001d6:11 v 151'494, mlcod=145'491)", 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.087996+0000", 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.68169870799999999, 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067848709999999996, 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.087996+0000", 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.087996+0000", 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.087997+0000", 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.088002+0000", 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9869999999999999e-06 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.088011+0000", 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4700000000000008e-06 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.088017+0000", 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4079999999999997e-06 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.088082+0000", 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4757000000000004e-05 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.088103+0000", 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1518999999999998e-05 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.094725+0000", 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066222970000000001 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.094781+0000", 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5680999999999998e-05 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.839 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.5.0:4070 3.1c e151/118 3:3d56312f:::rbd_data.11187bfcbd74.0000000000000114:11 v 151'687, mlcod=151'683)", 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.095559+0000", 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.67413556799999996, 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074637109999999996, 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.095559+0000", 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.095559+0000", 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.095561+0000", 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9740000000000001e-06 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.095576+0000", 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4503e-05 2024-09-12T05:22:47.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.095617+0000", 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1282999999999998e-05 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.095637+0000", 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9513000000000001e-05 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.095721+0000", 2024-09-12T05:22:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4853999999999998e-05 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.095746+0000", 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4545999999999998e-05 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.102973+0000", 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0072272669999999999 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.103023+0000", 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9771000000000002e-05 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.5.0:4071 3.1c e151/118 3:3fd73b87:::rbd_data.11187bfcbd74.000000000000025a:11 v 151'689, mlcod=151'683)", 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.096727+0000", 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.672967922, 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096448750000000007, 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.844 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096727+0000", 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096727+0000", 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096728+0000", 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023e-06 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096735+0000", 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.272e-06 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096747+0000", 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1858000000000001e-05 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096754+0000", 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4760000000000003e-06 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096861+0000", 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107205 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096881+0000", 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0316999999999999e-05 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.106116+0000", 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0092345320000000002 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.106372+0000", 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025619199999999998 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.848 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:120615 3.14 3:2f85e440:::rbd_data.11187bfcbd74.0000000000000024:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.230937+0000", 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.53875833900000003, 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012776595, 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 120615 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.849 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230937+0000", 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230937+0000", 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230938+0000", 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.358e-06 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230944+0000", 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.066e-06 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230961+0000", 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7186000000000001e-05 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230970+0000", 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6880000000000005e-06 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.231034+0000", 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4287000000000003e-05 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.231245+0000", 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021081499999999999 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.231304+0000", 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8770999999999997e-05 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.233203+0000", 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001899331 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243631+0000", 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010427542 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243681+0000", 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0392999999999997e-05 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243713+0000", 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2157999999999999e-05 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.854 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.6.0:1226 3.a e151/117 3:52557d33:::rbd_data.11187bfcbd74.000000000000010b:11 v 151'851, mlcod=150'846)", 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.239012+0000", 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.53068261400000005, 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073693980000000001, 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.239012+0000", 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.239012+0000", 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.239013+0000", 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3200000000000003e-07 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.239019+0000", 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5849999999999999e-06 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.239029+0000", 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0550000000000001e-05 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.239036+0000", 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.007e-06 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.240246+0000", 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001209246 2024-09-12T05:22:47.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.240260+0000", 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4134000000000001e-05 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246305+0000", 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0060455680000000003 2024-09-12T05:22:47.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246382+0000", 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6376000000000002e-05 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:120625 3.14 3:2b7150ed:::rbd_data.11187bfcbd74.00000000000000ee:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-12T05:22:47.859 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.243595+0000", 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.52609998700000005, 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0080199599999999996, 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 120625 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.860 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243595+0000", 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243595+0000", 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243597+0000", 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.843e-06 2024-09-12T05:22:47.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243606+0000", 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.234e-06 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243634+0000", 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8266e-05 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243654+0000", 2024-09-12T05:22:47.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.978e-05 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243789+0000", 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135489 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244054+0000", 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026497100000000002 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:47.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244340+0000", 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028586399999999999 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.250843+0000", 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065026349999999997 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251328+0000", 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048484 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251482+0000", 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015435899999999999 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251615+0000", 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013267899999999999 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.865 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:120628 3.14 3:29104c55:::rbd_data.11187bfcbd74.00000000000000f1:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.244025+0000", 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.52566942000000005, 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0078594979999999995, 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 120628 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244025+0000", 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244025+0000", 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244027+0000", 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7770000000000001e-06 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244036+0000", 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4829999999999999e-06 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244059+0000", 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3713000000000001e-05 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244076+0000", 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739e-05 2024-09-12T05:22:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.245221+0000", 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011450900000000001 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.245290+0000", 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9111999999999998e-05 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.245382+0000", 2024-09-12T05:22:47.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1426000000000002e-05 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.250943+0000", 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055615780000000002 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251636+0000", 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00069280899999999996 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251764+0000", 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012827499999999999 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251885+0000", 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012049600000000001 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:120631 3.3 3:c444cb40:::rbd_data.11187bfcbd74.00000000000000f4:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-12T05:22:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.246152+0000", 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.52354336000000001, 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00639859, 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 120631 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246152+0000", 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246152+0000", 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246153+0000", 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8330000000000001e-06 2024-09-12T05:22:47.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246160+0000", 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.08e-06 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246188+0000", 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7489000000000001e-05 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246205+0000", 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.73e-05 2024-09-12T05:22:47.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246276+0000", 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0846000000000006e-05 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246339+0000", 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2695999999999997e-05 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.246416+0000", 2024-09-12T05:22:47.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7059999999999997e-05 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251452+0000", 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0050362719999999996 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.252446+0000", 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099371700000000008 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:47.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.252504+0000", 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7818000000000001e-05 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.252550+0000", 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6479e-05 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:47.877 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:47.879 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:47.879 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:47.878+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:47.980 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:47.983+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:48.014 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:48.014 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:48.015 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:48.015 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:48.030 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:48.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:22:48.080 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:48.078+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:48.174 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:48.175 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:48.175 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:48.175 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:48.175 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:48.181 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:48.182+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:48.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:48.282 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:48.283+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:48.362 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:22:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 108.241779889, 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:22:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.911178819, 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:22:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.784618381000001, 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:22:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.784092856000001, 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:22:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:22:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.784070307999997, 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:22:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.784048518000006, 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.784027152999997, 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:22:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.784004608000004, 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.783982373000001, 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:22:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:22:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.783960789000005, 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:22:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:22:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:22:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.78375939, 2024-09-12T05:22:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:22:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.783733990000002, 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.776460713000006, 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.776438322999994, 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:22:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.776415674999996, 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:22:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:22:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:22:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.776395186000002, 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.776369121000002, 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:22:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.776345903999996, 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:22:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.776323540000007, 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:22:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:22:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.299783164000004, 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:22:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:22:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:22:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.456 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:48.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:48.458 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:48.458+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:48.557 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:48.558+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:48.629 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:48.629 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:48.629 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:48.629 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:48.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:48.685 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:48.686+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:48.759 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:48.759+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:48.812 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:48.812 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:48.812 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:48.812 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:48.812 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:48.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:48.861 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:48.863+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:48.956 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.536194952000002, 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:22:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.524746742999994, 2024-09-12T05:22:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:22:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.437131837999999, 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:22:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:22:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.437088734, 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:22:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:22:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.437061486000005, 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:22:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.437035206000004, 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:22:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.437012594999999, 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436984765999995, 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:22:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436962347000005, 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:22:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:22:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436941215000004, 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436852580999997, 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:22:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:22:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436821647000002, 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:22:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436795485000005, 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436773310999996, 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:22:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436752197000004, 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:22:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436730560000001, 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:22:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:22:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:22:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436565645000002, 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:22:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 95.436537928999996, 2024-09-12T05:22:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:22:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 85.351010032999994, 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:22:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:103340 3.0 3:06fad095:::rbd_data.1118e5d0fec8.00000000000000e6:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 124922~6150] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 66.983017099999998, 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95737219699999998, 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 103340 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972843+0000", 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5469999999999999e-06 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972859+0000", 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5625999999999999e-05 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972881+0000", 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.262e-05 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972893+0000", 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1866e-05 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972961+0000", 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8208999999999997e-05 2024-09-12T05:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972973+0000", 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1425e-05 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.927928+0000", 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95495565000000004 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928050+0000", 2024-09-12T05:22:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012213799999999999 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928260+0000", 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000209626 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.929880+0000", 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016203019999999999 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930114+0000", 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023339699999999999 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930171+0000", 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7697e-05 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930213+0000", 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1094000000000003e-05 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:49.048 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:49.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:49.049 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:49.051+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:49.050 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:49.081 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:22:49.165 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:49.166+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:49.222 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:49.222 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:49.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:49.251 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:49.251+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:49.271 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:49.292 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:49.293 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:49.310 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:49.311 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:49.311 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:49.333 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:49.352 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:49.350+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:49.353 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:49.372 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:49.397 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:49.397 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:49.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:49.453 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:49.454+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:49.554 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:49.555+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:49.577 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:49.577 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:49.592 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:49.600 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:49.600 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:49.604 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:49.605 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:49.654 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:49.655+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:49.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:49.755 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:49.754+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:49.856 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:49.854+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:49.905 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:49.905 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:49.918 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:49.957 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:49.958+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:50.042 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:50.042 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:50.057 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:50.058 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:50.058+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:50.071 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6, 2] out_osds: [] dead_osds: [3] live_osds: [0, 1, 2, 5, 6, 7, 4] 2024-09-12T05:22:50.071 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:22:50.072 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 3, 4, 5, 7, 6, 2] 2024-09-12T05:22:50.072 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-12T05:22:50.159 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:50.159+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:50.185 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:50.185 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:50.200 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:50.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:50.295+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:50.361 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:50.363+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:50.372 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:50.372 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:50.386 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:50.428 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-12T05:22:50.426+0000 7f6402832640 -1 mon.a@0(leader).osd e154 definitely_dead 0 2024-09-12T05:22:50.476 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:50.479+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:50.551 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:50.551 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:50.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:50.563+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:50.565 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:50.664 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:50.662+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:50.732 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:50.732 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:50.746 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:50.765 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:50.766+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:50.868 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:50.867+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:50.869 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:50.870 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:50.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:50.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:50.979+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:51.058 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:51.058 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:51.068 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:51.066+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:51.073 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:51.102 INFO:teuthology.orchestra.run.smithi059.stderr:marked out osd.1. 2024-09-12T05:22:51.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:22:51.177 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:51.178+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:51.236 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:51.236 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:51.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:51.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:51.299+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:51.369 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:51.370 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:51.370 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:51.370+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:51.384 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:51.476 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:51.479+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:51.551 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:51.551 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:51.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:51.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:51.617 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:51.618+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:51.672 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:51.675+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:51.700 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:51.700 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:51.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:51.773 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:51.775+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:51.777 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:51.794 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:51.795 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:51.811 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:51.811 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:51.812 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:51.833 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:51.851 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:51.851 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:51.853 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:51.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:51.874 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:51.875 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:51.874+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:51.896 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:51.899 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:51.899 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:51.974 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:51.975+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:51.985 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 111.86549361599999, 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:22:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:22:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:76442 3.1f 3.4fc8a2bf (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.534892545999995, 2024-09-12T05:22:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054769485999999999, 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 76442 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.450269+0000", 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455355+0000", 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050856060000000003 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455363+0000", 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2029999999999992e-06 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455375+0000", 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2283000000000001e-05 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.455383+0000", 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2230000000000007e-06 2024-09-12T05:22:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505031+0000", 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049647557000000002 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.505039+0000", 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6140000000000003e-06 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.408332107999996, 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:22:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407806582999996, 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:22:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407784035000006, 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:22:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407762245000001, 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:22:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407740880000006, 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:22:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:22:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407718334999998, 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:22:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:22:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:22:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:22:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:22:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:22:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407696099999995, 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:22:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:22:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:22:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:22:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:22:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407674516, 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:22:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407473116999995, 2024-09-12T05:22:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:22:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:22:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:22:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.407447716999997, 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.400174440000001, 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:22:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.400152050000003, 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:22:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.400129402000005, 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:22:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.400108912999997, 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.400082847999997, 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:22:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.400059631000005, 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:22:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:22:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.400037267000002, 2024-09-12T05:22:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:22:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 97.923496890999999, 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:22:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:22:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.085 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:52.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:52.087 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:52.087+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:52.114 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:22:52.189 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:52.190+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:121264 3.19 3.eeba4219 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:52.113583+0000", 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.10953708500000001, 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.109557431, 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "waiting for peered", 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 121264 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113583+0000", 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113583+0000", 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113587+0000", 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6799999999999999e-06 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113602+0000", 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5469999999999999e-05 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113667+0000", 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5166000000000006e-05 2024-09-12T05:22:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113694+0000", 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6815999999999999e-05 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113815+0000", 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0001204 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113848+0000", 2024-09-12T05:22:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3251999999999999e-05 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:121265 3.19 3.eeba4219 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:52.113758+0000", 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.109362653, 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.109444534, 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "waiting for peered", 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 121265 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113758+0000", 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113758+0000", 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113759+0000", 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4759999999999999e-06 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113767+0000", 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7000000000000008e-06 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113792+0000", 2024-09-12T05:22:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4847000000000001e-05 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113809+0000", 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7833e-05 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113904+0000", 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4214000000000003e-05 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113917+0000", 2024-09-12T05:22:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2937e-05 2024-09-12T05:22:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-12T05:22:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 2 2024-09-12T05:22:52.229 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:52.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:52.321 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:52.322+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:52.388 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:52.386+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:52.400 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:52.401 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:52.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:52.489 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:52.491+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:52.589 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:52.589 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:52.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:52.589 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.168767298999995, 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.590 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.157319090000001, 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:22:52.594 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:22:52.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069704185000006, 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.599 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:22:52.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069661081000007, 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:22:52.603 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:22:52.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:52.607 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069633832999997, 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:52.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:52.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.611 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069607552999997, 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:22:52.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069584942000006, 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.616 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.619 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069557113000002, 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:22:52.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:22:52.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.623 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069534693999998, 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069513561999997, 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.631 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069424928000004, 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069393993999995, 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:22:52.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:22:52.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069367831999998, 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:52.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:52.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069345658000003, 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:22:52.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069324543999997, 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:22:52.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069302906999994, 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:22:52.655 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:22:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78382 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069137991999995, 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059388825999999999, 2024-09-12T05:22:52.659 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78382 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519292+0000", 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519299+0000", 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2024-09-12T05:22:52.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519306+0000", 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1119999999999998e-06 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519311+0000", 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578674+0000", 2024-09-12T05:22:52.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059362508000000001 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578681+0000", 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8809999999999998e-06 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78383 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.069110276000004, 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059390085000000002, 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78383 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519320+0000", 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519510+0000", 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000190144 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519513+0000", 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1300000000000001e-06 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519522+0000", 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6950000000000006e-06 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519528+0000", 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.55e-06 2024-09-12T05:22:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578703+0000", 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059174711999999997 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578710+0000", 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8539999999999999e-06 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.983582380000001, 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:22:52.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:22:52.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:22:52.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:103340 3.0 3:06fad095:::rbd_data.1118e5d0fec8.00000000000000e6:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 124922~6150] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 70.615589447000005, 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95737219699999998, 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:52.674 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 103340 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972843+0000", 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5469999999999999e-06 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972859+0000", 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5625999999999999e-05 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972881+0000", 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.262e-05 2024-09-12T05:22:52.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972893+0000", 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1866e-05 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972961+0000", 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8208999999999997e-05 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972973+0000", 2024-09-12T05:22:52.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1425e-05 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.927928+0000", 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95495565000000004 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928050+0000", 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012213799999999999 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:22:52.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928260+0000", 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000209626 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.929880+0000", 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016203019999999999 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930114+0000", 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023339699999999999 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930171+0000", 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7697e-05 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930213+0000", 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1094000000000003e-05 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:52.680 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:52.681 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:52.590+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:52.682 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:52.725 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:52.726+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:52.791 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:52.790+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:52.854 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:52.855 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:52.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:52.916 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:52.914+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:52.992 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:52.995+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:53.042 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:53.042 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:53.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:53.093 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:53.095+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:53.194 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:53.194+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 152.227173182, 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:22:53.206 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 147.315540865, 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:53.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:22:53.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 146.93284038100001, 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.215 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:22:53.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:22:53.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 146.69879673400001, 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.219 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:22:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 146.66867240299999, 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:53.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:22:53.227 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 146.10658462200001, 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 146.10463040400001, 2024-09-12T05:22:53.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 137.16332166999999, 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:22:53.237 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:22:53.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:22:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 135.97638563699999, 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.245 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 128.09793138500001, 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:22:53.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 128.09788629100001, 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.250 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:22:53.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 128.08932472999999, 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:22:53.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 123.287286571, 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:22:53.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.263 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 117.773163133, 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:22:53.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 117.765077041, 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.268 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:22:53.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:22:53.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 103.86289079399999, 2024-09-12T05:22:53.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:22:53.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:22:53.277 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.133343893000003, 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:53.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:22:53.281 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.774094161999997, 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:53.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:22:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:3447 3.9 e151/107 3:9095e1db:::rbd_data.11187bfcbd74.00000000000000f3:11 v 151'520, mlcod=145'517)", 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:47.073490+0000", 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.1329444259999999, 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076533929999999997, 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073490+0000", 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073490+0000", 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073490+0000", 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8700000000000002e-07 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073495+0000", 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073509+0000", 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4591e-05 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073517+0000", 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0269999999999995e-06 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073598+0000", 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0592000000000004e-05 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073616+0000", 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.081081+0000", 2024-09-12T05:22:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074646959999999998 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.081143+0000", 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2006000000000002e-05 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:3449 3.9 e151/107 3:94ce0657:::rbd_data.11187bfcbd74.0000000000000117:11 v 151'522, mlcod=145'517)", 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:47.074114+0000", 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.1323201139999997, 2024-09-12T05:22:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007513207, 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074114+0000", 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074114+0000", 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074116+0000", 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.81e-06 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074131+0000", 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5517000000000001e-05 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074152+0000", 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0556000000000001e-05 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074164+0000", 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2649999999999999e-05 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074229+0000", 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4638e-05 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074243+0000", 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4005000000000001e-05 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.081583+0000", 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073394649999999999 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.081627+0000", 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4566e-05 2024-09-12T05:22:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:53.296 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:53.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:53.298 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:53.298+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:53.398 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:53.399+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:53.447 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:53.447 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:53.447 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:53.447 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:53.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:53.504 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:53.507+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:53.600 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:53.598+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:53.648 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:53.648 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:53.666 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:53.712 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:53.715+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:53.802 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:53.802+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:53.810 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:53.810 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:53.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.309631648999996, 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.811 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:22:53.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.309600000000003, 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:22:53.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:22:53.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.309563857000001, 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:22:53.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:22:53.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.309533047000002, 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.825 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:22:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.309502488000007, 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.830 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:22:53.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.309472592000006, 2024-09-12T05:22:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.307715649000002, 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:53.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.307672080000003, 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.844 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:22:53.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:53.848 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.307440189999994, 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:22:53.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.307319278999998, 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:22:53.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.857 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.307202240999999, 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:22:53.861 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.307082632999993, 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.862 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:22:53.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.304103905999995, 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:22:53.866 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:22:53.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:22:53.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.870 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.304069600000005, 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:53.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:22:53.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:22:53.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.304037424000001, 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.875 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:22:53.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.303975808000004, 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:22:53.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.303920452, 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:22:53.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:22:53.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.303865646000006, 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:22:53.888 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:22:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.303705972000003, 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.893 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:22:53.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:22:53.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115892 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_name in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118)", 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 39.588524444999997, 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.54022301299999997, 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:53.897 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115892 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223292+0000", 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2639999999999998e-06 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223302+0000", 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8959999999999998e-06 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223325+0000", 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-05 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223459+0000", 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013345300000000001 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223539+0000", 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0346000000000006e-05 2024-09-12T05:22:53.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223552+0000", 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3264e-05 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763244+0000", 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.53969141899999995 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763377+0000", 2024-09-12T05:22:53.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013312999999999999 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763513+0000", 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013600099999999999 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:53.902 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:53.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:53.904 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:53.905 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:53.907+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:54.005 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:54.007+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:54.079 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:54.080 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:54.096 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:54.096 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:54.098 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:54.098 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:54.098 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:54.098 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:54.105 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:54.107+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:54.113 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:54.114 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:54.114 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:54.131 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:54.132 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:54.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:22:54.153 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:54.154 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:54.174 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:54.195 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:54.195 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:54.198 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:54.199 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:54.245 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:54.246+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:54.278 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:54.278 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:54.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:54.336 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:54.339+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:54.407 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:54.407+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:54.415 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:54.415 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:54.429 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:54.508 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:54.506+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:54.601 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:54.601 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:54.609 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:54.610+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:54.615 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:54.710 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:54.710+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:54.735 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:54.736 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:54.751 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:54.755 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:22:54.810 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:54.811+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:54.886 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:54.887 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:54.900 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:54.911 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:54.910+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:55.011 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:55.011+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:55.070 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:55.071 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:55.085 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:55.129 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:55.131+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:55.214 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:55.215+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:55.252 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:55.252 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:55.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:55.315 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:55.314+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:55.416 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:55.419+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:55.435 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:55.531 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:55.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:55.535+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:55.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:55.633 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:55.635+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:55.669 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:55.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:55.734 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:55.735+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:55.810 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:55.810 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:55.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:55.835 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:55.835+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:55.935 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:55.935+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:55.954 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:55.954 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:55.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:56.036 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:56.034+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:56.098 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:56.098 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:56.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:22:56.133 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 7, 6, 2] out_osds: [1] dead_osds: [3] live_osds: [0, 1, 2, 5, 6, 7, 4] 2024-09-12T05:22:56.133 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:22:56.133 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-12T05:22:56.133 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T05:22:56.133 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T05:22:56.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-12T05:22:56.137 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:56.139+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:56.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:22:56.238 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:56.239+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:56.265 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:56.265 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T05:22:56.265 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:56.286 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:56.286 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:56.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:22:56.349 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:56.350+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:56.349 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:56.349 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:56.366 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:56.366 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:56.383 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:56.384 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:56.384 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:56.404 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:56.404 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:56.422 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:56.422 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:56.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:56.422 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:56.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.422 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77254 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13787136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 103.003295055, 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.063525838000000001, 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77254 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419663+0000", 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7e-07 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419665+0000", 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.012e-06 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419671+0000", 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3339999999999998e-06 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.419677+0000", 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5280000000000003e-06 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470541+0000", 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050863945000000001 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.470615+0000", 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3899999999999994e-05 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483188+0000", 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012573749 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77390 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 9166848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.991846846, 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.060085362000000003, 2024-09-12T05:22:56.428 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77390 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:56.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:56.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431111+0000", 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431114+0000", 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8590000000000001e-06 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431123+0000", 2024-09-12T05:22:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3080000000000008e-06 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.431128+0000", 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7960000000000001e-06 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483076+0000", 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.051947780999999998 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.483148+0000", 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1328999999999994e-05 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.491196+0000", 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080485320000000006 2024-09-12T05:22:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78346 3.0 3:05aec230:::rbd_data.11184141c2e2.0000000000000000:16 [read 13844480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.90423194100001, 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059467767999999997, 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78346 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518726+0000", 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.32e-07 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518728+0000", 2024-09-12T05:22:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1509999999999998e-06 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518736+0000", 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9580000000000007e-06 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518742+0000", 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3870000000000003e-06 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578053+0000", 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059311180999999998 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578124+0000", 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1500000000000003e-05 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578193+0000", 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9159000000000006e-05 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78349 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.90418883700001, 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059459763999999998, 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78349 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518769+0000", 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000004e-07 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518772+0000", 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7310000000000002e-06 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518781+0000", 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8070000000000006e-06 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518787+0000", 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.767e-06 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578221+0000", 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434008000000003 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578229+0000", 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9149999999999996e-06 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78352 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.904161589, 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463044, 2024-09-12T05:22:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78352 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518796+0000", 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518799+0000", 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659999999999999e-06 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518808+0000", 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3179999999999996e-06 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518814+0000", 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578252+0000", 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437975999999997 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578259+0000", 2024-09-12T05:22:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0389999999999999e-06 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78355 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.904135309, 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059465830999999997, 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78355 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518822+0000", 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518823+0000", 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518825+0000", 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5720000000000001e-06 2024-09-12T05:22:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518832+0000", 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9949999999999999e-06 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518838+0000", 2024-09-12T05:22:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1749999999999996e-06 2024-09-12T05:22:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578281+0000", 2024-09-12T05:22:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059443422000000003 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578288+0000", 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0559999999999999e-06 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78356 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.90411269800001, 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059472078999999997, 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78356 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518845+0000", 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0999999999999999e-07 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518852+0000", 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2890000000000003e-06 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518859+0000", 2024-09-12T05:22:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3669999999999999e-06 2024-09-12T05:22:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518864+0000", 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578310+0000", 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059445339999999999 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578317+0000", 2024-09-12T05:22:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78359 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.904084869, 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059475170000000001, 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78359 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518873+0000", 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518875+0000", 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2170000000000001e-06 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518882+0000", 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0940000000000002e-06 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518888+0000", 2024-09-12T05:22:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4269999999999999e-06 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578340+0000", 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059452577999999999 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578348+0000", 2024-09-12T05:22:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4429999999999997e-06 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78360 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.90406245, 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059486007, 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78360 2024-09-12T05:22:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518895+0000", 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518896+0000", 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2099999999999996e-07 2024-09-12T05:22:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518898+0000", 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9929999999999998e-06 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518904+0000", 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0140000000000004e-06 2024-09-12T05:22:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518909+0000", 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578374+0000", 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059464597000000001 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578381+0000", 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000004e-06 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78363 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.904041318, 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059495573000000003, 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78363 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518916+0000", 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518917+0000", 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.34e-07 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518919+0000", 2024-09-12T05:22:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.137e-06 2024-09-12T05:22:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518925+0000", 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6460000000000004e-06 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.518933+0000", 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1779999999999997e-06 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578404+0000", 2024-09-12T05:22:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059471614999999999 2024-09-12T05:22:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578412+0000", 2024-09-12T05:22:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5630000000000003e-06 2024-09-12T05:22:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78366 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.903952684, 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059436990000000002, 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78366 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519005+0000", 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519006+0000", 2024-09-12T05:22:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.68e-07 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519009+0000", 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3579999999999999e-06 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519018+0000", 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4080000000000004e-06 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519025+0000", 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7700000000000004e-06 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578435+0000", 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409490000000002 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578442+0000", 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2960000000000001e-06 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78367 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.90392174999999, 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059434916999999997, 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.480 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78367 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519036+0000", 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519039+0000", 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5409999999999999e-06 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519048+0000", 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1500000000000005e-06 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519054+0000", 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578464+0000", 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059409923000000003 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578471+0000", 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78370 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.903895588, 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059437358000000003, 2024-09-12T05:22:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78370 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:56.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519062+0000", 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519065+0000", 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519071+0000", 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519077+0000", 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3279999999999996e-06 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578492+0000", 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059415836 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578499+0000", 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8770000000000004e-06 2024-09-12T05:22:56.488 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78371 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.903873414, 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059444037999999998, 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.489 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78371 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519084+0000", 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519085+0000", 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9900000000000001e-07 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519087+0000", 2024-09-12T05:22:56.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0849999999999999e-06 2024-09-12T05:22:56.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519093+0000", 2024-09-12T05:22:56.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6429999999999998e-06 2024-09-12T05:22:56.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519098+0000", 2024-09-12T05:22:56.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0830000000000003e-06 2024-09-12T05:22:56.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578521+0000", 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059422793000000002 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578528+0000", 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0350000000000004e-06 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.494 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78374 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.9038523, 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059453901000000003, 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78374 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519105+0000", 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519106+0000", 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.51e-07 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519108+0000", 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3580000000000001e-06 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519114+0000", 2024-09-12T05:22:56.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.37e-06 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519120+0000", 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3539999999999999e-06 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578552+0000", 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059432020000000002 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578559+0000", 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3479999999999998e-06 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:78375 3.0 3.c4375a0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.90383066299999, 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059463393000000003, 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:22:56.499 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 78375 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519127+0000", 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519128+0000", 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3399999999999999e-07 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519130+0000", 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4260000000000002e-06 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519145+0000", 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5451000000000002e-05 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.519152+0000", 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3990000000000001e-06 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578583+0000", 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.059430959999999998 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.578590+0000", 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5229999999999998e-06 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:83683 3.0 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write 6849394~18422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 92.818110136000001, 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.070035703000000005, 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.503 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 83683 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604847+0000", 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.604851+0000", 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7359999999999999e-06 2024-09-12T05:22:56.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613721+0000", 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088701809999999996 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613750+0000", 2024-09-12T05:22:56.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8277e-05 2024-09-12T05:22:56.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613766+0000", 2024-09-12T05:22:56.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5968e-05 2024-09-12T05:22:56.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.613891+0000", 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125351 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.614155+0000", 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026444199999999999 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 6", 2024-09-12T05:22:56.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.615367+0000", 2024-09-12T05:22:56.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012111190000000001 2024-09-12T05:22:56.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:56.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.656266+0000", 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040899199999999997 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674556+0000", 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018290483999999999 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:56.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674660+0000", 2024-09-12T05:22:56.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010372799999999999 2024-09-12T05:22:56.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:23.674883+0000", 2024-09-12T05:22:56.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000223217 2024-09-12T05:22:56.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.512 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.512 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:103340 3.0 3:06fad095:::rbd_data.1118e5d0fec8.00000000000000e6:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 124922~6150] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-12T05:22:56.513 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:56.513 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 74.450117203000005, 2024-09-12T05:22:56.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95737219699999998, 2024-09-12T05:22:56.513 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.513 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:56.513 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.513 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.514 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.514 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 103340 2024-09-12T05:22:56.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.514 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:56.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972840+0000", 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972843+0000", 2024-09-12T05:22:56.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5469999999999999e-06 2024-09-12T05:22:56.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972859+0000", 2024-09-12T05:22:56.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5625999999999999e-05 2024-09-12T05:22:56.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972881+0000", 2024-09-12T05:22:56.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.262e-05 2024-09-12T05:22:56.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972893+0000", 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1866e-05 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972961+0000", 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8208999999999997e-05 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:56.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:41.972973+0000", 2024-09-12T05:22:56.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1425e-05 2024-09-12T05:22:56.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.927928+0000", 2024-09-12T05:22:56.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95495565000000004 2024-09-12T05:22:56.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:56.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928050+0000", 2024-09-12T05:22:56.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012213799999999999 2024-09-12T05:22:56.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 2", 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.928260+0000", 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000209626 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.929880+0000", 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016203019999999999 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930114+0000", 2024-09-12T05:22:56.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023339699999999999 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930171+0000", 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7697e-05 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:42.930213+0000", 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1094000000000003e-05 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:121264 3.19 3:98425d77:::rbd_header.11184248d50f:head [call rbd.snapshot_remove in=18b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e156)", 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:52.113583+0000", 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3093745090000004, 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.044405754, 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.523 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 121264 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113583+0000", 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113583+0000", 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113587+0000", 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6799999999999999e-06 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113602+0000", 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5469999999999999e-05 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113667+0000", 2024-09-12T05:22:56.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5166000000000006e-05 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113694+0000", 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6815999999999999e-05 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113815+0000", 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0001204 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:56.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113848+0000", 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3251999999999999e-05 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.150287+0000", 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0364396300000001 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.150537+0000", 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024968100000000002 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.151019+0000", 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00048167300000000001 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.152582+0000", 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001562999 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:22:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.157755+0000", 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051726699999999999 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.157834+0000", 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9085999999999995e-05 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.157989+0000", 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015523100000000001 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.529 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:121265 3.19 3:98425d77:::rbd_header.11184248d50f:head [watch reconnect cookie 140195249675504 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e156)", 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:52.113758+0000", 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3092000769999999, 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0468757289999999, 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:56.530 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 121265 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113758+0000", 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113758+0000", 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113759+0000", 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4759999999999999e-06 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113767+0000", 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7000000000000008e-06 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:56.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113792+0000", 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4847000000000001e-05 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113809+0000", 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7833e-05 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113904+0000", 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4214000000000003e-05 2024-09-12T05:22:56.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:52.113917+0000", 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2937e-05 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.151702+0000", 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0377856059999999 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.151824+0000", 2024-09-12T05:22:56.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000122149 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.158046+0000", 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006221557 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.158164+0000", 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118318 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:56.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:53.160633+0000", 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002469092 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:56.536 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:56.537 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:56.537 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:56.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:22:56.539 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:56.539 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:56.539 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:56.540 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:56.540 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:56.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:56.539+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:56.638 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:56.638+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:56.714 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:56.715 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:22:56.715 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:56.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:22:56.739 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:56.739+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:56.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:22:56.840 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:56.839+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:56.900 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:22:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:22:56.900 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:22:56.900 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:56.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:22:56.965 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:22:56.966+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:22:57.042 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:57.042+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:57.055 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:3935 3.4 e33/23 3:2075fa98:::rbd_object_map.1118a362a851.0000000000000006:head v 33'21, mlcod=33'16)", 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 156.07625547500001, 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064936489999999998, 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.056 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979261+0000", 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979262+0000", 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.540000000000001e-07 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979281+0000", 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8816000000000001e-05 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979294+0000", 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3117e-05 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979304+0000", 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9240000000000002e-06 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979377+0000", 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3054999999999998e-05 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.979401+0000", 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4340000000000001e-05 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985692+0000", 2024-09-12T05:22:57.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062910809999999996 2024-09-12T05:22:57.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:20.985755+0000", 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2361999999999997e-05 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:8964 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'53, mlcod=37'50)", 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 151.16462315800001, 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060306580000000004, 2024-09-12T05:22:57.061 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890893+0000", 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890894+0000", 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-09-12T05:22:57.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890900+0000", 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8200000000000002e-06 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890914+0000", 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.414e-05 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890921+0000", 2024-09-12T05:22:57.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7229999999999998e-06 2024-09-12T05:22:57.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890973+0000", 2024-09-12T05:22:57.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1881e-05 2024-09-12T05:22:57.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.890990+0000", 2024-09-12T05:22:57.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7351999999999999e-05 2024-09-12T05:22:57.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896893+0000", 2024-09-12T05:22:57.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059033339999999997 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:25.896924+0000", 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0477999999999999e-05 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:9886 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'110, mlcod=37'106)", 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 150.78192267399999, 2024-09-12T05:22:57.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726500000000003, 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:57.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273594+0000", 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8899999999999998e-07 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273600+0000", 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3839999999999996e-06 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273612+0000", 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.239e-05 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273619+0000", 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8909999999999998e-06 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273672+0000", 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2546000000000001e-05 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.273694+0000", 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2821000000000001e-05 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280806+0000", 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007111394 2024-09-12T05:22:57.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.280866+0000", 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0435e-05 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10191 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'158, mlcod=37'154)", 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:57.073 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 150.54787902699999, 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055664089999999996, 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507637+0000", 2024-09-12T05:22:57.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507638+0000", 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1299999999999999e-07 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507644+0000", 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5380000000000002e-06 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507655+0000", 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.15e-05 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507663+0000", 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5100000000000001e-06 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507705+0000", 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1854999999999998e-05 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.507724+0000", 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9590999999999999e-05 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513160+0000", 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054359090000000001 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.513204+0000", 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3693000000000003e-05 2024-09-12T05:22:57.077 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:10215 3.0 e37/23 3:021b833b:::rbd_object_map.11182c6d9c71:head v 37'169, mlcod=37'163)", 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 150.517754696, 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054849080000000001, 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537762+0000", 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8299999999999996e-07 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537768+0000", 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4249999999999997e-06 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537778+0000", 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0020000000000001e-05 2024-09-12T05:22:57.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537797+0000", 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8777e-05 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537864+0000", 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7292000000000006e-05 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.537880+0000", 2024-09-12T05:22:57.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5854000000000001e-05 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543217+0000", 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053370609999999997 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:26.543247+0000", 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9796000000000001e-05 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11433 3.9 e38/23 3:94f46403:::rbd_object_map.11182c6d9c71.000000000000000a:head v 38'64, mlcod=38'61)", 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 149.95566691499999, 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008373185, 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099849+0000", 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099850+0000", 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4399999999999999e-07 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099855+0000", 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7210000000000002e-06 2024-09-12T05:22:57.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099864+0000", 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9910000000000008e-06 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099871+0000", 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6880000000000002e-06 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099930+0000", 2024-09-12T05:22:57.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9593999999999999e-05 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.099946+0000", 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5863e-05 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108186+0000", 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082396789999999998 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.108223+0000", 2024-09-12T05:22:57.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6804999999999997e-05 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:11435 3.4 e38/23 3:276245dc:::rbd_data.11182c6d9c71.0000000000000006:head v 38'67, mlcod=37'65)", 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 149.95371269699999, 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058637309999999996, 2024-09-12T05:22:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101804+0000", 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.101805+0000", 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.421e-06 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102107+0000", 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030214899999999998 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102123+0000", 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5894999999999999e-05 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102132+0000", 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6519999999999995e-06 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102198+0000", 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6385999999999998e-05 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.102218+0000", 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0145000000000001e-05 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107624+0000", 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054058719999999999 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:27.107667+0000", 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3210999999999997e-05 2024-09-12T05:22:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:19591 3.0 e43/23 3:06676401:::rbd_data.1118d7e09baf.0000000000000096:head v 43'211, mlcod=43'208)", 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 141.012403963, 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058293679999999997, 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043112+0000", 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043113+0000", 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.92e-07 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043119+0000", 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6420000000000004e-06 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043129+0000", 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0267e-05 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043136+0000", 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5590000000000002e-06 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043230+0000", 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4043999999999996e-05 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.043249+0000", 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9677000000000002e-05 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048885+0000", 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056361500000000004 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:36.048942+0000", 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6336999999999999e-05 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:20167 3.9 e44/23 3:94f34572:::rbd_data.1118d7e09baf.000000000000007e:head v 44'98, mlcod=44'96)", 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 139.82546793, 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056263950000000002, 2024-09-12T05:22:57.096 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230048+0000", 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230050+0000", 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-06 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230058+0000", 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3340000000000002e-06 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230073+0000", 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230083+0000", 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8009999999999998e-06 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230183+0000", 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9834000000000007e-05 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.230210+0000", 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6914999999999999e-05 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235619+0000", 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054087930000000003 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:37.235675+0000", 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6104999999999999e-05 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.100 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32395 3.9 e47/23 3:905314e9:::rbd_data.111887da7c95.0000000000000066:head v 47'187, mlcod=46'184)", 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 131.94701367799999, 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067095169999999999, 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108503+0000", 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6100000000000001e-07 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108509+0000", 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4620000000000004e-06 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108523+0000", 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3977e-05 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108532+0000", 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1020000000000003e-06 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108629+0000", 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7591999999999997e-05 2024-09-12T05:22:57.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4173e-05 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115153+0000", 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064994850000000002 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.115212+0000", 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9165e-05 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32392 3.4 e47/23 3:24b083ff:::rbd_data.111887da7c95.0000000000000063:head v 47'164, mlcod=46'161)", 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 131.94696858399999, 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058104360000000004, 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.105 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.106 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:57.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108548+0000", 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1100000000000001e-07 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108557+0000", 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7949999999999996e-06 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108565+0000", 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9189999999999999e-06 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108570+0000", 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1830000000000002e-06 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108654+0000", 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3583000000000003e-05 2024-09-12T05:22:57.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.108674+0000", 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9904000000000001e-05 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114309+0000", 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056351559999999997 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.114358+0000", 2024-09-12T05:22:57.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9484999999999998e-05 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:32410 3.0 e47/23 3:0239fba7:::rbd_data.111887da7c95.0000000000000075:head v 47'253, mlcod=47'247)", 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 131.938407023, 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058745969999999996, 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117109+0000", 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117111+0000", 2024-09-12T05:22:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3370000000000001e-06 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117119+0000", 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8630000000000008e-06 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117154+0000", 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5080000000000003e-05 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117163+0000", 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2599999999999994e-06 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117231+0000", 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8285000000000001e-05 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.117253+0000", 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2163000000000001e-05 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122933+0000", 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056800569999999996 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:45.122984+0000", 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0552e-05 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:40654 3.0 e51/23 3:0540fb0d:::rbd_object_map.11182d2a28db:head v 51'333, mlcod=51'331)", 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:57.114 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 127.136368864, 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062554309999999997, 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919147+0000", 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919149+0000", 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.372e-06 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919158+0000", 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5750000000000007e-06 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919190+0000", 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1857999999999999e-05 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919200+0000", 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.662e-06 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919365+0000", 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016466300000000001 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.919440+0000", 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5235999999999996e-05 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925286+0000", 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058464420000000003 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:49.925403+0000", 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000116623 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.118 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54071 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'517, mlcod=54'514)", 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 121.62224542600001, 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013645446, 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:57.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433271+0000", 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.433273+0000", 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.979e-06 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434803+0000", 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001530394 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434822+0000", 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8589000000000001e-05 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434831+0000", 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5840000000000001e-06 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434932+0000", 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000100701 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.434955+0000", 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2486000000000001e-05 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446862+0000", 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011907002999999999 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.446916+0000", 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4710000000000003e-05 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:54072 3.0 e54/23 3:034981c4:::rbd_data.1118bf17036a.0000000000000009:head v 54'519, mlcod=54'514)", 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 121.61415933399999, 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076011309999999997, 2024-09-12T05:22:57.123 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441357+0000", 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441358+0000", 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0219999999999999e-06 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441366+0000", 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441384+0000", 2024-09-12T05:22:57.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7935999999999999e-05 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441393+0000", 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9830000000000002e-06 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441487+0000", 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4105999999999997e-05 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.441508+0000", 2024-09-12T05:22:57.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.122e-05 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448912+0000", 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074036479999999997 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:20:55.448958+0000", 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6244e-05 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:65132 3.9 3:9695b545:::rbd_data.1118b49023bd.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 107.711973087, 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095230509999999994, 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 65132 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343543+0000", 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343545+0000", 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8300000000000001e-06 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.343984+0000", 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043922999999999998 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344011+0000", 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6641000000000001e-05 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344027+0000", 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5630000000000001e-05 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344118+0000", 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1229000000000004e-05 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.344306+0000", 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000188617 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352905+0000", 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085988929999999998 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.352977+0000", 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1495999999999994e-05 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:09.353066+0000", 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9485000000000001e-05 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.132 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:80539 3.4 e68/23 3:2623a1b0:::rbd_data.11183d6a8c4d.000000000000000a:head v 68'328, mlcod=66'326)", 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 102.982426186, 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032381462, 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073090+0000", 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.073093+0000", 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6800000000000002e-06 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080337+0000", 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072445529999999999 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080372+0000", 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4159000000000003e-05 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080394+0000", 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2232999999999999e-05 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080505+0000", 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111567 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.080537+0000", 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1174999999999999e-05 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105360+0000", 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024823695999999999 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.105472+0000", 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111399 2024-09-12T05:22:57.136 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4376.0:82815 3.4 e72/23 3:27b614e5:::rbd_data.1118faf2bc6a.0000000000000007:head v 72'342, mlcod=70'339)", 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 97.623176455000007, 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061626040000000003, 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432340+0000", 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432349+0000", 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6680000000000007e-06 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432371+0000", 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1804e-05 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432380+0000", 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7189999999999996e-06 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432452+0000", 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.127e-05 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.432475+0000", 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.281e-05 2024-09-12T05:22:57.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438437+0000", 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059628520000000003 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:19.438502+0000", 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5068999999999997e-05 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:3447 3.9 e151/107 3:9095e1db:::rbd_data.11187bfcbd74.00000000000000f3:11 v 151'520, mlcod=145'517)", 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:47.073490+0000", 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.9820267190000003, 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076533929999999997, 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073490+0000", 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073490+0000", 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073490+0000", 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8700000000000002e-07 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073495+0000", 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8280000000000002e-06 2024-09-12T05:22:57.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073509+0000", 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4591e-05 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073517+0000", 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0269999999999995e-06 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073598+0000", 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0592000000000004e-05 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.073616+0000", 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.081081+0000", 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074646959999999998 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.081143+0000", 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2006000000000002e-05 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:3449 3.9 e151/107 3:94ce0657:::rbd_data.11187bfcbd74.0000000000000117:11 v 151'522, mlcod=145'517)", 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:22:47.074114+0000", 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.9814024070000009, 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007513207, 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:22:57.146 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074114+0000", 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074114+0000", 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074116+0000", 2024-09-12T05:22:57.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.81e-06 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074131+0000", 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5517000000000001e-05 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074152+0000", 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0556000000000001e-05 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074164+0000", 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2649999999999999e-05 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074229+0000", 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4638e-05 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.074243+0000", 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4005000000000001e-05 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.081583+0000", 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073394649999999999 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:22:47.081627+0000", 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4566e-05 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:22:57.150 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:22:57.152 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:22:57.153 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:57.155+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:57.253 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:57.255+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:57.282 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:57.282 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:57.296 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:22:57.384 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:57.387+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:57.455 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:57.454+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:57.458 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:57.458 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:57.458 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:57.458 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:57.458 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:57.472 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:22:57.556 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:57.554+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.140656414999995, 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:22:57.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:22:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.140624766000002, 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:22:57.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.140588622999999, 2024-09-12T05:22:57.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:22:57.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:22:57.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.140557813000001, 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:22:57.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:22:57.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.140527254000006, 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:22:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:57.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.140497358000005, 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.670 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.138740415000001, 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:22:57.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:22:57.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:22:57.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.138696846000002, 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:22:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:57.679 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.138464956000007, 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:57.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:22:57.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.138344044999997, 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:22:57.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.138227006999998, 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.688 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:22:57.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.138107399000006, 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:22:57.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:22:57.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.135128671999993, 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:22:57.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.135094366000004, 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:22:57.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:22:57.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.135062189999999, 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:22:57.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:57.710 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.135000574000003, 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.714 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.134945217999999, 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.715 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:22:57.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.134890412000004, 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:22:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:22:57.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:22:57.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.134730738000002, 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:22:57.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115892 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_name in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118)", 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.419549211000003, 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.54022301299999997, 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:57.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115892 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223292+0000", 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2639999999999998e-06 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223302+0000", 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8959999999999998e-06 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223325+0000", 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-05 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223459+0000", 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013345300000000001 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223539+0000", 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0346000000000006e-05 2024-09-12T05:22:57.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223552+0000", 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3264e-05 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763244+0000", 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.53969141899999995 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763377+0000", 2024-09-12T05:22:57.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013312999999999999 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763513+0000", 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013600099999999999 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:57.733 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:57.735 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:22:57.735 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:57.735+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:57.780 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:22:57.857 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:57.858+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:57.907 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:57.907 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:57.908 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:57.908 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:57.921 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:22:57.972 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:22:57.975+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:22:58.041 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:58.042+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:58.056 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:58.056 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:58.056 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:58.056 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:58.056 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:58.074 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:22:58.160 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:58.163+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:58.239 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:22:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:22:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:22:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:58.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06692221500001, 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:22:58.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.066220695, 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.066097961, 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.250 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:22:58.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:22:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.255 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06603574799999, 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.256 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:22:58.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.260 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06596893099999, 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:22:58.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.065908898, 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.266 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:22:58.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06582896200001, 2024-09-12T05:22:58.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:22:58.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:22:58.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06576940100001, 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.277 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:22:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:22:58.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06569461199999, 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.282 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:22:58.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.287 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06555721199999, 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.288 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06540547700001, 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:22:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06534250300001, 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:22:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:22:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06520661100001, 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.065142651, 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:22:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:22:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06505839799999, 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:22:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:22:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.064999038, 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:22:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06493877099999, 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:22:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:22:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:22:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06487577799999, 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:22:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:22:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 138.06471517, 2024-09-12T05:22:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:22:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 94.621483455999993, 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:22:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:22:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:22:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:22:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:22:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:22:58.347 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:58.349 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:22:58.349 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:58.351+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:58.449 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:22:58.451+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:22:58.522 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:58.522 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:58.522 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:22:58.522 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:58.536 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:22:58.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:22:58.589 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:58.590+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:58.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:58.655+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:58.701 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:22:58.702 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:22:58.706 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:22:58.706 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:22:58.706 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:22:58.706 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:22:58.706 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:22:58.718 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:22:58.719 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:22:58.721 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:22:58.737 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:22:58.737 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:22:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:22:58.754 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:58.754+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:58.756 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:22:58.757 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:22:58.778 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:22:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:22:58.805 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:22:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:22:58.827 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:22:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:22:58.834 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:22:58.834 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:22:58.877 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:58.878+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:58.906 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:58.906 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:58.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:22:58.968 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:58.971+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:59.056 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:59.059+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:59.061 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:59.061 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:59.078 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:22:59.164 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:22:59.167+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:22:59.242 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:59.242 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:59.257 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:22:59.258 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:59.258+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:59.359 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:59.359+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:59.424 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:59.424 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:59.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:22:59.480 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:59.483+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:59.561 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:59.562+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:59.574 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:59.574 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:59.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:22:59.662 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:22:59.663+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:22:59.760 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:59.760 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:59.762 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:59.762+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:22:59.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:22:59.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T05:22:59.863 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:22:59.862+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:22:59.948 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:22:59.948 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:22:59.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:22:59.965 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:22:59.966+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:00.066 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:00.066+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:00.127 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:00.127 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:00.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:23:00.167 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:00.166+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:00.259 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:00.259 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:00.267 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:00.266+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:00.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:23:00.367 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:00.366+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:00.400 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:00.401 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:00.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:23:00.469 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:00.470+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:00.542 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:00.542 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:00.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:23:00.605 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:00.606+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:00.671 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:00.670+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:00.683 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:00.683 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:00.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:23:00.772 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:00.774+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:00.797 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-09-12T05:23:00.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:23:00.874 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:00.874 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:00.875 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:00.874+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:00.891 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:23:00.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:00.974+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:00.977 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:23:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:23:00.996 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:23:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:23:01.014 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:23:01.014 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:23:01.014 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:23:01.032 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:01.032 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:01.034 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:23:01.034 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:23:01.047 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:23:01.052 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:23:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:23:01.070 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:23:01.070 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:23:01.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:01.090+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:01.089 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:23:01.089 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:23:01.094 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:23:01.095 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:23:01.176 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:01.178+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:01.212 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:01.213 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:01.213 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:23:01.213 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:23:01.213 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:01.227 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:23:01.280 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 7, 6, 2] out_osds: [1] dead_osds: [3] live_osds: [0, 1, 2, 5, 6, 7, 4] 2024-09-12T05:23:01.280 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:23:01.280 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-12T05:23:01.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-12T05:23:01.316 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:01.318+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:01.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:01.378+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:01.392 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101728 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2588672~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.890766302000003, 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091140633999999998, 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101728 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502183+0000", 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8599999999999998e-07 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502187+0000", 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.517e-06 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502196+0000", 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5100000000000004e-06 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502204+0000", 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.593e-06 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593008+0000", 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090803998999999996 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593145+0000", 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000136685 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593323+0000", 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017864399999999999 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101729 3.16 3:6b4938db:::rbd_data.111860f58c0c.0000000000000000:22 [read 4866048~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.890734652999996, 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091455232999999997, 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101729 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502214+0000", 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502215+0000", 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0400000000000005e-07 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502218+0000", 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3160000000000001e-06 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502227+0000", 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000004e-06 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502238+0000", 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063000000000001e-05 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593397+0000", 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091158890000000006 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593517+0000", 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119325 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593670+0000", 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000152855 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101730 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2686976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.890698509999993, 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091814732999999996, 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101730 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502250+0000", 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502251+0000", 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5000000000000002e-07 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502254+0000", 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1030000000000002e-06 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502263+0000", 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9840000000000007e-06 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502271+0000", 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8529999999999992e-06 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593753+0000", 2024-09-12T05:23:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091481867999999994 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.593891+0000", 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138135 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594065+0000", 2024-09-12T05:23:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017414000000000001 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101732 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2785280~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.890667699999995, 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092143002000000002, 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101732 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502281+0000", 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502282+0000", 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7999999999999995e-07 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502285+0000", 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2160000000000002e-06 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502294+0000", 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0829999999999993e-06 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502302+0000", 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6299999999999998e-06 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594147+0000", 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091844644000000003 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594270+0000", 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012364 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594424+0000", 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015410900000000001 2024-09-12T05:23:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101734 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.890637140999999, 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092503638999999999, 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101734 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502312+0000", 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502313+0000", 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1699999999999997e-07 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502316+0000", 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0000000000000001e-06 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502324+0000", 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6959999999999994e-06 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502332+0000", 2024-09-12T05:23:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6369999999999999e-06 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594507+0000", 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092175306999999998 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594643+0000", 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013585499999999999 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594815+0000", 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000172227 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101735 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 2998272~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.890607244999998, 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092786376000000004, 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101735 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.502342+0000", 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.503984+0000", 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016423849999999999 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504028+0000", 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3578999999999997e-05 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504053+0000", 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4876e-05 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504067+0000", 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4527e-05 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594857+0000", 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090789810999999998 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.594980+0000", 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012354999999999999 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595128+0000", 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014764800000000001 2024-09-12T05:23:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101737 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.888850301999994, 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091439357999999998, 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101737 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504099+0000", 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504100+0000", 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-06 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504104+0000", 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3239999999999996e-06 2024-09-12T05:23:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504116+0000", 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1466e-05 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504128+0000", 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2163e-05 2024-09-12T05:23:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595228+0000", 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091100743999999997 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595367+0000", 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138648 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595538+0000", 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017088699999999999 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101739 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 3194880~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.888806732999996, 2024-09-12T05:23:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091733002999999994, 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101739 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504142+0000", 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504143+0000", 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5000000000000001e-07 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504147+0000", 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4529999999999998e-06 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504156+0000", 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6730000000000004e-06 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504164+0000", 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5669999999999997e-06 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595610+0000", 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091446147000000005 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595729+0000", 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118569 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595875+0000", 2024-09-12T05:23:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000146644 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101762 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4112384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.888574843000001, 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091898718000000004, 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101762 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504374+0000", 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504375+0000", 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2270000000000001e-06 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504381+0000", 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4430000000000002e-06 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504397+0000", 2024-09-12T05:23:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6385999999999999e-05 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504411+0000", 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.348e-05 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.595961+0000", 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091550729999999997 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596103+0000", 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014118099999999999 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596273+0000", 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000170271 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101764 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4210688~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.888453932000004, 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092120664000000005, 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101764 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504495+0000", 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504496+0000", 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-12T05:23:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504502+0000", 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7239999999999997e-06 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504519+0000", 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7059e-05 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504537+0000", 2024-09-12T05:23:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8312999999999999e-05 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596350+0000", 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091812294000000003 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596470+0000", 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119979 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596616+0000", 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014611499999999999 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101766 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4423680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.888336894000005, 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092393570999999994, 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101766 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504612+0000", 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504614+0000", 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5269999999999999e-06 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504619+0000", 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4829999999999999e-06 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504636+0000", 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113e-05 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504649+0000", 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2836999999999999e-05 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596699+0000", 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092049781999999997 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.596836+0000", 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013691199999999999 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597006+0000", 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016991700000000001 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101768 3.16 3:6f737c7c:::rbd_data.111860f58c0c.0000000000000003:22 [read 4521984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.888217286, 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092614824999999998, 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101768 2024-09-12T05:23:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504732+0000", 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504733+0000", 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.237e-06 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504739+0000", 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8730000000000004e-06 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504756+0000", 2024-09-12T05:23:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7113999999999999e-05 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.504770+0000", 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4066000000000001e-05 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597082+0000", 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092311956000000001 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597202+0000", 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011997099999999999 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.597346+0000", 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014460800000000001 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101776 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4096000~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.885238559000001, 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091111153, 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101776 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507710+0000", 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507711+0000", 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999996e-07 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507714+0000", 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9869999999999999e-06 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507723+0000", 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1670000000000005e-06 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507731+0000", 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.34e-06 2024-09-12T05:23:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598554+0000", 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.090823844000000001 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598676+0000", 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121877 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598822+0000", 2024-09-12T05:23:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000145272 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101778 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4194304~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.885204252999998, 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091494428000000003, 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101778 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507745+0000", 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9699999999999995e-07 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507749+0000", 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.207e-06 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507758+0000", 2024-09-12T05:23:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9029999999999993e-06 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507765+0000", 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0859999999999996e-06 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.598906+0000", 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091141086999999996 2024-09-12T05:23:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599044+0000", 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138598 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599239+0000", 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019484999999999999 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101780 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4308992~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.885172076999993, 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091796405999999997, 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101780 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507777+0000", 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507778+0000", 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0999999999999997e-07 2024-09-12T05:23:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507783+0000", 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2299999999999999e-06 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507801+0000", 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8389999999999998e-05 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507816+0000", 2024-09-12T05:23:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4113e-05 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599312+0000", 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091496794000000006 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599429+0000", 2024-09-12T05:23:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011664500000000001 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599573+0000", 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014432400000000001 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101782 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4407296~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.885110460999996, 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092132555000000005, 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101782 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507838+0000", 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507840+0000", 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4929999999999999e-06 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507845+0000", 2024-09-12T05:23:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3229999999999997e-06 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507862+0000", 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6753999999999999e-05 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507875+0000", 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3396e-05 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599656+0000", 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.091780319999999999 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599796+0000", 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014014799999999999 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.599971+0000", 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017512100000000001 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101784 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4505600~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.885055105000006, 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092414708999999998, 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101784 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507894+0000", 2024-09-12T05:23:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507895+0000", 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1599999999999999e-06 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507900+0000", 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2329999999999997e-06 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507917+0000", 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6739999999999999e-05 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507930+0000", 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3149999999999999e-05 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600046+0000", 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092116229999999993 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600164+0000", 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117374 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600309+0000", 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014482199999999999 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101786 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4603904~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.885000298999998, 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092759523999999996, 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101786 2024-09-12T05:23:01.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507949+0000", 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507950+0000", 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5999999999999991e-07 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507955+0000", 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2390000000000002e-06 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.507974+0000", 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9449999999999998e-05 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508010+0000", 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6146000000000003e-05 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600392+0000", 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092381291000000004 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600528+0000", 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013607100000000001 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600708+0000", 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018036699999999999 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:101788 3.16 3:6f75c59d:::rbd_data.111860f58c0c.0000000000000004:22 [read 4816896~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 83.884840624999995, 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092909090999999999, 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.479 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 101788 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508108+0000", 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508110+0000", 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7659999999999999e-06 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508116+0000", 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508134+0000", 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8533999999999999e-05 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.508148+0000", 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600750+0000", 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.092601392000000005 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.600866+0000", 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000115858 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:37.601017+0000", 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015183199999999999 2024-09-12T05:23:01.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:115892 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_name in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118)", 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.169659097999997, 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.54022301299999997, 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:01.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 115892 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223290+0000", 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223292+0000", 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2639999999999998e-06 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223302+0000", 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8959999999999998e-06 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223325+0000", 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-05 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223459+0000", 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013345300000000001 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223539+0000", 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0346000000000006e-05 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.223552+0000", 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3264e-05 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:01.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763244+0000", 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.53969141899999995 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763377+0000", 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013312999999999999 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:14.763513+0000", 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013600099999999999 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:01.489 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:01.489 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:01.490 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:23:01.491 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:01.490+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:01.591 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:01.590+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:01.616 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-12T05:23:01.614+0000 7f6402832640 -1 mon.a@0(leader).osd e165 definitely_dead 0 2024-09-12T05:23:01.659 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:01.659 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:01.659 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:23:01.660 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:01.673 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:23:01.692 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:01.694+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:01.793 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:01.794+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:marked in osd.1. 2024-09-12T05:23:01.841 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-12T05:23:01.854 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:23:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:23:01.854 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:01.869 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:23:01.894 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:01.894+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:01.995 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:01.994+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:02.040 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:02.040 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:23:02.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.86839393599999, 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:23:02.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:23:02.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.045 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.86769241600001, 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.86756968200001, 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:23:02.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:23:02.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.867507469, 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:23:02.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:23:02.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.867440652, 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.060 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:23:02.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.86738061899999, 2024-09-12T05:23:02.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:23:02.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:23:02.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:23:02.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.867300683, 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.069 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:23:02.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:23:02.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.867241122, 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:23:02.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:23:02.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.867166333, 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:23:02.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:23:02.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.867028933, 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:23:02.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:23:02.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:23:02.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.866877198, 2024-09-12T05:23:02.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.866814224, 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:23:02.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:23:02.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:23:02.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.86667833199999, 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:23:02.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.86661437199999, 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:23:02.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:23:02.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.866530119, 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:23:02.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:23:02.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.86647075900001, 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:23:02.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.866410492, 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:23:02.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.866347499, 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.120 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:23:02.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:23:02.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 141.86618689100001, 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:23:02.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:23:02.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:23:02.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 98.422955177000006, 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.129 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:23:02.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:02.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.133 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:02.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:23:02.135 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:02.134+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:02.236 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:02.238+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:02.304 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:02.305 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:02.305 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:23:02.305 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:02.318 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:23:02.360 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:02.362+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:02.438 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:02.438+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:02.483 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:02.483 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:02.483 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:23:02.483 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:23:02.483 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:02.497 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:23:02.540 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:02.542+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:02.639 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:02.638+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.424603679000001, 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:23:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:23:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:23:02.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.423589957000004, 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.669 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:23:02.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.422896096000002, 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.674 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:23:02.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.679 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.419911252999995, 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:23:02.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:23:02.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.419669928000005, 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:23:02.685 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:23:02.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.418921718000007, 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:23:02.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:23:02.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.418609957000001, 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.696 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:23:02.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.417886995999993, 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:23:02.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.416588077, 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:23:02.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:23:02.712 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.414036323000005, 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:23:02.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:23:02.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.413257833000003, 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:23:02.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:23:02.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:23:02.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:23:02.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.726 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.412985492000004, 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.727 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.411709205999998, 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.732 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:23:02.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.410306590000005, 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.738 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:23:02.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:23:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:23:02.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.409591089000003, 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:23:02.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.749 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.408269692999994, 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.407193047999996, 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.755 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:23:02.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.760 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.406970303999998, 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:23:02.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:23:02.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.406349265000003, 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.766 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:23:02.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:23:02.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.404701132, 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:23:02.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:23:02.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:23:02.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:23:02.778 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.778 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.778 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.778 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.778 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.778 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:02.779 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:23:02.780 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:02.778+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:02.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:23:02.880 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:02.882+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:02.950 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:02.950 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:23:02.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.951 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:122445 3.1a 3.ac0e573a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e166)", 2024-09-12T05:23:02.951 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:23:01.860618+0000", 2024-09-12T05:23:02.951 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.092321157, 2024-09-12T05:23:02.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0923629130000001, 2024-09-12T05:23:02.952 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:02.952 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:02.952 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-12T05:23:02.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:02.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:02.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:02.953 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 122445 2024-09-12T05:23:02.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:02.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:02.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:01.860618+0000", 2024-09-12T05:23:02.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:02.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:01.860618+0000", 2024-09-12T05:23:02.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:02.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:02.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:01.860620+0000", 2024-09-12T05:23:02.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5150000000000001e-06 2024-09-12T05:23:02.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:02.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:01.860633+0000", 2024-09-12T05:23:02.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2418999999999999e-05 2024-09-12T05:23:02.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:02.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:01.860663+0000", 2024-09-12T05:23:02.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0434e-05 2024-09-12T05:23:02.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:02.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:01.860678+0000", 2024-09-12T05:23:02.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.472e-05 2024-09-12T05:23:02.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:01.860797+0000", 2024-09-12T05:23:02.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118999 2024-09-12T05:23:02.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:01.860814+0000", 2024-09-12T05:23:02.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7452000000000002e-05 2024-09-12T05:23:02.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:02.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:02.827911+0000", 2024-09-12T05:23:02.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.96709657900000001 2024-09-12T05:23:02.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:02.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:02.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:02.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:23:02.827944+0000", 2024-09-12T05:23:02.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3136999999999998e-05 2024-09-12T05:23:02.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.963 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:02.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:02.964 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-12T05:23:02.964 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-09-12T05:23:02.964 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:02.966 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:23:02.981 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:02.982+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:03.081 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:03.082+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:03.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:23:03.133 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:03.134 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:03.134 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:23:03.134 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:23:03.134 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:03.147 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:23:03.182 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:03.182+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:03.242 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:23:03.243 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:23:03.259 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:23:03.259 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:23:03.276 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:23:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:23:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:23:03.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:03.282+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:03.302 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:23:03.302 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:23:03.317 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:03.317 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:03.322 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:23:03.322 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:23:03.332 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:23:03.343 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:23:03.344 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:23:03.364 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:23:03.365 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:23:03.369 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:23:03.369 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:23:03.413 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:23:03.414+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:23:03.471 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:03.471 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:03.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:23:03.486 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:23:03.486+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:23:03.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:03.586+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:03.654 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:03.655 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:03.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:23:03.713 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:03.714+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:03.789 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:03.790+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:03.796 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:03.796 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:03.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:23:03.812 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:23:03.901 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:03.902+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:03.957 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:03.957 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:03.973 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:23:03.989 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:03.990+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:04.090 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:04.090+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:04.145 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:04.145 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:04.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:23:04.201 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:04.202+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:04.292 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:04.294+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:04.331 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:04.331 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:04.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:23:04.393 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:04.394+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:04.481 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:04.481 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:04.494 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:04.494+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:04.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:23:04.595 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:04.594+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:04.623 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:04.624 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:04.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:23:04.696 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:04.698+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:04.797 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:04.798+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:04.824 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:04.824 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:04.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:23:04.898 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:04.898+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:04.973 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:04.973 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:04.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:23:05.032 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:05.034+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:05.099 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:05.098+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:05.155 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:05.155 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:05.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:23:05.212 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:05.214+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:05.300 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:05.302+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:05.335 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:05.336 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:05.349 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:23:05.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T05:23:05.440 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:05.442+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:05.503 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:05.502+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:05.513 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:05.514 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:05.528 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:23:05.540 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:23:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:23:05.556 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:23:05.557 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:23:05.573 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:23:05.573 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:23:05.573 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:23:05.596 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:23:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:23:05.615 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:23:05.615 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:23:05.616 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:05.618+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:05.633 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:23:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:23:05.653 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:23:05.653 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:23:05.656 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:23:05.657 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:23:05.694 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:05.694 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:05.694 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:23:05.695 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:23:05.695 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:05.704 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:05.702+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:05.708 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:23:05.805 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:05.806+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:05.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:23:05.884 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:05.884 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:23:05.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:23:05.884 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22142 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71289089199999, 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043027317000000002, 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22142 2024-09-12T05:23:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171886+0000", 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171887+0000", 2024-09-12T05:23:05.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171894+0000", 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3060000000000003e-06 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171912+0000", 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006e-05 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.171926+0000", 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4259e-05 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214529+0000", 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042603139999999998 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214714+0000", 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018458799999999999 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.214913+0000", 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019921500000000001 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22160 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71218937200001, 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043369597000000003, 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.889 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22160 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172587+0000", 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172588+0000", 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069999999999999e-06 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172594+0000", 2024-09-12T05:23:05.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.536e-06 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172616+0000", 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2218999999999999e-05 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172631+0000", 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4856e-05 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215526+0000", 2024-09-12T05:23:05.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042895402999999999 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215768+0000", 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024216900000000001 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215957+0000", 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000188307 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22189 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71206663800001, 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043089123, 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22189 2024-09-12T05:23:05.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172710+0000", 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172711+0000", 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1969999999999999e-06 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172717+0000", 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3559999999999998e-06 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172737+0000", 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9434999999999999e-05 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172751+0000", 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4133e-05 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215496+0000", 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042744812 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215602+0000", 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105974 2024-09-12T05:23:05.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215799+0000", 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197216 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22190 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.898 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.712004425, 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.04339018, 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22190 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:23:05.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172772+0000", 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172774+0000", 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.423e-06 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172790+0000", 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6140000000000001e-05 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172804+0000", 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859000000000001e-05 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172818+0000", 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4569000000000001e-05 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.215889+0000", 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043070651000000001 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216021+0000", 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132688 2024-09-12T05:23:05.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216162+0000", 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014085000000000001 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22191 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.711937608, 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043816766, 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.903 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22191 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172839+0000", 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172840+0000", 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0330000000000001e-06 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172846+0000", 2024-09-12T05:23:05.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1929999999999998e-06 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172865+0000", 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8468999999999999e-05 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172879+0000", 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4063000000000001e-05 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216220+0000", 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043341059000000001 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216388+0000", 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016832500000000001 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216656+0000", 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267624 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22192 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 917504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71187757499999, 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044333074, 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22192 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172899+0000", 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172900+0000", 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.257e-06 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172906+0000", 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4500000000000003e-06 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172924+0000", 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805999999999999e-05 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172958+0000", 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4217999999999997e-05 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216771+0000", 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043813288999999998 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216983+0000", 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021158 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217232+0000", 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024947400000000002 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22193 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.711797639, 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044604600000000001, 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22193 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172979+0000", 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172980+0000", 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.217e-06 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.172986+0000", 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5099999999999998e-06 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173004+0000", 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8414999999999999e-05 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173018+0000", 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3783e-05 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217333+0000", 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044314917000000002 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217480+0000", 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147286 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217584+0000", 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103472 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.916 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22194 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.711738078, 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045043745000000003, 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22194 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173038+0000", 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173040+0000", 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.136e-06 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173058+0000", 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8646000000000001e-05 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173077+0000", 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9116000000000001e-05 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173092+0000", 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4789e-05 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217668+0000", 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044576056000000003 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217862+0000", 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019361899999999999 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218082+0000", 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022038299999999999 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.920 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22195 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.711663289, 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045415521, 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.921 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22195 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173113+0000", 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173115+0000", 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173133+0000", 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173152+0000", 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9015e-05 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173167+0000", 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4139e-05 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218180+0000", 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045013188000000003 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218381+0000", 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020138600000000001 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218529+0000", 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014766700000000001 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22196 3.a 3:54aa0169:::rbd_data.11186ec76cc4.0000000000000003:c [read 1933312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.711525889, 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045525717, 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.925 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22196 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173251+0000", 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173252+0000", 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3629999999999999e-06 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173260+0000", 2024-09-12T05:23:05.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2120000000000003e-06 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173280+0000", 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9983000000000002e-05 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173308+0000", 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7424999999999999e-05 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218569+0000", 2024-09-12T05:23:05.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045261619000000003 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218686+0000", 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116668 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218776+0000", 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0446999999999996e-05 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22198 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 327680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.711374154, 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043216376000000001, 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22198 2024-09-12T05:23:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173402+0000", 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173404+0000", 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.15e-06 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173409+0000", 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7930000000000003e-06 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173429+0000", 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0112e-05 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173444+0000", 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4266e-05 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216373+0000", 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042929690999999999 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216469+0000", 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5444000000000003e-05 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216619+0000", 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014992 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22199 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:23:05.934 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71131118, 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043957624000000001, 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22199 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173465+0000", 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173467+0000", 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.176e-06 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173473+0000", 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6490000000000002e-06 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173523+0000", 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9802000000000002e-05 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173539+0000", 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5529e-05 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.216802+0000", 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043263068000000002 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217054+0000", 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025255600000000003 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217423+0000", 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036884400000000001 2024-09-12T05:23:05.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22200 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71117528799999, 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044347270000000001, 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22200 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173601+0000", 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173603+0000", 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4270000000000001e-06 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173610+0000", 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8530000000000003e-06 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173628+0000", 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8779000000000001e-05 2024-09-12T05:23:05.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173643+0000", 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4521999999999999e-05 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217491+0000", 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043848449999999997 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217684+0000", 2024-09-12T05:23:05.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019271300000000001 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.217949+0000", 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026452600000000001 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22201 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71111132799999, 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044749471999999998, 2024-09-12T05:23:05.943 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22201 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173665+0000", 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173667+0000", 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.297e-06 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173672+0000", 2024-09-12T05:23:05.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173689+0000", 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6558999999999998e-05 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173717+0000", 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8711999999999999e-05 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218018+0000", 2024-09-12T05:23:05.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044301027 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218137+0000", 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118925 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218415+0000", 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027746599999999998 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22202 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.711027075, 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045148316000000001, 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22202 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.948 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173749+0000", 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173751+0000", 2024-09-12T05:23:05.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1000000000000001e-06 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173757+0000", 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1589999999999998e-06 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173773+0000", 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5826000000000001e-05 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173787+0000", 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4233000000000001e-05 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218500+0000", 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044713239000000002 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218702+0000", 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201747 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218898+0000", 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019601199999999999 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22203 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1343488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71096771500001, 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045325918999999999, 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.952 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22203 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173809+0000", 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173810+0000", 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173816+0000", 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173834+0000", 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7189000000000001e-05 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173848+0000", 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4173e-05 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.218970+0000", 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045122135000000001 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219059+0000", 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9191999999999996e-05 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219135+0000", 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5757e-05 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.956 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22204 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.710907448, 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045613065000000001, 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22204 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173869+0000", 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173870+0000", 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173877+0000", 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4629999999999998e-06 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173897+0000", 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0134999999999999e-05 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173911+0000", 2024-09-12T05:23:05.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4326e-05 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219232+0000", 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045320966999999997 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219372+0000", 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014005300000000001 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219482+0000", 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110031 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22205 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.710844455, 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046094152999999999, 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22205 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173932+0000", 2024-09-12T05:23:05.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173933+0000", 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173953+0000", 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9825000000000001e-05 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173977+0000", 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4439000000000001e-05 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.173993+0000", 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219582+0000", 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045589060000000001 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.219809+0000", 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000227591 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220026+0000", 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021705499999999999 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.965 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:22206 3.10 3:0949725f:::rbd_data.11186ec76cc4.0000000000000004:c [read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 145.71068384700001, 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046324861000000002, 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22206 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174093+0000", 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174095+0000", 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3039999999999999e-06 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174107+0000", 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2169e-05 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174136+0000", 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9059000000000001e-05 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.174158+0000", 2024-09-12T05:23:05.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1254999999999999e-05 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220088+0000", 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045930265999999997 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220223+0000", 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135587 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:20:40.220418+0000", 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019422100000000001 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:83683 3.0 e76/75 3:06ecd57d:::rbd_data.11182b429d69.0000000000000000:head v 76'651, mlcod=0'0)", 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 102.26745213300001, 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.056658927999999997, 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:05.970 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617324+0000", 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.617325+0000", 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640144+0000", 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022819151999999999 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640181+0000", 2024-09-12T05:23:05.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643000000000001e-05 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640197+0000", 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5916000000000001e-05 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640337+0000", 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000139708 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:05.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.640425+0000", 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8638000000000001e-05 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673916+0000", 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.033491198 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:23.673983+0000", 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6915999999999994e-05 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.974 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:05.975 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:05.975 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:05.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:23:05.977 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:05.978+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:06.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:06.078+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:06.146 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:06.146 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:06.146 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:23:06.146 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:06.160 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:23:06.178 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:06.178+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:06.279 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:06.278+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:06.326 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:06.326 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:06.326 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:23:06.326 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:23:06.327 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:06.340 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:23:06.384 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:06.386+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:06.482 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:06.482+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:06.504 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104525 3.f 3:f2a89abd:::rbd_data.1118e5d0fec8.0000000000000038:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.264854679999999, 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7858547580000002, 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104525 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239317+0000", 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239318+0000", 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4959999999999999e-06 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239324+0000", 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-06 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239342+0000", 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8110000000000001e-05 2024-09-12T05:23:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.239356+0000", 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3864e-05 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240116+0000", 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00075975399999999996 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240139+0000", 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3408999999999999e-05 2024-09-12T05:23:06.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992511+0000", 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75237213700000005 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992528+0000", 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6673000000000001e-05 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.024922+0000", 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0323943099999999 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025171+0000", 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000249025 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.510 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104579 3.f 3:f2c8a91c:::rbd_data.1118e5d0fec8.000000000000006e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.263840958000003, 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7853903149999999, 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104579 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240330+0000", 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240332+0000", 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3599999999999999e-06 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240338+0000", 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.896e-06 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240357+0000", 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9233999999999999e-05 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240373+0000", 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5936000000000001e-05 2024-09-12T05:23:06.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240499+0000", 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012578200000000001 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.240520+0000", 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1056999999999998e-05 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992597+0000", 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75207722499999996 2024-09-12T05:23:06.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992606+0000", 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0729999999999994e-06 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025530+0000", 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0329243960000001 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025721+0000", 2024-09-12T05:23:06.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019035600000000001 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104593 3.f 3:f11995a7:::rbd_data.1118e5d0fec8.000000000000007c:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.263147097000001, 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7850708769999999, 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104593 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241024+0000", 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241026+0000", 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6330000000000001e-06 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241047+0000", 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1512999999999999e-05 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241085+0000", 2024-09-12T05:23:06.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7107000000000002e-05 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241101+0000", 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6702999999999999e-05 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241279+0000", 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017792799999999999 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.241301+0000", 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2010000000000001e-05 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992640+0000", 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.75133894000000001 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992647+0000", 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2300000000000002e-06 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.025891+0000", 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033243181 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026095+0000", 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000204632 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.521 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104626 3.f 3:f32fc80d:::rbd_data.1118e5d0fec8.000000000000009d:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.260162253999994, 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7822975560000001, 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104626 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244009+0000", 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244011+0000", 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.826e-06 2024-09-12T05:23:06.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244017+0000", 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6540000000000004e-06 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244035+0000", 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8632999999999999e-05 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244050+0000", 2024-09-12T05:23:06.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4456e-05 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244199+0000", 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149302 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244219+0000", 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.014e-05 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992676+0000", 2024-09-12T05:23:06.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74845735499999999 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992683+0000", 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9e-06 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026143+0000", 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0334591340000001 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026307+0000", 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016415599999999999 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104632 3.f 3:f78674c7:::rbd_data.1118e5d0fec8.00000000000000a3:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.259920929000003, 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7824481379999999, 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.527 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104632 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244250+0000", 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244252+0000", 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.81e-06 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244260+0000", 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8429999999999993e-06 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244280+0000", 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0129e-05 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244304+0000", 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3762999999999999e-05 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244440+0000", 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013608899999999999 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244460+0000", 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9437e-05 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992711+0000", 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74825199099999995 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992718+0000", 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4330000000000001e-06 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026537+0000", 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.033819397 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026699+0000", 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016124600000000001 2024-09-12T05:23:06.532 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104634 3.f 3:f20ca195:::rbd_data.1118e5d0fec8.00000000000000a5:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.259172719000006, 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7819572290000001, 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104634 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.244999+0000", 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245000+0000", 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7969999999999999e-06 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245043+0000", 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2539e-05 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245069+0000", 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5633e-05 2024-09-12T05:23:06.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245087+0000", 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8620000000000001e-05 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245239+0000", 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015212599999999999 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245260+0000", 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0766000000000001e-05 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992745+0000", 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74748532899999998 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992752+0000", 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6540000000000002e-06 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026769+0000", 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0340167199999999 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.026956+0000", 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000187045 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104637 3.f 3:f686650a:::rbd_data.1118e5d0fec8.00000000000000a8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:23:06.538 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.258860958, 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781904103, 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104637 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:23:06.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245310+0000", 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245312+0000", 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7460000000000001e-06 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245320+0000", 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9000000000000006e-06 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245341+0000", 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0897e-05 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245358+0000", 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6816999999999998e-05 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245489+0000", 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013132500000000001 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.245510+0000", 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0757000000000001e-05 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992781+0000", 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74727144099999998 2024-09-12T05:23:06.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992788+0000", 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3629999999999999e-06 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027054+0000", 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034266138 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027215+0000", 2024-09-12T05:23:06.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000160719 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104646 3.f 3:f592679e:::rbd_data.1118e5d0fec8.00000000000000b1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.258137997000006, 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781415427, 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.544 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104646 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246033+0000", 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246035+0000", 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.55e-06 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246042+0000", 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7859999999999999e-06 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246065+0000", 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2863000000000001e-05 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246081+0000", 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5937e-05 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246213+0000", 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000132006 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.246232+0000", 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.931e-05 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992818+0000", 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74658642600000003 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992824+0000", 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1959999999999996e-06 2024-09-12T05:23:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027283+0000", 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0344582739999999 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027449+0000", 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016607899999999999 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104653 3.f 3:f3d3ccfa:::rbd_data.1118e5d0fec8.00000000000000b8:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.256839077999999, 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7805785140000001, 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104653 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247332+0000", 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247334+0000", 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.734e-06 2024-09-12T05:23:06.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247343+0000", 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7630000000000006e-06 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247365+0000", 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2229999999999999e-05 2024-09-12T05:23:06.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247382+0000", 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.721e-05 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247555+0000", 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017249499999999999 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.247575+0000", 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0590000000000001e-05 2024-09-12T05:23:06.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992863+0000", 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74528797499999999 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992870+0000", 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7240000000000003e-06 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027750+0000", 2024-09-12T05:23:06.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0348797869999999 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.027911+0000", 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000161006 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104678 3.f 3:f17356a8:::rbd_data.1118e5d0fec8.00000000000000d1:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.254287324000003, 2024-09-12T05:23:06.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7783188509999999, 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104678 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249884+0000", 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249885+0000", 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.24e-06 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249891+0000", 2024-09-12T05:23:06.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4160000000000003e-06 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249909+0000", 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7886000000000001e-05 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.249923+0000", 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.435e-05 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250115+0000", 2024-09-12T05:23:06.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019220899999999999 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250137+0000", 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1946999999999998e-05 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992908+0000", 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74277121999999995 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992915+0000", 2024-09-12T05:23:06.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5339999999999996e-06 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028001+0000", 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0350858439999999 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028203+0000", 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020220500000000001 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104684 3.f 3:f20d0d5c:::rbd_data.1118e5d0fec8.00000000000000d7:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.253508834000002, 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777740586, 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104684 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.561 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250663+0000", 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250665+0000", 2024-09-12T05:23:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2500000000000001e-06 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250673+0000", 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4759999999999998e-06 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250695+0000", 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1452999999999999e-05 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250713+0000", 2024-09-12T05:23:06.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8127000000000001e-05 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250862+0000", 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014918200000000001 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250895+0000", 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3346999999999998e-05 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992945+0000", 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74204979699999996 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992950+0000", 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7389999999999999e-06 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028256+0000", 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.035305642 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028403+0000", 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014757299999999999 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104686 3.f 3:f14f33b0:::rbd_data.1118e5d0fec8.00000000000000d9:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.253236493000003, 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.777753449, 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.566 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104686 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250935+0000", 2024-09-12T05:23:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250936+0000", 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5060000000000001e-06 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250944+0000", 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9070000000000007e-06 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250965+0000", 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1123000000000001e-05 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.250981+0000", 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6010000000000001e-05 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251131+0000", 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000150063 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.251151+0000", 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9579e-05 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992983+0000", 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74183162599999997 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.992990+0000", 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0589999999999997e-06 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028491+0000", 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0355014680000001 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028688+0000", 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019710800000000001 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104711 3.f 3:f6ff99c6:::rbd_data.1118e5d0fec8.00000000000000f2:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.251960206999996, 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7766771750000001, 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104711 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252211+0000", 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252213+0000", 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5370000000000001e-06 2024-09-12T05:23:06.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252219+0000", 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6329999999999999e-06 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252238+0000", 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8666999999999999e-05 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252254+0000", 2024-09-12T05:23:06.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5613000000000001e-05 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252425+0000", 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000171669 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.252451+0000", 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5398999999999999e-05 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993019+0000", 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.74056833799999999 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993023+0000", 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3789999999999999e-06 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028739+0000", 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0357160839999999 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028888+0000", 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148856 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104822 3.f 3:f3d2d81e:::rbd_data.1118e5d0fec8.0000000000000161:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.250557591000003, 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.781074949, 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.577 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104822 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253614+0000", 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253615+0000", 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.677e-06 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253621+0000", 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.49e-06 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253639+0000", 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7710000000000002e-05 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.253652+0000", 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3129000000000001e-05 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254055+0000", 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00040319299999999999 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254075+0000", 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9976999999999999e-05 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993056+0000", 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73898101400000005 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993064+0000", 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8650000000000001e-06 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.028975+0000", 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0359114970000001 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029198+0000", 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022223100000000001 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034564+0000", 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053668140000000001 2024-09-12T05:23:06.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.034689+0000", 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012435199999999999 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.583 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104837 3.f 3:f3112bc3:::rbd_data.1118e5d0fec8.0000000000000170:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.249842090000001, 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.775104784, 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104837 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254329+0000", 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254331+0000", 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3459999999999999e-06 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254352+0000", 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1143999999999999e-05 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254373+0000", 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.09e-05 2024-09-12T05:23:06.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254464+0000", 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1194999999999997e-05 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254592+0000", 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128419 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.254612+0000", 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9463999999999999e-05 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993093+0000", 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73848129100000004 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993097+0000", 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3579999999999996e-06 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029262+0000", 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036164761 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029434+0000", 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017190599999999999 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104896 3.f 3:f3d0c138:::rbd_data.1118e5d0fec8.00000000000001ab:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.589 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.248520694000007, 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.774083775, 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104896 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255651+0000", 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255652+0000", 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.333e-06 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255658+0000", 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8370000000000002e-06 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255677+0000", 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8940000000000002e-05 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255691+0000", 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4486e-05 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255881+0000", 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018932899999999999 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.255902+0000", 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1356e-05 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993127+0000", 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73722518599999998 2024-09-12T05:23:06.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993134+0000", 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1420000000000004e-06 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029536+0000", 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0364013940000001 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029734+0000", 2024-09-12T05:23:06.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000198772 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104959 3.f 3:f76257e6:::rbd_data.1118e5d0fec8.00000000000001ea:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.247444048999995, 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.773217842, 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104959 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256727+0000", 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256729+0000", 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-06 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256734+0000", 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3369999999999999e-06 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256752+0000", 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7836e-05 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256771+0000", 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8936999999999998e-05 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256895+0000", 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012388899999999999 2024-09-12T05:23:06.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256918+0000", 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3516e-05 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993163+0000", 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73624520000000004 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993168+0000", 2024-09-12T05:23:06.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3800000000000004e-06 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029785+0000", 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0366172220000001 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.029945+0000", 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016032199999999999 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104969 3.f 3:f6d993d0:::rbd_data.1118e5d0fec8.00000000000001f4:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.247221304999997, 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7732786890000001, 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.601 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104969 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256950+0000", 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256952+0000", 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.517e-06 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256958+0000", 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.256982+0000", 2024-09-12T05:23:06.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.421e-05 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257002+0000", 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0387e-05 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257120+0000", 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000117302 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257147+0000", 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6752999999999999e-05 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993200+0000", 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73605387700000002 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993208+0000", 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2450000000000001e-06 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030035+0000", 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.036827086 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030229+0000", 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000194002 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:104991 3.f 3:f63942bd:::rbd_data.1118e5d0fec8.000000000000020a:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.606 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.246600266000002, 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.77314518, 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 104991 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257571+0000", 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257573+0000", 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257580+0000", 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7530000000000004e-06 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257598+0000", 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-05 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257613+0000", 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5187e-05 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257734+0000", 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121505 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.257752+0000", 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7714e-05 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993276+0000", 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73552373699999996 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993283+0000", 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030515+0000", 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037231048 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.030716+0000", 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020176300000000001 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.611 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:105021 3.f 3:f23ba7a7:::rbd_data.1118e5d0fec8.0000000000000228:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 80.244952132999998, 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7831120499999999, 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:06.612 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 105021 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259219+0000", 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259221+0000", 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3769999999999999e-06 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259227+0000", 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4030000000000004e-06 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259247+0000", 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9587000000000001e-05 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259263+0000", 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6867e-05 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259405+0000", 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014149200000000001 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.259423+0000", 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8359000000000002e-05 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993428+0000", 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.73400460499999998 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:46.993435+0000", 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4939999999999997e-06 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031548+0000", 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.038112752 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for missing object", 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.031746+0000", 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019808900000000001 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042169+0000", 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010422613000000001 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:21:48.042331+0000", 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016241199999999999 2024-09-12T05:23:06.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.618 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:06.618 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:06.618 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:06.619 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:23:06.620 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:06.618+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:06.720 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:06.722+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:06.763 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:23:06.790 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:06.790 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-12T05:23:06.790 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:06.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:23:06.840 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:06.842+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:06.842 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 7, 6, 2, 1] out_osds: [] dead_osds: [3] live_osds: [0, 1, 2, 5, 6, 7, 4] 2024-09-12T05:23:06.842 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T05:23:06.842 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-12T05:23:06.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-12T05:23:06.922 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:06.922+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:06.933 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-12T05:23:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-12T05:23:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-12T05:23:06.933 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:06.947 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:23:07.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-12T05:23:07.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:07.046+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:07.124 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-12T05:23:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-12T05:23:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-12T05:23:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-12T05:23:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:116840 3.1a 3:582e491b:::rbd_data.111846fb6c83.0000000000000009:head [delete] snapc 28=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-12T05:23:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:23:07.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.181440578999997, 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0078812729999999994, 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 116840 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942044+0000", 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942046+0000", 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7700000000000002e-06 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942061+0000", 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4413000000000001e-05 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942100+0000", 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8982e-05 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942125+0000", 2024-09-12T05:23:07.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5384e-05 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942295+0000", 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017022200000000001 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942570+0000", 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027470100000000003 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:23:07.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.942807+0000", 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023657800000000001 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946714+0000", 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003907265 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949653+0000", 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0029390470000000002 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949796+0000", 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000143456 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.949925+0000", 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128455 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.130 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116836 3.13 e125/119 3:caed1d5a:::rbd_data.111846fb6c83.0000000000000005:head v 125'479, mlcod=120'477)", 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.180109799999997, 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012590459999999999, 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:23:07.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943374+0000", 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943375+0000", 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.33e-07 2024-09-12T05:23:07.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943385+0000", 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6670000000000008e-06 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943421+0000", 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6340000000000001e-05 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.943439+0000", 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7943000000000001e-05 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946692+0000", 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032526640000000002 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946753+0000", 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0736000000000003e-05 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955859+0000", 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091062309999999994 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955965+0000", 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010594600000000001 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:116834 3.a e125/117 3:523d80f0:::rbd_data.111846fb6c83.0000000000000003:head v 125'763, mlcod=123'761)", 2024-09-12T05:23:07.135 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.177715573, 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097679289999999998, 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945769+0000", 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0699999999999996e-07 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945778+0000", 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945800+0000", 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1886999999999999e-05 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.945815+0000", 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4555999999999999e-05 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946808+0000", 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0009934220000000001 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.946859+0000", 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1075999999999997e-05 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955438+0000", 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0085788310000000003 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:20.955536+0000", 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8517000000000006e-05 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117176 3.1a 3:5dbbe14f:::rbd_data.1118e5d0fec8.0000000000000043:head [delete] snapc 26=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.160565548999998, 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0090363549999999994, 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117176 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962919+0000", 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962920+0000", 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4339999999999999e-06 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962925+0000", 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4149999999999998e-06 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962941+0000", 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5308e-05 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.962952+0000", 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1715999999999999e-05 2024-09-12T05:23:07.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963039+0000", 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6458000000000005e-05 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963208+0000", 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016904499999999999 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:23:07.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.963341+0000", 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013301400000000001 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.965163+0000", 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018218679999999999 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971869+0000", 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067059950000000002 2024-09-12T05:23:07.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971913+0000", 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3707e-05 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:23.971955+0000", 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2395000000000003e-05 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.145 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:117683 3.14 3:2bb7c124:::rbd_data.1118d53b39e7.000000000000002c:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e133)", 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.077149437999999, 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0079451109999999995, 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 117683 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046335+0000", 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046337+0000", 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7439999999999999e-06 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046350+0000", 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2976000000000001e-05 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046395+0000", 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4087e-05 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046423+0000", 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8873e-05 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046740+0000", 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00031646099999999998 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.046966+0000", 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022639099999999999 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.047294+0000", 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000328241 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.053674+0000", 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0063794890000000003 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054066+0000", 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039221299999999998 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054213+0000", 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147312 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:29.054280+0000", 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6323999999999997e-05 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.7.0:3327 3.11 e143/117 3:8e65ebd0:::rbd_data.11185a81880a.0000000000000005:19 v 143'398, mlcod=135'393)", 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.140626836999999, 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0084248250000000004, 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.151 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982857+0000", 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982859+0000", 2024-09-12T05:23:07.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1229999999999998e-06 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982875+0000", 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5143999999999999e-05 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982904+0000", 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9620000000000001e-05 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982923+0000", 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9276e-05 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.982984+0000", 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0324e-05 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.983004+0000", 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0531e-05 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.991208+0000", 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0082034389999999999 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.991282+0000", 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4368000000000004e-05 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.0.0:3384 3.1b e143/118 3:de2cf152:::rbd_data.11185a81880a.0000000000000002:19 v 143'674, mlcod=138'671)", 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:23:07.155 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.136455900000001, 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011964226, 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987028+0000", 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987029+0000", 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.223e-06 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987040+0000", 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0994e-05 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987063+0000", 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2368999999999999e-05 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987085+0000", 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1685999999999999e-05 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987165+0000", 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0945999999999994e-05 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.987189+0000", 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4039000000000001e-05 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.998964+0000", 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011774420000000001 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:38.998992+0000", 2024-09-12T05:23:07.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8549000000000001e-05 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:119306 3.14 3:2c49c427:::rbd_data.11185a81880a.0000000000000003:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.980186529000001, 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022063445000000001, 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 119306 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143298+0000", 2024-09-12T05:23:07.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143300+0000", 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143329+0000", 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9539999999999998e-05 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143365+0000", 2024-09-12T05:23:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6123e-05 2024-09-12T05:23:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143386+0000", 2024-09-12T05:23:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999998e-05 2024-09-12T05:23:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143550+0000", 2024-09-12T05:23:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164098 2024-09-12T05:23:07.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143821+0000", 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027084800000000002 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.144179+0000", 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035827 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.161097+0000", 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016918182 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165221+0000", 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041235320000000001 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165288+0000", 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7333000000000001e-05 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.165361+0000", 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2694999999999994e-05 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4376.0:119305 3.1b e143/118 3:de2cf152:::rbd_data.11185a81880a.0000000000000002:head v 143'675, mlcod=140'672)", 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.979886576999998, 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020708957, 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:23:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143598+0000", 2024-09-12T05:23:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143600+0000", 2024-09-12T05:23:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.26e-06 2024-09-12T05:23:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143614+0000", 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3716e-05 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143645+0000", 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0987e-05 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143657+0000", 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2216e-05 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143792+0000", 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013486600000000001 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.143867+0000", 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5803000000000006e-05 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.164252+0000", 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02038442 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:39.164307+0000", 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4688999999999998e-05 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.175 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.5.0:4071 3.1c e151/118 3:3fd73b87:::rbd_data.11187bfcbd74.000000000000025a:11 v 151'689, mlcod=151'683)", 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.096727+0000", 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.026757188000001, 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096448750000000007, 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.176 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096727+0000", 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096727+0000", 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096728+0000", 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023e-06 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096735+0000", 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.272e-06 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096747+0000", 2024-09-12T05:23:07.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1858000000000001e-05 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096754+0000", 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4760000000000003e-06 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096861+0000", 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107205 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.096881+0000", 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0316999999999999e-05 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.106116+0000", 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0092345320000000002 2024-09-12T05:23:07.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.106372+0000", 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025619199999999998 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:120615 3.14 3:2f85e440:::rbd_data.11187bfcbd74.0000000000000024:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.230937+0000", 2024-09-12T05:23:07.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.892547605000001, 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012776595, 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 120615 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230937+0000", 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230937+0000", 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230938+0000", 2024-09-12T05:23:07.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.358e-06 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230944+0000", 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.066e-06 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230961+0000", 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7186000000000001e-05 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.230970+0000", 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6880000000000005e-06 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.231034+0000", 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4287000000000003e-05 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.231245+0000", 2024-09-12T05:23:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021081499999999999 2024-09-12T05:23:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:23:07.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.231304+0000", 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8770999999999997e-05 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.233203+0000", 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001899331 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243631+0000", 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010427542 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243681+0000", 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0392999999999997e-05 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243713+0000", 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2157999999999999e-05 2024-09-12T05:23:07.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:120625 3.14 3:2b7150ed:::rbd_data.11187bfcbd74.00000000000000ee:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:47.243595+0000", 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.879889253000002, 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0080199599999999996, 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.189 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 120625 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243595+0000", 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243595+0000", 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243597+0000", 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.843e-06 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243606+0000", 2024-09-12T05:23:07.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.234e-06 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243634+0000", 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8266e-05 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243654+0000", 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.978e-05 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.243789+0000", 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000135489 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244054+0000", 2024-09-12T05:23:07.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026497100000000002 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.244340+0000", 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028586399999999999 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.250843+0000", 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065026349999999997 2024-09-12T05:23:07.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251328+0000", 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00048484 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251482+0000", 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015435899999999999 2024-09-12T05:23:07.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:47.251615+0000", 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013267899999999999 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:120785 3.14 3:2f552367:::rbd_data.11182d2a28db.000000000000000c:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e152)", 2024-09-12T05:23:07.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:48.197957+0000", 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.925527482, 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013652331, 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 120785 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.197 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.197957+0000", 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.197957+0000", 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.197959+0000", 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.773e-06 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.197971+0000", 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.185e-05 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.198013+0000", 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1603000000000001e-05 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.198036+0000", 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2929999999999999e-05 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.198268+0000", 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023244499999999999 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.198805+0000", 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000536956 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.199098+0000", 2024-09-12T05:23:07.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00029270700000000001 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.206094+0000", 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006995818 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.211329+0000", 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052356649999999996 2024-09-12T05:23:07.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.211491+0000", 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016150800000000001 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.211609+0000", 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118076 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:120794 3.1a 3:5cd8818a:::rbd_data.11182d2a28db.0000000000000031:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e152)", 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:48.200451+0000", 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.923032952, 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0079644699999999995, 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 120794 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.200451+0000", 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.200451+0000", 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.200454+0000", 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9569999999999998e-06 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.200469+0000", 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5053e-05 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.200504+0000", 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5163000000000002e-05 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.200529+0000", 2024-09-12T05:23:07.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4830000000000001e-05 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.200790+0000", 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026050800000000001 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.201256+0000", 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046674900000000003 2024-09-12T05:23:07.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.201538+0000", 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028109199999999998 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.203255+0000", 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017172120000000001 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.208165+0000", 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004910368 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.208307+0000", 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000142146 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:48.208416+0000", 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108392 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.0.0:3502 3.1b e153/118 3:d99eb6fe:::rbd_data.111887da7c95.000000000000023f:f v 153'684, mlcod=150'680)", 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:49.106400+0000", 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.017083972999998, 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010462477, 2024-09-12T05:23:07.211 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.106400+0000", 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.106400+0000", 2024-09-12T05:23:07.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.106409+0000", 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4700000000000002e-06 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.106429+0000", 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0035999999999999e-05 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.106453+0000", 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3957000000000001e-05 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.106471+0000", 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8006999999999999e-05 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.106850+0000", 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037946600000000002 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.106900+0000", 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9966000000000002e-05 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116644+0000", 2024-09-12T05:23:07.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097438030000000005 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116863+0000", 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000218772 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.0.0:3504 3.1b e153/118 3:dbac7d2d:::rbd_data.111887da7c95.0000000000000060:f v 153'686, mlcod=150'680)", 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:49.108287+0000", 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.015197332, 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0088679840000000006, 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.108287+0000", 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.108287+0000", 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.108289+0000", 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1339999999999998e-06 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.108300+0000", 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1260000000000001e-05 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.108326+0000", 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5636e-05 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.108345+0000", 2024-09-12T05:23:07.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9483999999999998e-05 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.109226+0000", 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00088070300000000004 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.109280+0000", 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4265000000000003e-05 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116881+0000", 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00760044 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.117155+0000", 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00027406199999999999 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.7.0:3440 3.11 e153/117 3:8f27d8bd:::rbd_data.111887da7c95.0000000000000247:f v 153'439, mlcod=151'434)", 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:49.116058+0000", 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.007426273, 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0079924599999999998, 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116058+0000", 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116058+0000", 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116060+0000", 2024-09-12T05:23:07.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3939999999999999e-06 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116076+0000", 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.56e-05 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116111+0000", 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5496e-05 2024-09-12T05:23:07.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.116131+0000", 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9145999999999999e-05 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.118698+0000", 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025675730000000001 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.118758+0000", 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9929000000000002e-05 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.123948+0000", 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051898760000000004 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.124050+0000", 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102446 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.5.0:4115 3.1d e153/117 3:bbec73f0:::rbd_data.111887da7c95.000000000000005f:f v 153'756, mlcod=153'750)", 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:49.137271+0000", 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.986213592999999, 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0082237060000000008, 2024-09-12T05:23:07.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137271+0000", 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137271+0000", 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137272+0000", 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.68e-06 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137285+0000", 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2451e-05 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137312+0000", 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7032000000000001e-05 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137328+0000", 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6211000000000001e-05 2024-09-12T05:23:07.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137608+0000", 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00028044000000000002 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137649+0000", 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0506000000000001e-05 2024-09-12T05:23:07.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.145382+0000", 2024-09-12T05:23:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0077328470000000002 2024-09-12T05:23:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.145494+0000", 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112539 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(osd.7.0:3450 3.13 e153/119 3:cabf9455:::rbd_data.111887da7c95.000000000000006e:f v 153'552, mlcod=153'546)", 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:49.137469+0000", 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.986015149, 2024-09-12T05:23:07.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.008085432, 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137469+0000", 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137469+0000", 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137471+0000", 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2029999999999999e-06 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137486+0000", 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4333e-05 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137515+0000", 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9479999999999999e-05 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.137534+0000", 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9479000000000001e-05 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.138052+0000", 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00051785500000000001 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.138107+0000", 2024-09-12T05:23:07.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4361999999999999e-05 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.145436+0000", 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0073296810000000002 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.145554+0000", 2024-09-12T05:23:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118039 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4376.0:121015 3.14 3:2dba2408:::rbd_data.111887da7c95.000000000000004f:head [delete] snapc f=[] ondisk+write+known_if_redirected+supports_pool_eio e153)", 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-12T05:22:49.285532+0000", 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 17.837951667999999, 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094428519999999998, 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-12T05:23:07.239 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4376", 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 121015 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.285532+0000", 2024-09-12T05:23:07.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.285532+0000", 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.285535+0000", 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1239999999999999e-06 2024-09-12T05:23:07.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.285544+0000", 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1260000000000004e-06 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.285574+0000", 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0448999999999999e-05 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.285589+0000", 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5085999999999999e-05 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.285723+0000", 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000134172 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-12T05:23:07.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.286252+0000", 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00052817999999999995 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.286503+0000", 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025107500000000002 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.292448+0000", 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0059448490000000003 2024-09-12T05:23:07.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.294682+0000", 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022348810000000002 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.294844+0000", 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016208300000000001 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-12T05:23:07.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-12T05:22:49.294975+0000", 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000130827 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-12T05:23:07.246 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-12T05:23:07.247 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-09-12T05:23:07.122+0000 7fdbb08af640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26381) UID: 0 2024-09-12T05:23:07.248 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:23:07.249 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:07.250+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:23:07.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T05:23:07.250 INFO:tasks.thrashosds.thrasher:Failed to reset_purged_snaps_last, ignoring 2024-09-12T05:23:07.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-12T05:23:07.349 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:07.350+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:07.420 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:07.420 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:23:07.420 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:23:07.420 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:07.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T05:23:07.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:07.450+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:07.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-12T05:23:07.565 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:23:07.566+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:23:07.594 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:07.594 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:23:07.594 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-09-12T05:23:07.594 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-09-12T05:23:07.594 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:07.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T05:23:07.653 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:23:07.654+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:23:07.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T05:23:07.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-12T05:23:07.771 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:07.771 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-09-12T05:23:07.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-09-12T05:23:07.771 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-09-12T05:23:07.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.771 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:59762 3.1 3:8408889b:::rbd_data.1118c64990c9.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T05:23:07.771 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 127.652068461, 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056322856999999997, 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 59762 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119668+0000", 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119672+0000", 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7230000000000002e-06 2024-09-12T05:23:07.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119688+0000", 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6067e-05 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119729+0000", 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0890999999999999e-05 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119751+0000", 2024-09-12T05:23:07.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2161999999999999e-05 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.119919+0000", 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016772999999999999 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.120170+0000", 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025143300000000002 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 4", 2024-09-12T05:23:07.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.130275+0000", 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010105158 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175767+0000", 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045491626 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175843+0000", 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6590999999999999e-05 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:23:07.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175927+0000", 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3622000000000007e-05 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:00.175991+0000", 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3854000000000002e-05 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77593 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 12017664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.777 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.194906953, 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054938720000000003, 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77593 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:23:07.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576830+0000", 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6000000000000004e-07 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576832+0000", 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2989999999999999e-06 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576839+0000", 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8179999999999998e-06 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.576844+0000", 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9479999999999999e-06 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625785+0000", 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048941110000000003 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.625860+0000", 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4381999999999994e-05 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631768+0000", 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059086030000000001 2024-09-12T05:23:07.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77684 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15589376~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.194381428, 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054777447999999999, 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.782 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77684 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577355+0000", 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577356+0000", 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4999999999999998e-07 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577358+0000", 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2479999999999999e-06 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577365+0000", 2024-09-12T05:23:07.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8009999999999998e-06 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577370+0000", 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.366e-06 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631684+0000", 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054313779 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.631996+0000", 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031239199999999999 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632133+0000", 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013641200000000001 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77686 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14508032~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.786 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.19435888, 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054985079999999999, 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77686 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:23:07.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577378+0000", 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1099999999999995e-07 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577380+0000", 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.046e-06 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577387+0000", 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4300000000000003e-06 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577392+0000", 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2499999999999997e-06 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632167+0000", 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054775363000000001 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632253+0000", 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6073000000000001e-05 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632363+0000", 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109307 2024-09-12T05:23:07.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77688 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15261696~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.19433709, 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055157468000000001, 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77688 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577399+0000", 2024-09-12T05:23:07.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577400+0000", 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4899999999999995e-07 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577402+0000", 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.125e-06 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577409+0000", 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.703e-06 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577414+0000", 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8389999999999997e-06 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632397+0000", 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054982916999999999 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632480+0000", 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3108000000000005e-05 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632557+0000", 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7226999999999998e-05 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77689 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14925824~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.194315725, 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055320610999999999, 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77689 2024-09-12T05:23:07.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577421+0000", 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2900000000000004e-07 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577423+0000", 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.962e-06 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577431+0000", 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3540000000000002e-06 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577436+0000", 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0030000000000002e-06 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632591+0000", 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055154979999999999 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632667+0000", 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6433999999999994e-05 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632741+0000", 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4349000000000003e-05 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77692 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15605760~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.19429318, 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055483622000000003, 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77692 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577443+0000", 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577444+0000", 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.27e-07 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577446+0000", 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3319999999999999e-06 2024-09-12T05:23:07.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577453+0000", 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7739999999999999e-06 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577458+0000", 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.412e-06 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632775+0000", 2024-09-12T05:23:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055316499999999998 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632853+0000", 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8005999999999998e-05 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632927+0000", 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4171000000000005e-05 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77693 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14598144~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.194270945, 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055646176999999998, 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.805 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77693 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577466+0000", 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-07 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577468+0000", 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.153e-06 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577474+0000", 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.285e-06 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577480+0000", 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3310000000000003e-06 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.632959+0000", 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055479593000000001 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633038+0000", 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9136999999999998e-05 2024-09-12T05:23:07.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633112+0000", 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3277999999999999e-05 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77694 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14934016~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.194249361, 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055801864, 2024-09-12T05:23:07.809 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77694 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577487+0000", 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577655+0000", 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000168283 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577659+0000", 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6480000000000001e-06 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577670+0000", 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0492999999999999e-05 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577677+0000", 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.973e-06 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633142+0000", 2024-09-12T05:23:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055465759000000003 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633214+0000", 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1798999999999995e-05 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633289+0000", 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4908999999999997e-05 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77696 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 15278080~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.194047962, 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055817011999999999, 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77696 2024-09-12T05:23:07.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577689+0000", 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000001e-07 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577692+0000", 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.65e-06 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577699+0000", 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2980000000000003e-06 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577705+0000", 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9190000000000004e-06 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633319+0000", 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055614371000000003 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633427+0000", 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108151 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633506+0000", 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8131000000000001e-05 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77697 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 14606336~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.194022562, 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056014999000000003, 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77697 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.577714+0000", 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583206+0000", 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054918459999999999 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583212+0000", 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8479999999999997e-06 2024-09-12T05:23:07.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583224+0000", 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2019e-05 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.583232+0000", 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8089999999999993e-06 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633544+0000", 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.050312942999999999 2024-09-12T05:23:07.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633627+0000", 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2873000000000004e-05 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.633729+0000", 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101661 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77763 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13606912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.186749285, 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802137000000001, 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77763 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584987+0000", 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584988+0000", 2024-09-12T05:23:07.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9400000000000001e-07 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584990+0000", 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4830000000000002e-06 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.584997+0000", 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7510000000000002e-06 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585002+0000", 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2079999999999999e-06 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639685+0000", 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054682411 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639735+0000", 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0013999999999999e-05 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639789+0000", 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4876000000000001e-05 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77766 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8527872~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.18672689500001, 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054960936000000002, 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77766 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585010+0000", 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3799999999999998e-07 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585012+0000", 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3180000000000001e-06 2024-09-12T05:23:07.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585019+0000", 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.63e-06 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585024+0000", 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.152e-06 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639827+0000", 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054802503000000002 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639901+0000", 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4103999999999994e-05 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.639971+0000", 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9790999999999996e-05 2024-09-12T05:23:07.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77768 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8945664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.18670424699999, 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055142938000000002, 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77768 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585032+0000", 2024-09-12T05:23:07.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585033+0000", 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.84e-07 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585035+0000", 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3760000000000002e-06 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585041+0000", 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2339999999999999e-06 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585046+0000", 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8250000000000004e-06 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640017+0000", 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.05497084 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640100+0000", 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2861999999999994e-05 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640175+0000", 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5417e-05 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77770 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 7864320~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.186683758, 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382637999999998, 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77770 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.837 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585053+0000", 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-09-12T05:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585060+0000", 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7320000000000001e-06 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585067+0000", 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6059999999999999e-06 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585072+0000", 2024-09-12T05:23:07.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0309999999999998e-06 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640232+0000", 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055159998000000002 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640326+0000", 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4307000000000004e-05 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640435+0000", 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000109505 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77772 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 13279232~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.186657693, 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055567766999999997, 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.841 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77772 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585079+0000", 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2399999999999998e-07 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585082+0000", 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.052e-06 2024-09-12T05:23:07.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585088+0000", 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6320000000000002e-06 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585093+0000", 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3410000000000002e-06 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640476+0000", 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055382382000000001 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640562+0000", 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5791999999999994e-05 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640647+0000", 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4944000000000005e-05 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.845 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77774 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8200192~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.18663447599999, 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055752243999999999, 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.846 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77774 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585102+0000", 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.15e-07 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585105+0000", 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4480000000000001e-06 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585112+0000", 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9229999999999996e-06 2024-09-12T05:23:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585117+0000", 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1919999999999996e-06 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640693+0000", 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055576137999999997 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640771+0000", 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7632000000000005e-05 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640854+0000", 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3496000000000002e-05 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:77776 3.1f 3:fd4513f2:::rbd_data.11184141c2e2.0000000000000001:16 [read 8617984~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:23:07.850 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 114.18661211200001, 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.055877612, 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 77776 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:23:07.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.585124+0000", 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595197+0000", 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010072724 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595203+0000", 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4530000000000001e-06 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595211+0000", 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6179999999999995e-06 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.595216+0000", 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0429999999999998e-06 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640904+0000", 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04568767 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.640952+0000", 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8165999999999999e-05 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:13.641002+0000", 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9938000000000002e-05 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:80537 3.3 3:c5cce0af:::rbd_data.11183d6a8c4d.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 4194304~41894] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 113.710071736, 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056943697000000001, 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.855 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 80537 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061665+0000", 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.061667+0000", 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2220000000000001e-06 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.068979+0000", 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073117529999999998 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069022+0000", 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3556000000000001e-05 2024-09-12T05:23:07.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069038+0000", 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5764e-05 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069207+0000", 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016920300000000001 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-09-12T05:23:07.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.069436+0000", 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022839400000000001 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118245+0000", 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048809524999999999 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118385+0000", 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013963499999999999 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:21:14.118609+0000", 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022364499999999999 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4376.0:122609 3.6 3:67cae2ed:::rbd_mirroring:head [list-watchers] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e170)", 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-09-12T05:23:05.826481+0000", 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.9452551819999999, 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95174505700000001, 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-09-12T05:23:07.860 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4376", 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/1700321407", 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 122609 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:05.826481+0000", 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:05.826481+0000", 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:05.826484+0000", 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3470000000000001e-06 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:05.826499+0000", 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5426000000000001e-05 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:05.826527+0000", 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7552999999999999e-05 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:05.826543+0000", 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6350000000000001e-05 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:05.826707+0000", 2024-09-12T05:23:07.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000163552 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:05.826726+0000", 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.944e-05 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:06.778075+0000", 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.95134875299999999 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-09-12T05:23:07.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-09-12T05:23:06.778226+0000", 2024-09-12T05:23:07.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000151636 2024-09-12T05:23:07.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.865 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-12T05:23:07.865 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-12T05:23:07.865 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:07.865 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:07.770+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:07.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T05:23:07.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-12T05:23:07.906 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:23:07.906+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:23:07.908 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-09-12T05:23:07.908 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T05:23:07.932 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-09-12T05:23:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T05:23:07.952 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-09-12T05:23:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T05:23:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-12T05:23:07.968 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:07.970+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:07.975 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-09-12T05:23:07.975 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T05:23:08.013 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-09-12T05:23:08.013 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T05:23:08.038 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-09-12T05:23:08.038 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T05:23:08.045 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:08.045 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:08.063 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-09-12T05:23:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T05:23:08.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T05:23:08.067 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T05:23:08.068 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T05:23:08.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-12T05:23:08.097 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:08.098+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:08.170 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:08.170+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:08.209 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:08.210 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:08.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T05:23:08.270 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T05:23:08.270+0000 7fa3a228c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26498) UID: 0 2024-09-12T05:23:08.301 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-12T05:23:08.347 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:08.347 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:08.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T05:23:08.405 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:08.406+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:08.472 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:08.470+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:08.524 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:08.524 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:08.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T05:23:08.573 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T05:23:08.574+0000 7f56073a6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26500) UID: 0 2024-09-12T05:23:08.674 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-09-12T05:23:08.674+0000 7f71be4dd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26383) UID: 0 2024-09-12T05:23:08.698 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:08.699 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:08.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T05:23:08.776 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T05:23:08.774+0000 7f40cccad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26496) UID: 0 2024-09-12T05:23:08.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T05:23:08.876 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:08.878+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:08.881 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:08.881 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:08.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T05:23:08.977 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T05:23:08.978+0000 7f35e78e1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34215) UID: 0 2024-09-12T05:23:09.029 INFO:teuthology.orchestra.run.smithi059.stdout:All operations completed A-OK! 2024-09-12T05:23:09.044 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:09.045 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:09.059 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T05:23:09.079 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-09-12T05:23:09.078+0000 7fcace811640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26379) UID: 0 2024-09-12T05:23:09.095 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:09.095 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-12T05:23:09.108 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T05:23:09.138 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T05:23:09.262 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:09.262 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:09.276 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T05:23:09.402 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:09.402 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:09.417 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T05:23:09.539 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:09.539 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:09.553 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T05:23:09.675 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:09.675 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:09.689 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T05:23:09.805 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:09.805 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:09.819 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T05:23:09.891 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-09-12T05:23:09.938 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:09.938 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:09.952 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T05:23:10.065 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:10.065 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:10.078 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T05:23:10.186 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:10.186 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:10.200 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T05:23:10.319 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:10.319 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:10.333 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T05:23:10.455 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:10.455 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:10.470 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T05:23:10.593 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-12T05:23:10.594 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T05:23:11.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T05:23:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-09-12T05:23:12.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T05:23:13.463 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-12T05:23:13.464 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2024-09-12T05:23:13.464 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T05:23:13.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T05:23:13.466 INFO:tasks.ceph.osd.3:Started 2024-09-12T05:23:13.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:no valid command found; 10 closest matches: 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:0 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:1 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:2 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:abort 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:assert 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:config diff 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:config diff get 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:config get 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:config help [] 2024-09-12T05:23:13.590 INFO:teuthology.orchestra.run.smithi059.stderr:config set ... 2024-09-12T05:23:13.591 INFO:teuthology.orchestra.run.smithi059.stderr:admin_socket: invalid command 2024-09-12T05:23:13.592 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T05:23:13.593 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-12T05:23:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-09-12T05:23:14.794 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:23:14.794+0000 7f58ba70c7c0 -1 Falling back to public interface 2024-09-12T05:23:18.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:23:18.726 INFO:teuthology.orchestra.run.smithi059.stderr:no valid command found; 10 closest matches: 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:0 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:1 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:abort 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:assert 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:bluefs debug_inject_read_zeros 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:bluefs files list 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:bluefs stats 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:bluestore allocator dump block 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:bluestore allocator fragmentation block 2024-09-12T05:23:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:admin_socket: invalid command 2024-09-12T05:23:18.728 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T05:23:18.729 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-12T05:23:18.794 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:23:18.794+0000 7f58ba70c7c0 -1 osd.3 129 log_to_monitors true 2024-09-12T05:23:19.060 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-09-12T05:23:19.058+0000 7f58ae4e7640 -1 osd.3 177 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T05:23:23.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T05:23:23.867 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:23.868 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-09-12T05:23:23.868 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-09-12T05:23:23.868 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:23.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T05:23:24.028 INFO:teuthology.orchestra.run.smithi059.stdout:mon.a: {} 2024-09-12T05:23:24.028 INFO:teuthology.orchestra.run.smithi059.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T05:23:24.041 INFO:teuthology.orchestra.run.smithi059.stdout:mon.b: {} 2024-09-12T05:23:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T05:23:24.052 INFO:teuthology.orchestra.run.smithi059.stdout:mon.c: {} 2024-09-12T05:23:24.052 INFO:teuthology.orchestra.run.smithi059.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T05:23:24.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T05:23:25.111 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T05:23:25.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T05:23:26.120 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T05:23:26.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T05:23:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T05:23:27.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T05:23:28.141 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T05:23:28.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T05:23:29.160 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T05:23:29.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T05:23:29.764 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T05:23:29.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T05:23:30.774 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T05:23:30.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-12T05:23:31.782 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-12T05:23:31.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T05:23:32.792 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T05:23:32.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-12T05:23:33.794 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-12T05:23:33.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T05:23:34.803 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T05:23:34.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-12T05:23:35.813 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-12T05:23:35.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T05:23:36.825 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T05:23:36.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-12T05:23:37.835 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-12T05:23:37.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T05:23:38.847 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T05:23:38.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-12T05:23:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-12T05:23:39.887 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T05:23:39.887 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T05:23:39.887 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T05:23:39.887 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T05:23:39.888 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T05:23:39.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T05:23:40.209 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:40.209 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":198,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:23:39.851451+0000","last_up_change":"2024-09-12T05:23:20.017803+0000","last_in_change":"2024-09-12T05:23:01.800319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T05:19:52.945109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T05:19:58.280650+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-12T05:20:08.800004+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":46,"snap_epoch":173,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6817","nonce":3837229352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6819","nonce":3837229352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6823","nonce":3837229352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6821","nonce":3837229352}]},"public_addr":"172.21.15.59:6817/3837229352","cluster_addr":"172.21.15.59:6819/3837229352","heartbeat_back_addr":"172.21.15.59:6823/3837229352","heartbeat_front_addr":"172.21.15.59:6821/3837229352","state":["exists","up"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6801","nonce":1576154773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6803","nonce":1576154773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6807","nonce":1576154773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6805","nonce":1576154773}]},"public_addr":"172.21.15.59:6801/1576154773","cluster_addr":"172.21.15.59:6803/1576154773","heartbeat_back_addr":"172.21.15.59:6807/1576154773","heartbeat_front_addr":"172.21.15.59:6805/1576154773","state":["exists","up"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6825","nonce":3725088694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6827","nonce":3725088694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6831","nonce":3725088694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6829","nonce":3725088694}]},"public_addr":"172.21.15.59:6825/3725088694","cluster_addr":"172.21.15.59:6827/3725088694","heartbeat_back_addr":"172.21.15.59:6831/3725088694","heartbeat_front_addr":"172.21.15.59:6829/3725088694","state":["exists","up"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":129,"up_from":178,"up_thru":181,"down_at":130,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6809","nonce":1430015273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6811","nonce":1430015273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6815","nonce":1430015273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6813","nonce":1430015273}]},"public_addr":"172.21.15.59:6809/1430015273","cluster_addr":"172.21.15.59:6811/1430015273","heartbeat_back_addr":"172.21.15.59:6815/1430015273","heartbeat_front_addr":"172.21.15.59:6813/1430015273","state":["exists","up"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":58,"up_from":114,"up_thru":169,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6825","nonce":1662122460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6827","nonce":1662122460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6831","nonce":1662122460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6829","nonce":1662122460}]},"public_addr":"172.21.15.194:6825/1662122460","cluster_addr":"172.21.15.194:6827/1662122460","heartbeat_back_addr":"172.21.15.194:6831/1662122460","heartbeat_front_addr":"172.21.15.194:6829/1662122460","state":["exists","up"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6801","nonce":1911143418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6803","nonce":1911143418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6807","nonce":1911143418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6805","nonce":1911143418}]},"public_addr":"172.21.15.194:6801/1911143418","cluster_addr":"172.21.15.194:6803/1911143418","heartbeat_back_addr":"172.21.15.194:6807/1911143418","heartbeat_front_addr":"172.21.15.194:6805/1911143418","state":["exists","up"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6817","nonce":90490456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6819","nonce":90490456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6823","nonce":90490456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6821","nonce":90490456}]},"public_addr":"172.21.15.194:6817/90490456","cluster_addr":"172.21.15.194:6819/90490456","heartbeat_back_addr":"172.21.15.194:6823/90490456","heartbeat_front_addr":"172.21.15.194:6821/90490456","state":["exists","up"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6809","nonce":2109956055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6811","nonce":2109956055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6815","nonce":2109956055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6813","nonce":2109956055}]},"public_addr":"172.21.15.194:6809/2109956055","cluster_addr":"172.21.15.194:6811/2109956055","heartbeat_back_addr":"172.21.15.194:6815/2109956055","heartbeat_front_addr":"172.21.15.194:6813/2109956055","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.291372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.699928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.078333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.878139+0000","dead_epoch":130},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.129610+0000","dead_epoch":60},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.515195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.266450+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.961964+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.9","osds":[0,2]}],"pg_upmap_items":[{"pgid":"2.1","mappings":[{"from":3,"to":6}]},{"pgid":"2.4","mappings":[{"from":0,"to":4}]},{"pgid":"3.b","mappings":[{"from":0,"to":7},{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:23:40.229 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T05:23:40.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T05:23:40.541 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:40.542 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":198,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:23:39.851451+0000","last_up_change":"2024-09-12T05:23:20.017803+0000","last_in_change":"2024-09-12T05:23:01.800319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T05:19:52.945109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T05:19:58.280650+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-12T05:20:08.800004+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":46,"snap_epoch":173,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6817","nonce":3837229352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6819","nonce":3837229352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6823","nonce":3837229352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6821","nonce":3837229352}]},"public_addr":"172.21.15.59:6817/3837229352","cluster_addr":"172.21.15.59:6819/3837229352","heartbeat_back_addr":"172.21.15.59:6823/3837229352","heartbeat_front_addr":"172.21.15.59:6821/3837229352","state":["exists","up"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6801","nonce":1576154773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6803","nonce":1576154773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6807","nonce":1576154773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6805","nonce":1576154773}]},"public_addr":"172.21.15.59:6801/1576154773","cluster_addr":"172.21.15.59:6803/1576154773","heartbeat_back_addr":"172.21.15.59:6807/1576154773","heartbeat_front_addr":"172.21.15.59:6805/1576154773","state":["exists","up"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6825","nonce":3725088694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6827","nonce":3725088694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6831","nonce":3725088694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6829","nonce":3725088694}]},"public_addr":"172.21.15.59:6825/3725088694","cluster_addr":"172.21.15.59:6827/3725088694","heartbeat_back_addr":"172.21.15.59:6831/3725088694","heartbeat_front_addr":"172.21.15.59:6829/3725088694","state":["exists","up"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":129,"up_from":178,"up_thru":181,"down_at":130,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6809","nonce":1430015273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6811","nonce":1430015273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6815","nonce":1430015273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6813","nonce":1430015273}]},"public_addr":"172.21.15.59:6809/1430015273","cluster_addr":"172.21.15.59:6811/1430015273","heartbeat_back_addr":"172.21.15.59:6815/1430015273","heartbeat_front_addr":"172.21.15.59:6813/1430015273","state":["exists","up"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":58,"up_from":114,"up_thru":169,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6825","nonce":1662122460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6827","nonce":1662122460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6831","nonce":1662122460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6829","nonce":1662122460}]},"public_addr":"172.21.15.194:6825/1662122460","cluster_addr":"172.21.15.194:6827/1662122460","heartbeat_back_addr":"172.21.15.194:6831/1662122460","heartbeat_front_addr":"172.21.15.194:6829/1662122460","state":["exists","up"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6801","nonce":1911143418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6803","nonce":1911143418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6807","nonce":1911143418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6805","nonce":1911143418}]},"public_addr":"172.21.15.194:6801/1911143418","cluster_addr":"172.21.15.194:6803/1911143418","heartbeat_back_addr":"172.21.15.194:6807/1911143418","heartbeat_front_addr":"172.21.15.194:6805/1911143418","state":["exists","up"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6817","nonce":90490456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6819","nonce":90490456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6823","nonce":90490456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6821","nonce":90490456}]},"public_addr":"172.21.15.194:6817/90490456","cluster_addr":"172.21.15.194:6819/90490456","heartbeat_back_addr":"172.21.15.194:6823/90490456","heartbeat_front_addr":"172.21.15.194:6821/90490456","state":["exists","up"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6809","nonce":2109956055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6811","nonce":2109956055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6815","nonce":2109956055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6813","nonce":2109956055}]},"public_addr":"172.21.15.194:6809/2109956055","cluster_addr":"172.21.15.194:6811/2109956055","heartbeat_back_addr":"172.21.15.194:6815/2109956055","heartbeat_front_addr":"172.21.15.194:6813/2109956055","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.291372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.699928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.078333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.878139+0000","dead_epoch":130},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.129610+0000","dead_epoch":60},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.515195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.266450+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.961964+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.9","osds":[0,2]}],"pg_upmap_items":[{"pgid":"2.1","mappings":[{"from":3,"to":6}]},{"pgid":"2.4","mappings":[{"from":0,"to":4}]},{"pgid":"3.b","mappings":[{"from":0,"to":7},{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:23:40.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T05:23:40.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T05:23:40.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T05:23:40.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T05:23:40.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T05:23:40.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T05:23:40.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T05:23:40.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T05:23:40.826 INFO:teuthology.orchestra.run.smithi059.stdout:764504178694 2024-09-12T05:23:40.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T05:23:40.829 INFO:teuthology.orchestra.run.smithi059.stdout:60129542194 2024-09-12T05:23:40.829 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T05:23:40.835 INFO:teuthology.orchestra.run.smithi059.stdout:60129542193 2024-09-12T05:23:40.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T05:23:40.842 INFO:teuthology.orchestra.run.smithi059.stdout:60129542193 2024-09-12T05:23:40.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T05:23:40.844 INFO:teuthology.orchestra.run.smithi059.stdout:60129542194 2024-09-12T05:23:40.844 INFO:teuthology.orchestra.run.smithi059.stdout:60129542193 2024-09-12T05:23:40.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T05:23:40.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T05:23:40.849 INFO:teuthology.orchestra.run.smithi059.stdout:489626271764 2024-09-12T05:23:40.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T05:23:40.850 INFO:teuthology.orchestra.run.smithi059.stdout:60129542192 2024-09-12T05:23:40.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T05:23:41.347 INFO:teuthology.orchestra.run.smithi059.stdout:764504178692 2024-09-12T05:23:41.368 INFO:teuthology.orchestra.run.smithi059.stdout:60129542193 2024-09-12T05:23:41.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 764504178694 got 764504178692 for osd.3 2024-09-12T05:23:41.378 INFO:teuthology.orchestra.run.smithi059.stdout:60129542192 2024-09-12T05:23:41.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542194 got 60129542193 for osd.7 2024-09-12T05:23:41.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542192 for osd.2 2024-09-12T05:23:41.421 INFO:teuthology.orchestra.run.smithi059.stdout:60129542193 2024-09-12T05:23:41.433 INFO:teuthology.orchestra.run.smithi059.stdout:60129542191 2024-09-12T05:23:41.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542194 got 60129542193 for osd.1 2024-09-12T05:23:41.439 INFO:teuthology.orchestra.run.smithi059.stdout:60129542192 2024-09-12T05:23:41.446 INFO:teuthology.orchestra.run.smithi059.stdout:60129542192 2024-09-12T05:23:41.446 INFO:teuthology.orchestra.run.smithi059.stdout:489626271762 2024-09-12T05:23:41.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542192 got 60129542191 for osd.6 2024-09-12T05:23:41.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542192 for osd.0 2024-09-12T05:23:41.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542192 for osd.5 2024-09-12T05:23:41.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 489626271764 got 489626271762 for osd.4 2024-09-12T05:23:42.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T05:23:42.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T05:23:42.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T05:23:42.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T05:23:42.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T05:23:42.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T05:23:42.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T05:23:42.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T05:23:42.813 INFO:teuthology.orchestra.run.smithi059.stdout:764504178694 2024-09-12T05:23:42.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 764504178694 got 764504178694 for osd.3 2024-09-12T05:23:42.839 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:42.929 INFO:teuthology.orchestra.run.smithi059.stdout:60129542194 2024-09-12T05:23:42.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542194 got 60129542194 for osd.1 2024-09-12T05:23:42.947 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:42.954 INFO:teuthology.orchestra.run.smithi059.stdout:60129542194 2024-09-12T05:23:42.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542194 got 60129542194 for osd.7 2024-09-12T05:23:42.974 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:42.989 INFO:teuthology.orchestra.run.smithi059.stdout:60129542193 2024-09-12T05:23:43.010 INFO:teuthology.orchestra.run.smithi059.stdout:60129542193 2024-09-12T05:23:43.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542193 for osd.2 2024-09-12T05:23:43.013 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:43.022 INFO:teuthology.orchestra.run.smithi059.stdout:60129542192 2024-09-12T05:23:43.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542193 for osd.5 2024-09-12T05:23:43.029 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:43.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542192 got 60129542192 for osd.6 2024-09-12T05:23:43.041 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:43.049 INFO:teuthology.orchestra.run.smithi059.stdout:60129542193 2024-09-12T05:23:43.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542193 for osd.0 2024-09-12T05:23:43.066 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:43.087 INFO:teuthology.orchestra.run.smithi059.stdout:489626271764 2024-09-12T05:23:43.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 489626271764 got 489626271764 for osd.4 2024-09-12T05:23:43.105 DEBUG:teuthology.parallel:result is None 2024-09-12T05:23:43.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T05:23:43.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:23:43.451 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:43.453 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:23:43.468 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-12T05:23:42.962045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":939,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":939,"num_whiteouts":931,"num_read":160785,"num_read_kb":931040,"num_write":23858,"num_write_kb":472150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3302,"num_bytes_recovered":149051719,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21079,"ondisk_log_size":21079,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":413060,"kb_used_data":19784,"kb_used_omap":64,"kb_used_meta":393023,"kb_avail":754561660,"statfs":{"total":773094113280,"available":772671139840,"internally_reserved":0,"allocated":20258816,"data_stored":10475184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65607,"internal_metadata":402456505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001788"},"pg_stats":[{"pgid":"3.1f","version":"173'486","reported_seq":9172,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108147+0000","last_change":"2024-09-12T05:23:08.894836+0000","last_active":"2024-09-12T05:23:39.108147+0000","last_peered":"2024-09-12T05:23:39.108147+0000","last_clean":"2024-09-12T05:23:39.108147+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:23:39.108147+0000","last_undegraded":"2024-09-12T05:23:39.108147+0000","last_fullsized":"2024-09-12T05:23:39.108147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:46.702174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003248342,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9528,"num_read_kb":33880,"num_write":431,"num_write_kb":7991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"179'378","reported_seq":7803,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207394+0000","last_change":"2024-09-12T05:23:21.451138+0000","last_active":"2024-09-12T05:23:40.207394+0000","last_peered":"2024-09-12T05:23:40.207394+0000","last_clean":"2024-09-12T05:23:40.207394+0000","last_became_active":"2024-09-12T05:23:21.054723+0000","last_became_peered":"2024-09-12T05:23:21.054723+0000","last_unstale":"2024-09-12T05:23:40.207394+0000","last_undegraded":"2024-09-12T05:23:40.207394+0000","last_fullsized":"2024-09-12T05:23:40.207394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:36.202472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.11218479200000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":7029,"num_read_kb":84720,"num_write":386,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'786","reported_seq":4147,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112144+0000","last_change":"2024-09-12T05:23:08.884176+0000","last_active":"2024-09-12T05:23:39.112144+0000","last_peered":"2024-09-12T05:23:39.112144+0000","last_clean":"2024-09-12T05:23:39.112144+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:23:39.112144+0000","last_undegraded":"2024-09-12T05:23:39.112144+0000","last_fullsized":"2024-09-12T05:23:39.112144+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:16.886391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772933,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5372,"num_read_kb":9022,"num_write":882,"num_write_kb":5162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'728","reported_seq":5598,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111345+0000","last_change":"2024-09-12T05:23:08.885454+0000","last_active":"2024-09-12T05:23:39.111345+0000","last_peered":"2024-09-12T05:23:39.111345+0000","last_clean":"2024-09-12T05:23:39.111345+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:23:39.111345+0000","last_undegraded":"2024-09-12T05:23:39.111345+0000","last_fullsized":"2024-09-12T05:23:39.111345+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.227991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002840431,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":6419,"num_read_kb":39592,"num_write":787,"num_write_kb":9586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"172'701","reported_seq":4029,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108032+0000","last_change":"2024-09-12T05:23:08.894170+0000","last_active":"2024-09-12T05:23:39.108032+0000","last_peered":"2024-09-12T05:23:39.108032+0000","last_clean":"2024-09-12T05:23:39.108032+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:23:39.108032+0000","last_undegraded":"2024-09-12T05:23:39.108032+0000","last_fullsized":"2024-09-12T05:23:39.108032+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:09.253291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028723139999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":4932,"num_read_kb":38662,"num_write":725,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'441","reported_seq":6261,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848488+0000","last_change":"2024-09-12T05:23:08.921196+0000","last_active":"2024-09-12T05:23:38.848488+0000","last_peered":"2024-09-12T05:23:38.848488+0000","last_clean":"2024-09-12T05:23:38.848488+0000","last_became_active":"2024-09-12T05:23:05.778317+0000","last_became_peered":"2024-09-12T05:23:05.778317+0000","last_unstale":"2024-09-12T05:23:38.848488+0000","last_undegraded":"2024-09-12T05:23:38.848488+0000","last_fullsized":"2024-09-12T05:23:38.848488+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:31.021021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023560629999999998,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5982,"num_read_kb":31159,"num_write":378,"num_write_kb":18476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":278,"num_bytes_recovered":17309726,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"172'466","reported_seq":4426,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866481+0000","last_change":"2024-09-12T05:23:22.198107+0000","last_active":"2024-09-12T05:23:39.866481+0000","last_peered":"2024-09-12T05:23:39.866481+0000","last_clean":"2024-09-12T05:23:39.866481+0000","last_became_active":"2024-09-12T05:23:22.049233+0000","last_became_peered":"2024-09-12T05:23:22.049233+0000","last_unstale":"2024-09-12T05:23:39.866481+0000","last_undegraded":"2024-09-12T05:23:39.866481+0000","last_fullsized":"2024-09-12T05:23:39.866481+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.090281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015759229999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4026,"num_read_kb":33452,"num_write":410,"num_write_kb":5078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":1855629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"179'656","reported_seq":3405,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207255+0000","last_change":"2024-09-12T05:23:21.371061+0000","last_active":"2024-09-12T05:23:40.207255+0000","last_peered":"2024-09-12T05:23:40.207255+0000","last_clean":"2024-09-12T05:23:40.207255+0000","last_became_active":"2024-09-12T05:23:21.054412+0000","last_became_peered":"2024-09-12T05:23:21.054412+0000","last_unstale":"2024-09-12T05:23:40.207255+0000","last_undegraded":"2024-09-12T05:23:40.207255+0000","last_fullsized":"2024-09-12T05:23:40.207255+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:27.068859+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.10278277800000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4940,"num_read_kb":22589,"num_write":590,"num_write_kb":11883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"173'686","reported_seq":2504,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108153+0000","last_change":"2024-09-12T05:23:08.896248+0000","last_active":"2024-09-12T05:23:39.108153+0000","last_peered":"2024-09-12T05:23:39.108153+0000","last_clean":"2024-09-12T05:23:39.108153+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:23:39.108153+0000","last_undegraded":"2024-09-12T05:23:39.108153+0000","last_fullsized":"2024-09-12T05:23:39.108153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:58.298697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042327889999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3367,"num_read_kb":15041,"num_write":820,"num_write_kb":7486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"165'549","reported_seq":6342,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112821+0000","last_change":"2024-09-12T05:23:08.884563+0000","last_active":"2024-09-12T05:23:39.112821+0000","last_peered":"2024-09-12T05:23:39.112821+0000","last_clean":"2024-09-12T05:23:39.112821+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:23:39.112821+0000","last_undegraded":"2024-09-12T05:23:39.112821+0000","last_fullsized":"2024-09-12T05:23:39.112821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:42.147876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00202206,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":6274,"num_read_kb":69645,"num_write":520,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'418","reported_seq":2533,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867909+0000","last_change":"2024-09-12T05:23:24.071340+0000","last_active":"2024-09-12T05:23:39.867909+0000","last_peered":"2024-09-12T05:23:39.867909+0000","last_clean":"2024-09-12T05:23:39.867909+0000","last_became_active":"2024-09-12T05:23:24.069263+0000","last_became_peered":"2024-09-12T05:23:24.069263+0000","last_unstale":"2024-09-12T05:23:39.867909+0000","last_undegraded":"2024-09-12T05:23:39.867909+0000","last_fullsized":"2024-09-12T05:23:39.867909+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:24.354148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041559700000000002,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":1771,"num_read_kb":12775,"num_write":434,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"173'1271","reported_seq":5562,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848790+0000","last_change":"2024-09-12T05:23:08.921139+0000","last_active":"2024-09-12T05:23:38.848790+0000","last_peered":"2024-09-12T05:23:38.848790+0000","last_clean":"2024-09-12T05:23:38.848790+0000","last_became_active":"2024-09-12T05:22:14.756246+0000","last_became_peered":"2024-09-12T05:22:14.756246+0000","last_unstale":"2024-09-12T05:23:38.848790+0000","last_undegraded":"2024-09-12T05:23:38.848790+0000","last_fullsized":"2024-09-12T05:23:38.848790+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:02.371995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001595127,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":8879,"num_read_kb":39076,"num_write":1824,"num_write_kb":25359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":17251748,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":317,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111101+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:23:39.111101+0000","last_peered":"2024-09-12T05:23:39.111101+0000","last_clean":"2024-09-12T05:23:39.111101+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:23:39.111101+0000","last_undegraded":"2024-09-12T05:23:39.111101+0000","last_fullsized":"2024-09-12T05:23:39.111101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"173'802","reported_seq":3301,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107905+0000","last_change":"2024-09-12T05:23:08.896149+0000","last_active":"2024-09-12T05:23:39.107905+0000","last_peered":"2024-09-12T05:23:39.107905+0000","last_clean":"2024-09-12T05:23:39.107905+0000","last_became_active":"2024-09-12T05:23:06.775134+0000","last_became_peered":"2024-09-12T05:23:06.775134+0000","last_unstale":"2024-09-12T05:23:39.107905+0000","last_undegraded":"2024-09-12T05:23:39.107905+0000","last_fullsized":"2024-09-12T05:23:39.107905+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:00.057042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042806040000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":2732,"num_read_kb":14112,"num_write":849,"num_write_kb":22030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":524386,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866541+0000","last_change":"2024-09-12T05:23:02.831403+0000","last_active":"2024-09-12T05:23:39.866541+0000","last_peered":"2024-09-12T05:23:39.866541+0000","last_clean":"2024-09-12T05:23:39.866541+0000","last_became_active":"2024-09-12T05:23:02.830555+0000","last_became_peered":"2024-09-12T05:23:02.830555+0000","last_unstale":"2024-09-12T05:23:39.866541+0000","last_undegraded":"2024-09-12T05:23:39.866541+0000","last_fullsized":"2024-09-12T05:23:39.866541+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:08.335748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"179'435","reported_seq":3445,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207585+0000","last_change":"2024-09-12T05:23:21.287558+0000","last_active":"2024-09-12T05:23:40.207585+0000","last_peered":"2024-09-12T05:23:40.207585+0000","last_clean":"2024-09-12T05:23:40.207585+0000","last_became_active":"2024-09-12T05:23:21.051627+0000","last_became_peered":"2024-09-12T05:23:21.051627+0000","last_unstale":"2024-09-12T05:23:40.207585+0000","last_undegraded":"2024-09-12T05:23:40.207585+0000","last_fullsized":"2024-09-12T05:23:40.207585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:44.975331+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.114526524,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2848,"num_read_kb":54239,"num_write":458,"num_write_kb":24596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":368,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868205+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:23:39.868205+0000","last_peered":"2024-09-12T05:23:39.868205+0000","last_clean":"2024-09-12T05:23:39.868205+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:23:39.868205+0000","last_undegraded":"2024-09-12T05:23:39.868205+0000","last_fullsized":"2024-09-12T05:23:39.868205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"172'752","reported_seq":4313,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866631+0000","last_change":"2024-09-12T05:23:08.885502+0000","last_active":"2024-09-12T05:23:39.866631+0000","last_peered":"2024-09-12T05:23:39.866631+0000","last_clean":"2024-09-12T05:23:39.866631+0000","last_became_active":"2024-09-12T05:23:06.773505+0000","last_became_peered":"2024-09-12T05:23:06.773505+0000","last_unstale":"2024-09-12T05:23:39.866631+0000","last_undegraded":"2024-09-12T05:23:39.866631+0000","last_fullsized":"2024-09-12T05:23:39.866631+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:15.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024700099999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5270,"num_read_kb":22820,"num_write":798,"num_write_kb":28293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":474,"num_bytes_recovered":12649810,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866460+0000","last_change":"2024-09-12T05:23:02.830895+0000","last_active":"2024-09-12T05:23:39.866460+0000","last_peered":"2024-09-12T05:23:39.866460+0000","last_clean":"2024-09-12T05:23:39.866460+0000","last_became_active":"2024-09-12T05:23:02.829933+0000","last_became_peered":"2024-09-12T05:23:02.829933+0000","last_unstale":"2024-09-12T05:23:39.866460+0000","last_undegraded":"2024-09-12T05:23:39.866460+0000","last_fullsized":"2024-09-12T05:23:39.866460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.164044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"179'485","reported_seq":2864,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112442+0000","last_change":"2024-09-12T05:23:21.221659+0000","last_active":"2024-09-12T05:23:39.112442+0000","last_peered":"2024-09-12T05:23:39.112442+0000","last_clean":"2024-09-12T05:23:39.112442+0000","last_became_active":"2024-09-12T05:23:21.069868+0000","last_became_peered":"2024-09-12T05:23:21.069868+0000","last_unstale":"2024-09-12T05:23:39.112442+0000","last_undegraded":"2024-09-12T05:23:39.112442+0000","last_fullsized":"2024-09-12T05:23:39.112442+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:29.218757+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.078824042999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2610,"num_read_kb":20437,"num_write":595,"num_write_kb":10557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"173'729","reported_seq":5225,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848718+0000","last_change":"2024-09-12T05:23:08.920199+0000","last_active":"2024-09-12T05:23:38.848718+0000","last_peered":"2024-09-12T05:23:38.848718+0000","last_clean":"2024-09-12T05:23:38.848718+0000","last_became_active":"2024-09-12T05:22:14.219295+0000","last_became_peered":"2024-09-12T05:22:14.219295+0000","last_unstale":"2024-09-12T05:23:38.848718+0000","last_undegraded":"2024-09-12T05:23:38.848718+0000","last_fullsized":"2024-09-12T05:23:38.848718+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:08.649145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001330901,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":5192,"num_read_kb":18719,"num_write":679,"num_write_kb":26356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":391,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:23:02.838440+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:23:02.830933+0000","last_became_peered":"2024-09-12T05:23:02.830933+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:59.974404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"172'1022","reported_seq":10699,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866410+0000","last_change":"2024-09-12T05:23:08.884903+0000","last_active":"2024-09-12T05:23:39.866410+0000","last_peered":"2024-09-12T05:23:39.866410+0000","last_clean":"2024-09-12T05:23:39.866410+0000","last_became_active":"2024-09-12T05:23:06.773339+0000","last_became_peered":"2024-09-12T05:23:06.773339+0000","last_unstale":"2024-09-12T05:23:39.866410+0000","last_undegraded":"2024-09-12T05:23:39.866410+0000","last_fullsized":"2024-09-12T05:23:39.866410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1022,"log_dups_size":0,"ondisk_log_size":1022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.213297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002206193,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":11896,"num_read_kb":54588,"num_write":1368,"num_write_kb":21769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":13965694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.864991+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:23:39.864991+0000","last_peered":"2024-09-12T05:23:39.864991+0000","last_clean":"2024-09-12T05:23:39.864991+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:23:39.864991+0000","last_undegraded":"2024-09-12T05:23:39.864991+0000","last_fullsized":"2024-09-12T05:23:39.864991+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'610","reported_seq":2588,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108052+0000","last_change":"2024-09-12T05:23:08.892844+0000","last_active":"2024-09-12T05:23:39.108052+0000","last_peered":"2024-09-12T05:23:39.108052+0000","last_clean":"2024-09-12T05:23:39.108052+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:23:39.108052+0000","last_undegraded":"2024-09-12T05:23:39.108052+0000","last_fullsized":"2024-09-12T05:23:39.108052+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:18.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015778210000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":2646,"num_read_kb":16084,"num_write":734,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":380,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867778+0000","last_change":"2024-09-12T05:23:02.827747+0000","last_active":"2024-09-12T05:23:39.867778+0000","last_peered":"2024-09-12T05:23:39.867778+0000","last_clean":"2024-09-12T05:23:39.867778+0000","last_became_active":"2024-09-12T05:23:02.826853+0000","last_became_peered":"2024-09-12T05:23:02.826853+0000","last_unstale":"2024-09-12T05:23:39.867778+0000","last_undegraded":"2024-09-12T05:23:39.867778+0000","last_fullsized":"2024-09-12T05:23:39.867778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:35.923974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"179'516","reported_seq":3644,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207359+0000","last_change":"2024-09-12T05:23:21.556051+0000","last_active":"2024-09-12T05:23:40.207359+0000","last_peered":"2024-09-12T05:23:40.207359+0000","last_clean":"2024-09-12T05:23:40.207359+0000","last_became_active":"2024-09-12T05:23:21.060573+0000","last_became_peered":"2024-09-12T05:23:21.060573+0000","last_unstale":"2024-09-12T05:23:40.207359+0000","last_undegraded":"2024-09-12T05:23:40.207359+0000","last_fullsized":"2024-09-12T05:23:40.207359+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:56.367076+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.13014315100000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3396,"num_read_kb":46312,"num_write":573,"num_write_kb":32831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":390,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":460,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867568+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:23:39.867568+0000","last_peered":"2024-09-12T05:23:39.867568+0000","last_clean":"2024-09-12T05:23:39.867568+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:23:39.867568+0000","last_undegraded":"2024-09-12T05:23:39.867568+0000","last_fullsized":"2024-09-12T05:23:39.867568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"172'719","reported_seq":5307,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207106+0000","last_change":"2024-09-12T05:23:24.067998+0000","last_active":"2024-09-12T05:23:40.207106+0000","last_peered":"2024-09-12T05:23:40.207106+0000","last_clean":"2024-09-12T05:23:40.207106+0000","last_became_active":"2024-09-12T05:23:24.066068+0000","last_became_peered":"2024-09-12T05:23:24.066068+0000","last_unstale":"2024-09-12T05:23:40.207106+0000","last_undegraded":"2024-09-12T05:23:40.207106+0000","last_fullsized":"2024-09-12T05:23:40.207106+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:53.720206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021121,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7224,"num_read_kb":35602,"num_write":683,"num_write_kb":24689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":22193143,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"173'568","reported_seq":2739,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107780+0000","last_change":"2024-09-12T05:23:08.892915+0000","last_active":"2024-09-12T05:23:39.107780+0000","last_peered":"2024-09-12T05:23:39.107780+0000","last_clean":"2024-09-12T05:23:39.107780+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:23:39.107780+0000","last_undegraded":"2024-09-12T05:23:39.107780+0000","last_fullsized":"2024-09-12T05:23:39.107780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:36.311832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002006543,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":2948,"num_read_kb":4414,"num_write":610,"num_write_kb":2188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"172'904","reported_seq":3485,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110717+0000","last_change":"2024-09-12T05:23:09.006738+0000","last_active":"2024-09-12T05:23:39.110717+0000","last_peered":"2024-09-12T05:23:39.110717+0000","last_clean":"2024-09-12T05:23:39.110717+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:23:39.110717+0000","last_undegraded":"2024-09-12T05:23:39.110717+0000","last_fullsized":"2024-09-12T05:23:39.110717+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:24.153867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037362760000000002,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":5009,"num_read_kb":21353,"num_write":1061,"num_write_kb":9448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"166'486","reported_seq":5111,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110776+0000","last_change":"2024-09-12T05:23:09.007825+0000","last_active":"2024-09-12T05:23:39.110776+0000","last_peered":"2024-09-12T05:23:39.110776+0000","last_clean":"2024-09-12T05:23:39.110776+0000","last_became_active":"2024-09-12T05:22:23.848062+0000","last_became_peered":"2024-09-12T05:22:23.848062+0000","last_unstale":"2024-09-12T05:23:39.110776+0000","last_undegraded":"2024-09-12T05:23:39.110776+0000","last_fullsized":"2024-09-12T05:23:39.110776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:15.695305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045086240000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5071,"num_read_kb":16406,"num_write":417,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":6526540,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"179'1802","reported_seq":4650,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111610+0000","last_change":"2024-09-12T05:23:21.320885+0000","last_active":"2024-09-12T05:23:39.111610+0000","last_peered":"2024-09-12T05:23:39.111610+0000","last_clean":"2024-09-12T05:23:39.111610+0000","last_became_active":"2024-09-12T05:23:21.071081+0000","last_became_peered":"2024-09-12T05:23:21.071081+0000","last_unstale":"2024-09-12T05:23:39.111610+0000","last_undegraded":"2024-09-12T05:23:39.111610+0000","last_fullsized":"2024-09-12T05:23:39.111610+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.752691+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.074865914000000006,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":10272,"num_read_kb":16192,"num_write":3031,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"172'764","reported_seq":6213,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868057+0000","last_change":"2024-09-12T05:23:09.006532+0000","last_active":"2024-09-12T05:23:39.868057+0000","last_peered":"2024-09-12T05:23:39.868057+0000","last_clean":"2024-09-12T05:23:39.868057+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:23:39.868057+0000","last_undegraded":"2024-09-12T05:23:39.868057+0000","last_fullsized":"2024-09-12T05:23:39.868057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:19.123843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052823210000000004,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7010,"num_read_kb":29483,"num_write":891,"num_write_kb":11124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"172'527","reported_seq":2206,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868215+0000","last_change":"2024-09-12T05:23:09.007104+0000","last_active":"2024-09-12T05:23:39.868215+0000","last_peered":"2024-09-12T05:23:39.868215+0000","last_clean":"2024-09-12T05:23:39.868215+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:23:39.868215+0000","last_undegraded":"2024-09-12T05:23:39.868215+0000","last_fullsized":"2024-09-12T05:23:39.868215+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.855353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053945199999999999,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":2302,"num_read_kb":6600,"num_write":563,"num_write_kb":4788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"165'378","reported_seq":3931,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868228+0000","last_change":"2024-09-12T05:23:09.008317+0000","last_active":"2024-09-12T05:23:39.868228+0000","last_peered":"2024-09-12T05:23:39.868228+0000","last_clean":"2024-09-12T05:23:39.868228+0000","last_became_active":"2024-09-12T05:22:54.769137+0000","last_became_peered":"2024-09-12T05:22:54.769137+0000","last_unstale":"2024-09-12T05:23:39.868228+0000","last_undegraded":"2024-09-12T05:23:39.868228+0000","last_fullsized":"2024-09-12T05:23:39.868228+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:48.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062235559999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3060,"num_read_kb":10629,"num_write":327,"num_write_kb":8973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":227,"num_bytes_recovered":1802832,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"166'501","reported_seq":3371,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110697+0000","last_change":"2024-09-12T05:23:09.005232+0000","last_active":"2024-09-12T05:23:39.110697+0000","last_peered":"2024-09-12T05:23:39.110697+0000","last_clean":"2024-09-12T05:23:39.110697+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:23:39.110697+0000","last_undegraded":"2024-09-12T05:23:39.110697+0000","last_fullsized":"2024-09-12T05:23:39.110697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:08.625788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025783249999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":3230,"num_read_kb":18134,"num_write":544,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"172'454","reported_seq":3074,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867582+0000","last_change":"2024-09-12T05:23:09.002032+0000","last_active":"2024-09-12T05:23:39.867582+0000","last_peered":"2024-09-12T05:23:39.867582+0000","last_clean":"2024-09-12T05:23:39.867582+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:23:39.867582+0000","last_undegraded":"2024-09-12T05:23:39.867582+0000","last_fullsized":"2024-09-12T05:23:39.867582+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:39.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019782329999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3005,"num_read_kb":39119,"num_write":453,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'408","reported_seq":2186,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107755+0000","last_change":"2024-09-12T05:23:27.159232+0000","last_active":"2024-09-12T05:23:39.107755+0000","last_peered":"2024-09-12T05:23:39.107755+0000","last_clean":"2024-09-12T05:23:39.107755+0000","last_became_active":"2024-09-12T05:23:27.157078+0000","last_became_peered":"2024-09-12T05:23:27.157078+0000","last_unstale":"2024-09-12T05:23:39.107755+0000","last_undegraded":"2024-09-12T05:23:39.107755+0000","last_fullsized":"2024-09-12T05:23:39.107755+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:13.706853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022490409999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2054,"num_read_kb":36836,"num_write":418,"num_write_kb":29183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"172'576","reported_seq":4135,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867878+0000","last_change":"2024-09-12T05:23:09.003554+0000","last_active":"2024-09-12T05:23:39.867878+0000","last_peered":"2024-09-12T05:23:39.867878+0000","last_clean":"2024-09-12T05:23:39.867878+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:23:39.867878+0000","last_undegraded":"2024-09-12T05:23:39.867878+0000","last_fullsized":"2024-09-12T05:23:39.867878+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.365681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034044259999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4425,"num_read_kb":19293,"num_write":516,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":935,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":935,"num_whiteouts":931,"num_read":160719,"num_read_kb":930985,"num_write":23755,"num_write_kb":470520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3298,"num_bytes_recovered":149051681,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24428,"internal_metadata":0},"log_size":21004,"ondisk_log_size":21004,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60472,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311368,"statfs":{"total":96636764160,"available":96574840832,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41828,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330012,"statfs":{"total":96636764160,"available":96593932288,"internally_reserved":0,"allocated":2375680,"data_stored":1158828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77932,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293908,"statfs":{"total":96636764160,"available":96556961792,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271764,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43504,"kb_used_data":2324,"kb_used_omap":27,"kb_used_meta":41124,"kb_avail":94328336,"statfs":{"total":96636764160,"available":96592216064,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":42111799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":178,"seq":764504178694,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35440,"kb_used_data":2332,"kb_used_omap":27,"kb_used_meta":33060,"kb_avail":94336400,"statfs":{"total":96636764160,"available":96600473600,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28194,"internal_metadata":33853918},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41848,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329992,"statfs":{"total":96636764160,"available":96593911808,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1164803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56296,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315544,"statfs":{"total":96636764160,"available":96579117056,"internally_reserved":0,"allocated":2969600,"data_stored":1749196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11950,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:23:43.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:23:43.784 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:43.785 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:23:43.801 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-12T05:23:42.962045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":939,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":939,"num_whiteouts":931,"num_read":160785,"num_read_kb":931040,"num_write":23858,"num_write_kb":472150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3302,"num_bytes_recovered":149051719,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21079,"ondisk_log_size":21079,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":413060,"kb_used_data":19784,"kb_used_omap":64,"kb_used_meta":393023,"kb_avail":754561660,"statfs":{"total":773094113280,"available":772671139840,"internally_reserved":0,"allocated":20258816,"data_stored":10475184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65607,"internal_metadata":402456505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001788"},"pg_stats":[{"pgid":"3.1f","version":"173'486","reported_seq":9172,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108147+0000","last_change":"2024-09-12T05:23:08.894836+0000","last_active":"2024-09-12T05:23:39.108147+0000","last_peered":"2024-09-12T05:23:39.108147+0000","last_clean":"2024-09-12T05:23:39.108147+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:23:39.108147+0000","last_undegraded":"2024-09-12T05:23:39.108147+0000","last_fullsized":"2024-09-12T05:23:39.108147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:46.702174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003248342,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9528,"num_read_kb":33880,"num_write":431,"num_write_kb":7991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"179'378","reported_seq":7803,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207394+0000","last_change":"2024-09-12T05:23:21.451138+0000","last_active":"2024-09-12T05:23:40.207394+0000","last_peered":"2024-09-12T05:23:40.207394+0000","last_clean":"2024-09-12T05:23:40.207394+0000","last_became_active":"2024-09-12T05:23:21.054723+0000","last_became_peered":"2024-09-12T05:23:21.054723+0000","last_unstale":"2024-09-12T05:23:40.207394+0000","last_undegraded":"2024-09-12T05:23:40.207394+0000","last_fullsized":"2024-09-12T05:23:40.207394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:36.202472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.11218479200000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":7029,"num_read_kb":84720,"num_write":386,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'786","reported_seq":4147,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112144+0000","last_change":"2024-09-12T05:23:08.884176+0000","last_active":"2024-09-12T05:23:39.112144+0000","last_peered":"2024-09-12T05:23:39.112144+0000","last_clean":"2024-09-12T05:23:39.112144+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:23:39.112144+0000","last_undegraded":"2024-09-12T05:23:39.112144+0000","last_fullsized":"2024-09-12T05:23:39.112144+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:16.886391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772933,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5372,"num_read_kb":9022,"num_write":882,"num_write_kb":5162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'728","reported_seq":5598,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111345+0000","last_change":"2024-09-12T05:23:08.885454+0000","last_active":"2024-09-12T05:23:39.111345+0000","last_peered":"2024-09-12T05:23:39.111345+0000","last_clean":"2024-09-12T05:23:39.111345+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:23:39.111345+0000","last_undegraded":"2024-09-12T05:23:39.111345+0000","last_fullsized":"2024-09-12T05:23:39.111345+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.227991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002840431,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":6419,"num_read_kb":39592,"num_write":787,"num_write_kb":9586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"172'701","reported_seq":4029,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108032+0000","last_change":"2024-09-12T05:23:08.894170+0000","last_active":"2024-09-12T05:23:39.108032+0000","last_peered":"2024-09-12T05:23:39.108032+0000","last_clean":"2024-09-12T05:23:39.108032+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:23:39.108032+0000","last_undegraded":"2024-09-12T05:23:39.108032+0000","last_fullsized":"2024-09-12T05:23:39.108032+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:09.253291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028723139999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":4932,"num_read_kb":38662,"num_write":725,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'441","reported_seq":6261,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848488+0000","last_change":"2024-09-12T05:23:08.921196+0000","last_active":"2024-09-12T05:23:38.848488+0000","last_peered":"2024-09-12T05:23:38.848488+0000","last_clean":"2024-09-12T05:23:38.848488+0000","last_became_active":"2024-09-12T05:23:05.778317+0000","last_became_peered":"2024-09-12T05:23:05.778317+0000","last_unstale":"2024-09-12T05:23:38.848488+0000","last_undegraded":"2024-09-12T05:23:38.848488+0000","last_fullsized":"2024-09-12T05:23:38.848488+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:31.021021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023560629999999998,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5982,"num_read_kb":31159,"num_write":378,"num_write_kb":18476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":278,"num_bytes_recovered":17309726,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"172'466","reported_seq":4426,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866481+0000","last_change":"2024-09-12T05:23:22.198107+0000","last_active":"2024-09-12T05:23:39.866481+0000","last_peered":"2024-09-12T05:23:39.866481+0000","last_clean":"2024-09-12T05:23:39.866481+0000","last_became_active":"2024-09-12T05:23:22.049233+0000","last_became_peered":"2024-09-12T05:23:22.049233+0000","last_unstale":"2024-09-12T05:23:39.866481+0000","last_undegraded":"2024-09-12T05:23:39.866481+0000","last_fullsized":"2024-09-12T05:23:39.866481+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.090281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015759229999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4026,"num_read_kb":33452,"num_write":410,"num_write_kb":5078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":1855629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"179'656","reported_seq":3405,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207255+0000","last_change":"2024-09-12T05:23:21.371061+0000","last_active":"2024-09-12T05:23:40.207255+0000","last_peered":"2024-09-12T05:23:40.207255+0000","last_clean":"2024-09-12T05:23:40.207255+0000","last_became_active":"2024-09-12T05:23:21.054412+0000","last_became_peered":"2024-09-12T05:23:21.054412+0000","last_unstale":"2024-09-12T05:23:40.207255+0000","last_undegraded":"2024-09-12T05:23:40.207255+0000","last_fullsized":"2024-09-12T05:23:40.207255+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:27.068859+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.10278277800000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4940,"num_read_kb":22589,"num_write":590,"num_write_kb":11883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"173'686","reported_seq":2504,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108153+0000","last_change":"2024-09-12T05:23:08.896248+0000","last_active":"2024-09-12T05:23:39.108153+0000","last_peered":"2024-09-12T05:23:39.108153+0000","last_clean":"2024-09-12T05:23:39.108153+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:23:39.108153+0000","last_undegraded":"2024-09-12T05:23:39.108153+0000","last_fullsized":"2024-09-12T05:23:39.108153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:58.298697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042327889999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3367,"num_read_kb":15041,"num_write":820,"num_write_kb":7486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"165'549","reported_seq":6342,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112821+0000","last_change":"2024-09-12T05:23:08.884563+0000","last_active":"2024-09-12T05:23:39.112821+0000","last_peered":"2024-09-12T05:23:39.112821+0000","last_clean":"2024-09-12T05:23:39.112821+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:23:39.112821+0000","last_undegraded":"2024-09-12T05:23:39.112821+0000","last_fullsized":"2024-09-12T05:23:39.112821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:42.147876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00202206,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":6274,"num_read_kb":69645,"num_write":520,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'418","reported_seq":2533,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867909+0000","last_change":"2024-09-12T05:23:24.071340+0000","last_active":"2024-09-12T05:23:39.867909+0000","last_peered":"2024-09-12T05:23:39.867909+0000","last_clean":"2024-09-12T05:23:39.867909+0000","last_became_active":"2024-09-12T05:23:24.069263+0000","last_became_peered":"2024-09-12T05:23:24.069263+0000","last_unstale":"2024-09-12T05:23:39.867909+0000","last_undegraded":"2024-09-12T05:23:39.867909+0000","last_fullsized":"2024-09-12T05:23:39.867909+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:24.354148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041559700000000002,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":1771,"num_read_kb":12775,"num_write":434,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"173'1271","reported_seq":5562,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848790+0000","last_change":"2024-09-12T05:23:08.921139+0000","last_active":"2024-09-12T05:23:38.848790+0000","last_peered":"2024-09-12T05:23:38.848790+0000","last_clean":"2024-09-12T05:23:38.848790+0000","last_became_active":"2024-09-12T05:22:14.756246+0000","last_became_peered":"2024-09-12T05:22:14.756246+0000","last_unstale":"2024-09-12T05:23:38.848790+0000","last_undegraded":"2024-09-12T05:23:38.848790+0000","last_fullsized":"2024-09-12T05:23:38.848790+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:02.371995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001595127,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":8879,"num_read_kb":39076,"num_write":1824,"num_write_kb":25359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":17251748,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":317,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111101+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:23:39.111101+0000","last_peered":"2024-09-12T05:23:39.111101+0000","last_clean":"2024-09-12T05:23:39.111101+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:23:39.111101+0000","last_undegraded":"2024-09-12T05:23:39.111101+0000","last_fullsized":"2024-09-12T05:23:39.111101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"173'802","reported_seq":3301,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107905+0000","last_change":"2024-09-12T05:23:08.896149+0000","last_active":"2024-09-12T05:23:39.107905+0000","last_peered":"2024-09-12T05:23:39.107905+0000","last_clean":"2024-09-12T05:23:39.107905+0000","last_became_active":"2024-09-12T05:23:06.775134+0000","last_became_peered":"2024-09-12T05:23:06.775134+0000","last_unstale":"2024-09-12T05:23:39.107905+0000","last_undegraded":"2024-09-12T05:23:39.107905+0000","last_fullsized":"2024-09-12T05:23:39.107905+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:00.057042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042806040000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":2732,"num_read_kb":14112,"num_write":849,"num_write_kb":22030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":524386,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866541+0000","last_change":"2024-09-12T05:23:02.831403+0000","last_active":"2024-09-12T05:23:39.866541+0000","last_peered":"2024-09-12T05:23:39.866541+0000","last_clean":"2024-09-12T05:23:39.866541+0000","last_became_active":"2024-09-12T05:23:02.830555+0000","last_became_peered":"2024-09-12T05:23:02.830555+0000","last_unstale":"2024-09-12T05:23:39.866541+0000","last_undegraded":"2024-09-12T05:23:39.866541+0000","last_fullsized":"2024-09-12T05:23:39.866541+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:08.335748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"179'435","reported_seq":3445,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207585+0000","last_change":"2024-09-12T05:23:21.287558+0000","last_active":"2024-09-12T05:23:40.207585+0000","last_peered":"2024-09-12T05:23:40.207585+0000","last_clean":"2024-09-12T05:23:40.207585+0000","last_became_active":"2024-09-12T05:23:21.051627+0000","last_became_peered":"2024-09-12T05:23:21.051627+0000","last_unstale":"2024-09-12T05:23:40.207585+0000","last_undegraded":"2024-09-12T05:23:40.207585+0000","last_fullsized":"2024-09-12T05:23:40.207585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:44.975331+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.114526524,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2848,"num_read_kb":54239,"num_write":458,"num_write_kb":24596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":368,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868205+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:23:39.868205+0000","last_peered":"2024-09-12T05:23:39.868205+0000","last_clean":"2024-09-12T05:23:39.868205+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:23:39.868205+0000","last_undegraded":"2024-09-12T05:23:39.868205+0000","last_fullsized":"2024-09-12T05:23:39.868205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"172'752","reported_seq":4313,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866631+0000","last_change":"2024-09-12T05:23:08.885502+0000","last_active":"2024-09-12T05:23:39.866631+0000","last_peered":"2024-09-12T05:23:39.866631+0000","last_clean":"2024-09-12T05:23:39.866631+0000","last_became_active":"2024-09-12T05:23:06.773505+0000","last_became_peered":"2024-09-12T05:23:06.773505+0000","last_unstale":"2024-09-12T05:23:39.866631+0000","last_undegraded":"2024-09-12T05:23:39.866631+0000","last_fullsized":"2024-09-12T05:23:39.866631+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:15.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024700099999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5270,"num_read_kb":22820,"num_write":798,"num_write_kb":28293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":474,"num_bytes_recovered":12649810,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866460+0000","last_change":"2024-09-12T05:23:02.830895+0000","last_active":"2024-09-12T05:23:39.866460+0000","last_peered":"2024-09-12T05:23:39.866460+0000","last_clean":"2024-09-12T05:23:39.866460+0000","last_became_active":"2024-09-12T05:23:02.829933+0000","last_became_peered":"2024-09-12T05:23:02.829933+0000","last_unstale":"2024-09-12T05:23:39.866460+0000","last_undegraded":"2024-09-12T05:23:39.866460+0000","last_fullsized":"2024-09-12T05:23:39.866460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.164044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"179'485","reported_seq":2864,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112442+0000","last_change":"2024-09-12T05:23:21.221659+0000","last_active":"2024-09-12T05:23:39.112442+0000","last_peered":"2024-09-12T05:23:39.112442+0000","last_clean":"2024-09-12T05:23:39.112442+0000","last_became_active":"2024-09-12T05:23:21.069868+0000","last_became_peered":"2024-09-12T05:23:21.069868+0000","last_unstale":"2024-09-12T05:23:39.112442+0000","last_undegraded":"2024-09-12T05:23:39.112442+0000","last_fullsized":"2024-09-12T05:23:39.112442+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:29.218757+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.078824042999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2610,"num_read_kb":20437,"num_write":595,"num_write_kb":10557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"173'729","reported_seq":5225,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848718+0000","last_change":"2024-09-12T05:23:08.920199+0000","last_active":"2024-09-12T05:23:38.848718+0000","last_peered":"2024-09-12T05:23:38.848718+0000","last_clean":"2024-09-12T05:23:38.848718+0000","last_became_active":"2024-09-12T05:22:14.219295+0000","last_became_peered":"2024-09-12T05:22:14.219295+0000","last_unstale":"2024-09-12T05:23:38.848718+0000","last_undegraded":"2024-09-12T05:23:38.848718+0000","last_fullsized":"2024-09-12T05:23:38.848718+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:08.649145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001330901,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":5192,"num_read_kb":18719,"num_write":679,"num_write_kb":26356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":391,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:23:02.838440+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:23:02.830933+0000","last_became_peered":"2024-09-12T05:23:02.830933+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:59.974404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"172'1022","reported_seq":10699,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866410+0000","last_change":"2024-09-12T05:23:08.884903+0000","last_active":"2024-09-12T05:23:39.866410+0000","last_peered":"2024-09-12T05:23:39.866410+0000","last_clean":"2024-09-12T05:23:39.866410+0000","last_became_active":"2024-09-12T05:23:06.773339+0000","last_became_peered":"2024-09-12T05:23:06.773339+0000","last_unstale":"2024-09-12T05:23:39.866410+0000","last_undegraded":"2024-09-12T05:23:39.866410+0000","last_fullsized":"2024-09-12T05:23:39.866410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1022,"log_dups_size":0,"ondisk_log_size":1022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.213297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002206193,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":11896,"num_read_kb":54588,"num_write":1368,"num_write_kb":21769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":13965694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.864991+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:23:39.864991+0000","last_peered":"2024-09-12T05:23:39.864991+0000","last_clean":"2024-09-12T05:23:39.864991+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:23:39.864991+0000","last_undegraded":"2024-09-12T05:23:39.864991+0000","last_fullsized":"2024-09-12T05:23:39.864991+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'610","reported_seq":2588,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108052+0000","last_change":"2024-09-12T05:23:08.892844+0000","last_active":"2024-09-12T05:23:39.108052+0000","last_peered":"2024-09-12T05:23:39.108052+0000","last_clean":"2024-09-12T05:23:39.108052+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:23:39.108052+0000","last_undegraded":"2024-09-12T05:23:39.108052+0000","last_fullsized":"2024-09-12T05:23:39.108052+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:18.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015778210000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":2646,"num_read_kb":16084,"num_write":734,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":380,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867778+0000","last_change":"2024-09-12T05:23:02.827747+0000","last_active":"2024-09-12T05:23:39.867778+0000","last_peered":"2024-09-12T05:23:39.867778+0000","last_clean":"2024-09-12T05:23:39.867778+0000","last_became_active":"2024-09-12T05:23:02.826853+0000","last_became_peered":"2024-09-12T05:23:02.826853+0000","last_unstale":"2024-09-12T05:23:39.867778+0000","last_undegraded":"2024-09-12T05:23:39.867778+0000","last_fullsized":"2024-09-12T05:23:39.867778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:35.923974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"179'516","reported_seq":3644,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207359+0000","last_change":"2024-09-12T05:23:21.556051+0000","last_active":"2024-09-12T05:23:40.207359+0000","last_peered":"2024-09-12T05:23:40.207359+0000","last_clean":"2024-09-12T05:23:40.207359+0000","last_became_active":"2024-09-12T05:23:21.060573+0000","last_became_peered":"2024-09-12T05:23:21.060573+0000","last_unstale":"2024-09-12T05:23:40.207359+0000","last_undegraded":"2024-09-12T05:23:40.207359+0000","last_fullsized":"2024-09-12T05:23:40.207359+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:56.367076+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.13014315100000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3396,"num_read_kb":46312,"num_write":573,"num_write_kb":32831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":390,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":460,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867568+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:23:39.867568+0000","last_peered":"2024-09-12T05:23:39.867568+0000","last_clean":"2024-09-12T05:23:39.867568+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:23:39.867568+0000","last_undegraded":"2024-09-12T05:23:39.867568+0000","last_fullsized":"2024-09-12T05:23:39.867568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"172'719","reported_seq":5307,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207106+0000","last_change":"2024-09-12T05:23:24.067998+0000","last_active":"2024-09-12T05:23:40.207106+0000","last_peered":"2024-09-12T05:23:40.207106+0000","last_clean":"2024-09-12T05:23:40.207106+0000","last_became_active":"2024-09-12T05:23:24.066068+0000","last_became_peered":"2024-09-12T05:23:24.066068+0000","last_unstale":"2024-09-12T05:23:40.207106+0000","last_undegraded":"2024-09-12T05:23:40.207106+0000","last_fullsized":"2024-09-12T05:23:40.207106+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:53.720206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021121,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7224,"num_read_kb":35602,"num_write":683,"num_write_kb":24689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":22193143,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"173'568","reported_seq":2739,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107780+0000","last_change":"2024-09-12T05:23:08.892915+0000","last_active":"2024-09-12T05:23:39.107780+0000","last_peered":"2024-09-12T05:23:39.107780+0000","last_clean":"2024-09-12T05:23:39.107780+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:23:39.107780+0000","last_undegraded":"2024-09-12T05:23:39.107780+0000","last_fullsized":"2024-09-12T05:23:39.107780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:36.311832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002006543,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":2948,"num_read_kb":4414,"num_write":610,"num_write_kb":2188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"172'904","reported_seq":3485,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110717+0000","last_change":"2024-09-12T05:23:09.006738+0000","last_active":"2024-09-12T05:23:39.110717+0000","last_peered":"2024-09-12T05:23:39.110717+0000","last_clean":"2024-09-12T05:23:39.110717+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:23:39.110717+0000","last_undegraded":"2024-09-12T05:23:39.110717+0000","last_fullsized":"2024-09-12T05:23:39.110717+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:24.153867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037362760000000002,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":5009,"num_read_kb":21353,"num_write":1061,"num_write_kb":9448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"166'486","reported_seq":5111,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110776+0000","last_change":"2024-09-12T05:23:09.007825+0000","last_active":"2024-09-12T05:23:39.110776+0000","last_peered":"2024-09-12T05:23:39.110776+0000","last_clean":"2024-09-12T05:23:39.110776+0000","last_became_active":"2024-09-12T05:22:23.848062+0000","last_became_peered":"2024-09-12T05:22:23.848062+0000","last_unstale":"2024-09-12T05:23:39.110776+0000","last_undegraded":"2024-09-12T05:23:39.110776+0000","last_fullsized":"2024-09-12T05:23:39.110776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:15.695305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045086240000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5071,"num_read_kb":16406,"num_write":417,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":6526540,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"179'1802","reported_seq":4650,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111610+0000","last_change":"2024-09-12T05:23:21.320885+0000","last_active":"2024-09-12T05:23:39.111610+0000","last_peered":"2024-09-12T05:23:39.111610+0000","last_clean":"2024-09-12T05:23:39.111610+0000","last_became_active":"2024-09-12T05:23:21.071081+0000","last_became_peered":"2024-09-12T05:23:21.071081+0000","last_unstale":"2024-09-12T05:23:39.111610+0000","last_undegraded":"2024-09-12T05:23:39.111610+0000","last_fullsized":"2024-09-12T05:23:39.111610+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.752691+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.074865914000000006,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":10272,"num_read_kb":16192,"num_write":3031,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"172'764","reported_seq":6213,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868057+0000","last_change":"2024-09-12T05:23:09.006532+0000","last_active":"2024-09-12T05:23:39.868057+0000","last_peered":"2024-09-12T05:23:39.868057+0000","last_clean":"2024-09-12T05:23:39.868057+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:23:39.868057+0000","last_undegraded":"2024-09-12T05:23:39.868057+0000","last_fullsized":"2024-09-12T05:23:39.868057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:19.123843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052823210000000004,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7010,"num_read_kb":29483,"num_write":891,"num_write_kb":11124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"172'527","reported_seq":2206,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868215+0000","last_change":"2024-09-12T05:23:09.007104+0000","last_active":"2024-09-12T05:23:39.868215+0000","last_peered":"2024-09-12T05:23:39.868215+0000","last_clean":"2024-09-12T05:23:39.868215+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:23:39.868215+0000","last_undegraded":"2024-09-12T05:23:39.868215+0000","last_fullsized":"2024-09-12T05:23:39.868215+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.855353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053945199999999999,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":2302,"num_read_kb":6600,"num_write":563,"num_write_kb":4788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"165'378","reported_seq":3931,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868228+0000","last_change":"2024-09-12T05:23:09.008317+0000","last_active":"2024-09-12T05:23:39.868228+0000","last_peered":"2024-09-12T05:23:39.868228+0000","last_clean":"2024-09-12T05:23:39.868228+0000","last_became_active":"2024-09-12T05:22:54.769137+0000","last_became_peered":"2024-09-12T05:22:54.769137+0000","last_unstale":"2024-09-12T05:23:39.868228+0000","last_undegraded":"2024-09-12T05:23:39.868228+0000","last_fullsized":"2024-09-12T05:23:39.868228+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:48.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062235559999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3060,"num_read_kb":10629,"num_write":327,"num_write_kb":8973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":227,"num_bytes_recovered":1802832,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"166'501","reported_seq":3371,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110697+0000","last_change":"2024-09-12T05:23:09.005232+0000","last_active":"2024-09-12T05:23:39.110697+0000","last_peered":"2024-09-12T05:23:39.110697+0000","last_clean":"2024-09-12T05:23:39.110697+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:23:39.110697+0000","last_undegraded":"2024-09-12T05:23:39.110697+0000","last_fullsized":"2024-09-12T05:23:39.110697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:08.625788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025783249999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":3230,"num_read_kb":18134,"num_write":544,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"172'454","reported_seq":3074,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867582+0000","last_change":"2024-09-12T05:23:09.002032+0000","last_active":"2024-09-12T05:23:39.867582+0000","last_peered":"2024-09-12T05:23:39.867582+0000","last_clean":"2024-09-12T05:23:39.867582+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:23:39.867582+0000","last_undegraded":"2024-09-12T05:23:39.867582+0000","last_fullsized":"2024-09-12T05:23:39.867582+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:39.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019782329999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3005,"num_read_kb":39119,"num_write":453,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'408","reported_seq":2186,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107755+0000","last_change":"2024-09-12T05:23:27.159232+0000","last_active":"2024-09-12T05:23:39.107755+0000","last_peered":"2024-09-12T05:23:39.107755+0000","last_clean":"2024-09-12T05:23:39.107755+0000","last_became_active":"2024-09-12T05:23:27.157078+0000","last_became_peered":"2024-09-12T05:23:27.157078+0000","last_unstale":"2024-09-12T05:23:39.107755+0000","last_undegraded":"2024-09-12T05:23:39.107755+0000","last_fullsized":"2024-09-12T05:23:39.107755+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:13.706853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022490409999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2054,"num_read_kb":36836,"num_write":418,"num_write_kb":29183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"172'576","reported_seq":4135,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867878+0000","last_change":"2024-09-12T05:23:09.003554+0000","last_active":"2024-09-12T05:23:39.867878+0000","last_peered":"2024-09-12T05:23:39.867878+0000","last_clean":"2024-09-12T05:23:39.867878+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:23:39.867878+0000","last_undegraded":"2024-09-12T05:23:39.867878+0000","last_fullsized":"2024-09-12T05:23:39.867878+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.365681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034044259999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4425,"num_read_kb":19293,"num_write":516,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":935,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":935,"num_whiteouts":931,"num_read":160719,"num_read_kb":930985,"num_write":23755,"num_write_kb":470520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3298,"num_bytes_recovered":149051681,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24428,"internal_metadata":0},"log_size":21004,"ondisk_log_size":21004,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60472,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311368,"statfs":{"total":96636764160,"available":96574840832,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41828,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330012,"statfs":{"total":96636764160,"available":96593932288,"internally_reserved":0,"allocated":2375680,"data_stored":1158828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77932,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293908,"statfs":{"total":96636764160,"available":96556961792,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271764,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43504,"kb_used_data":2324,"kb_used_omap":27,"kb_used_meta":41124,"kb_avail":94328336,"statfs":{"total":96636764160,"available":96592216064,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":42111799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":178,"seq":764504178694,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35440,"kb_used_data":2332,"kb_used_omap":27,"kb_used_meta":33060,"kb_avail":94336400,"statfs":{"total":96636764160,"available":96600473600,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28194,"internal_metadata":33853918},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41848,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329992,"statfs":{"total":96636764160,"available":96593911808,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1164803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56296,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315544,"statfs":{"total":96636764160,"available":96579117056,"internally_reserved":0,"allocated":2969600,"data_stored":1749196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11950,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:23:43.803 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T05:23:43.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T05:23:44.137 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T05:23:44.145 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T05:23:44.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:23:44.446 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:44.446 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:23:44.463 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-12T05:23:42.962045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":939,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":939,"num_whiteouts":931,"num_read":160785,"num_read_kb":931040,"num_write":23858,"num_write_kb":472150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3302,"num_bytes_recovered":149051719,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21079,"ondisk_log_size":21079,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":413060,"kb_used_data":19784,"kb_used_omap":64,"kb_used_meta":393023,"kb_avail":754561660,"statfs":{"total":773094113280,"available":772671139840,"internally_reserved":0,"allocated":20258816,"data_stored":10475184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65607,"internal_metadata":402456505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001788"},"pg_stats":[{"pgid":"3.1f","version":"173'486","reported_seq":9172,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108147+0000","last_change":"2024-09-12T05:23:08.894836+0000","last_active":"2024-09-12T05:23:39.108147+0000","last_peered":"2024-09-12T05:23:39.108147+0000","last_clean":"2024-09-12T05:23:39.108147+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:23:39.108147+0000","last_undegraded":"2024-09-12T05:23:39.108147+0000","last_fullsized":"2024-09-12T05:23:39.108147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:46.702174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003248342,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9528,"num_read_kb":33880,"num_write":431,"num_write_kb":7991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"179'378","reported_seq":7803,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207394+0000","last_change":"2024-09-12T05:23:21.451138+0000","last_active":"2024-09-12T05:23:40.207394+0000","last_peered":"2024-09-12T05:23:40.207394+0000","last_clean":"2024-09-12T05:23:40.207394+0000","last_became_active":"2024-09-12T05:23:21.054723+0000","last_became_peered":"2024-09-12T05:23:21.054723+0000","last_unstale":"2024-09-12T05:23:40.207394+0000","last_undegraded":"2024-09-12T05:23:40.207394+0000","last_fullsized":"2024-09-12T05:23:40.207394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:36.202472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.11218479200000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":7029,"num_read_kb":84720,"num_write":386,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'786","reported_seq":4147,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112144+0000","last_change":"2024-09-12T05:23:08.884176+0000","last_active":"2024-09-12T05:23:39.112144+0000","last_peered":"2024-09-12T05:23:39.112144+0000","last_clean":"2024-09-12T05:23:39.112144+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:23:39.112144+0000","last_undegraded":"2024-09-12T05:23:39.112144+0000","last_fullsized":"2024-09-12T05:23:39.112144+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:16.886391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772933,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5372,"num_read_kb":9022,"num_write":882,"num_write_kb":5162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'728","reported_seq":5598,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111345+0000","last_change":"2024-09-12T05:23:08.885454+0000","last_active":"2024-09-12T05:23:39.111345+0000","last_peered":"2024-09-12T05:23:39.111345+0000","last_clean":"2024-09-12T05:23:39.111345+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:23:39.111345+0000","last_undegraded":"2024-09-12T05:23:39.111345+0000","last_fullsized":"2024-09-12T05:23:39.111345+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.227991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002840431,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":6419,"num_read_kb":39592,"num_write":787,"num_write_kb":9586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"172'701","reported_seq":4029,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108032+0000","last_change":"2024-09-12T05:23:08.894170+0000","last_active":"2024-09-12T05:23:39.108032+0000","last_peered":"2024-09-12T05:23:39.108032+0000","last_clean":"2024-09-12T05:23:39.108032+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:23:39.108032+0000","last_undegraded":"2024-09-12T05:23:39.108032+0000","last_fullsized":"2024-09-12T05:23:39.108032+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:09.253291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028723139999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":4932,"num_read_kb":38662,"num_write":725,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'441","reported_seq":6261,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848488+0000","last_change":"2024-09-12T05:23:08.921196+0000","last_active":"2024-09-12T05:23:38.848488+0000","last_peered":"2024-09-12T05:23:38.848488+0000","last_clean":"2024-09-12T05:23:38.848488+0000","last_became_active":"2024-09-12T05:23:05.778317+0000","last_became_peered":"2024-09-12T05:23:05.778317+0000","last_unstale":"2024-09-12T05:23:38.848488+0000","last_undegraded":"2024-09-12T05:23:38.848488+0000","last_fullsized":"2024-09-12T05:23:38.848488+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:31.021021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023560629999999998,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5982,"num_read_kb":31159,"num_write":378,"num_write_kb":18476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":278,"num_bytes_recovered":17309726,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"172'466","reported_seq":4426,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866481+0000","last_change":"2024-09-12T05:23:22.198107+0000","last_active":"2024-09-12T05:23:39.866481+0000","last_peered":"2024-09-12T05:23:39.866481+0000","last_clean":"2024-09-12T05:23:39.866481+0000","last_became_active":"2024-09-12T05:23:22.049233+0000","last_became_peered":"2024-09-12T05:23:22.049233+0000","last_unstale":"2024-09-12T05:23:39.866481+0000","last_undegraded":"2024-09-12T05:23:39.866481+0000","last_fullsized":"2024-09-12T05:23:39.866481+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.090281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015759229999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4026,"num_read_kb":33452,"num_write":410,"num_write_kb":5078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":1855629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"179'656","reported_seq":3405,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207255+0000","last_change":"2024-09-12T05:23:21.371061+0000","last_active":"2024-09-12T05:23:40.207255+0000","last_peered":"2024-09-12T05:23:40.207255+0000","last_clean":"2024-09-12T05:23:40.207255+0000","last_became_active":"2024-09-12T05:23:21.054412+0000","last_became_peered":"2024-09-12T05:23:21.054412+0000","last_unstale":"2024-09-12T05:23:40.207255+0000","last_undegraded":"2024-09-12T05:23:40.207255+0000","last_fullsized":"2024-09-12T05:23:40.207255+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:27.068859+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.10278277800000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4940,"num_read_kb":22589,"num_write":590,"num_write_kb":11883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"173'686","reported_seq":2504,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108153+0000","last_change":"2024-09-12T05:23:08.896248+0000","last_active":"2024-09-12T05:23:39.108153+0000","last_peered":"2024-09-12T05:23:39.108153+0000","last_clean":"2024-09-12T05:23:39.108153+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:23:39.108153+0000","last_undegraded":"2024-09-12T05:23:39.108153+0000","last_fullsized":"2024-09-12T05:23:39.108153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:58.298697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042327889999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3367,"num_read_kb":15041,"num_write":820,"num_write_kb":7486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"165'549","reported_seq":6342,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112821+0000","last_change":"2024-09-12T05:23:08.884563+0000","last_active":"2024-09-12T05:23:39.112821+0000","last_peered":"2024-09-12T05:23:39.112821+0000","last_clean":"2024-09-12T05:23:39.112821+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:23:39.112821+0000","last_undegraded":"2024-09-12T05:23:39.112821+0000","last_fullsized":"2024-09-12T05:23:39.112821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:42.147876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00202206,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":6274,"num_read_kb":69645,"num_write":520,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'418","reported_seq":2533,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867909+0000","last_change":"2024-09-12T05:23:24.071340+0000","last_active":"2024-09-12T05:23:39.867909+0000","last_peered":"2024-09-12T05:23:39.867909+0000","last_clean":"2024-09-12T05:23:39.867909+0000","last_became_active":"2024-09-12T05:23:24.069263+0000","last_became_peered":"2024-09-12T05:23:24.069263+0000","last_unstale":"2024-09-12T05:23:39.867909+0000","last_undegraded":"2024-09-12T05:23:39.867909+0000","last_fullsized":"2024-09-12T05:23:39.867909+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:24.354148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041559700000000002,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":1771,"num_read_kb":12775,"num_write":434,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"173'1271","reported_seq":5562,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848790+0000","last_change":"2024-09-12T05:23:08.921139+0000","last_active":"2024-09-12T05:23:38.848790+0000","last_peered":"2024-09-12T05:23:38.848790+0000","last_clean":"2024-09-12T05:23:38.848790+0000","last_became_active":"2024-09-12T05:22:14.756246+0000","last_became_peered":"2024-09-12T05:22:14.756246+0000","last_unstale":"2024-09-12T05:23:38.848790+0000","last_undegraded":"2024-09-12T05:23:38.848790+0000","last_fullsized":"2024-09-12T05:23:38.848790+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:02.371995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001595127,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":8879,"num_read_kb":39076,"num_write":1824,"num_write_kb":25359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":17251748,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":317,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111101+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:23:39.111101+0000","last_peered":"2024-09-12T05:23:39.111101+0000","last_clean":"2024-09-12T05:23:39.111101+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:23:39.111101+0000","last_undegraded":"2024-09-12T05:23:39.111101+0000","last_fullsized":"2024-09-12T05:23:39.111101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"173'802","reported_seq":3301,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107905+0000","last_change":"2024-09-12T05:23:08.896149+0000","last_active":"2024-09-12T05:23:39.107905+0000","last_peered":"2024-09-12T05:23:39.107905+0000","last_clean":"2024-09-12T05:23:39.107905+0000","last_became_active":"2024-09-12T05:23:06.775134+0000","last_became_peered":"2024-09-12T05:23:06.775134+0000","last_unstale":"2024-09-12T05:23:39.107905+0000","last_undegraded":"2024-09-12T05:23:39.107905+0000","last_fullsized":"2024-09-12T05:23:39.107905+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:00.057042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042806040000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":2732,"num_read_kb":14112,"num_write":849,"num_write_kb":22030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":524386,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866541+0000","last_change":"2024-09-12T05:23:02.831403+0000","last_active":"2024-09-12T05:23:39.866541+0000","last_peered":"2024-09-12T05:23:39.866541+0000","last_clean":"2024-09-12T05:23:39.866541+0000","last_became_active":"2024-09-12T05:23:02.830555+0000","last_became_peered":"2024-09-12T05:23:02.830555+0000","last_unstale":"2024-09-12T05:23:39.866541+0000","last_undegraded":"2024-09-12T05:23:39.866541+0000","last_fullsized":"2024-09-12T05:23:39.866541+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:08.335748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"179'435","reported_seq":3445,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207585+0000","last_change":"2024-09-12T05:23:21.287558+0000","last_active":"2024-09-12T05:23:40.207585+0000","last_peered":"2024-09-12T05:23:40.207585+0000","last_clean":"2024-09-12T05:23:40.207585+0000","last_became_active":"2024-09-12T05:23:21.051627+0000","last_became_peered":"2024-09-12T05:23:21.051627+0000","last_unstale":"2024-09-12T05:23:40.207585+0000","last_undegraded":"2024-09-12T05:23:40.207585+0000","last_fullsized":"2024-09-12T05:23:40.207585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:44.975331+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.114526524,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2848,"num_read_kb":54239,"num_write":458,"num_write_kb":24596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":368,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868205+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:23:39.868205+0000","last_peered":"2024-09-12T05:23:39.868205+0000","last_clean":"2024-09-12T05:23:39.868205+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:23:39.868205+0000","last_undegraded":"2024-09-12T05:23:39.868205+0000","last_fullsized":"2024-09-12T05:23:39.868205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"172'752","reported_seq":4313,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866631+0000","last_change":"2024-09-12T05:23:08.885502+0000","last_active":"2024-09-12T05:23:39.866631+0000","last_peered":"2024-09-12T05:23:39.866631+0000","last_clean":"2024-09-12T05:23:39.866631+0000","last_became_active":"2024-09-12T05:23:06.773505+0000","last_became_peered":"2024-09-12T05:23:06.773505+0000","last_unstale":"2024-09-12T05:23:39.866631+0000","last_undegraded":"2024-09-12T05:23:39.866631+0000","last_fullsized":"2024-09-12T05:23:39.866631+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:15.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024700099999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5270,"num_read_kb":22820,"num_write":798,"num_write_kb":28293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":474,"num_bytes_recovered":12649810,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866460+0000","last_change":"2024-09-12T05:23:02.830895+0000","last_active":"2024-09-12T05:23:39.866460+0000","last_peered":"2024-09-12T05:23:39.866460+0000","last_clean":"2024-09-12T05:23:39.866460+0000","last_became_active":"2024-09-12T05:23:02.829933+0000","last_became_peered":"2024-09-12T05:23:02.829933+0000","last_unstale":"2024-09-12T05:23:39.866460+0000","last_undegraded":"2024-09-12T05:23:39.866460+0000","last_fullsized":"2024-09-12T05:23:39.866460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.164044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"179'485","reported_seq":2864,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112442+0000","last_change":"2024-09-12T05:23:21.221659+0000","last_active":"2024-09-12T05:23:39.112442+0000","last_peered":"2024-09-12T05:23:39.112442+0000","last_clean":"2024-09-12T05:23:39.112442+0000","last_became_active":"2024-09-12T05:23:21.069868+0000","last_became_peered":"2024-09-12T05:23:21.069868+0000","last_unstale":"2024-09-12T05:23:39.112442+0000","last_undegraded":"2024-09-12T05:23:39.112442+0000","last_fullsized":"2024-09-12T05:23:39.112442+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:29.218757+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.078824042999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2610,"num_read_kb":20437,"num_write":595,"num_write_kb":10557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"173'729","reported_seq":5225,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848718+0000","last_change":"2024-09-12T05:23:08.920199+0000","last_active":"2024-09-12T05:23:38.848718+0000","last_peered":"2024-09-12T05:23:38.848718+0000","last_clean":"2024-09-12T05:23:38.848718+0000","last_became_active":"2024-09-12T05:22:14.219295+0000","last_became_peered":"2024-09-12T05:22:14.219295+0000","last_unstale":"2024-09-12T05:23:38.848718+0000","last_undegraded":"2024-09-12T05:23:38.848718+0000","last_fullsized":"2024-09-12T05:23:38.848718+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:08.649145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001330901,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":5192,"num_read_kb":18719,"num_write":679,"num_write_kb":26356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":391,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:23:02.838440+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:23:02.830933+0000","last_became_peered":"2024-09-12T05:23:02.830933+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:59.974404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"172'1022","reported_seq":10699,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866410+0000","last_change":"2024-09-12T05:23:08.884903+0000","last_active":"2024-09-12T05:23:39.866410+0000","last_peered":"2024-09-12T05:23:39.866410+0000","last_clean":"2024-09-12T05:23:39.866410+0000","last_became_active":"2024-09-12T05:23:06.773339+0000","last_became_peered":"2024-09-12T05:23:06.773339+0000","last_unstale":"2024-09-12T05:23:39.866410+0000","last_undegraded":"2024-09-12T05:23:39.866410+0000","last_fullsized":"2024-09-12T05:23:39.866410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1022,"log_dups_size":0,"ondisk_log_size":1022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.213297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002206193,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":11896,"num_read_kb":54588,"num_write":1368,"num_write_kb":21769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":13965694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.864991+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:23:39.864991+0000","last_peered":"2024-09-12T05:23:39.864991+0000","last_clean":"2024-09-12T05:23:39.864991+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:23:39.864991+0000","last_undegraded":"2024-09-12T05:23:39.864991+0000","last_fullsized":"2024-09-12T05:23:39.864991+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'610","reported_seq":2588,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108052+0000","last_change":"2024-09-12T05:23:08.892844+0000","last_active":"2024-09-12T05:23:39.108052+0000","last_peered":"2024-09-12T05:23:39.108052+0000","last_clean":"2024-09-12T05:23:39.108052+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:23:39.108052+0000","last_undegraded":"2024-09-12T05:23:39.108052+0000","last_fullsized":"2024-09-12T05:23:39.108052+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:18.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015778210000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":2646,"num_read_kb":16084,"num_write":734,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":380,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867778+0000","last_change":"2024-09-12T05:23:02.827747+0000","last_active":"2024-09-12T05:23:39.867778+0000","last_peered":"2024-09-12T05:23:39.867778+0000","last_clean":"2024-09-12T05:23:39.867778+0000","last_became_active":"2024-09-12T05:23:02.826853+0000","last_became_peered":"2024-09-12T05:23:02.826853+0000","last_unstale":"2024-09-12T05:23:39.867778+0000","last_undegraded":"2024-09-12T05:23:39.867778+0000","last_fullsized":"2024-09-12T05:23:39.867778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:35.923974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"179'516","reported_seq":3644,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207359+0000","last_change":"2024-09-12T05:23:21.556051+0000","last_active":"2024-09-12T05:23:40.207359+0000","last_peered":"2024-09-12T05:23:40.207359+0000","last_clean":"2024-09-12T05:23:40.207359+0000","last_became_active":"2024-09-12T05:23:21.060573+0000","last_became_peered":"2024-09-12T05:23:21.060573+0000","last_unstale":"2024-09-12T05:23:40.207359+0000","last_undegraded":"2024-09-12T05:23:40.207359+0000","last_fullsized":"2024-09-12T05:23:40.207359+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:56.367076+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.13014315100000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3396,"num_read_kb":46312,"num_write":573,"num_write_kb":32831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":390,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":460,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867568+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:23:39.867568+0000","last_peered":"2024-09-12T05:23:39.867568+0000","last_clean":"2024-09-12T05:23:39.867568+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:23:39.867568+0000","last_undegraded":"2024-09-12T05:23:39.867568+0000","last_fullsized":"2024-09-12T05:23:39.867568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"172'719","reported_seq":5307,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207106+0000","last_change":"2024-09-12T05:23:24.067998+0000","last_active":"2024-09-12T05:23:40.207106+0000","last_peered":"2024-09-12T05:23:40.207106+0000","last_clean":"2024-09-12T05:23:40.207106+0000","last_became_active":"2024-09-12T05:23:24.066068+0000","last_became_peered":"2024-09-12T05:23:24.066068+0000","last_unstale":"2024-09-12T05:23:40.207106+0000","last_undegraded":"2024-09-12T05:23:40.207106+0000","last_fullsized":"2024-09-12T05:23:40.207106+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:53.720206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021121,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7224,"num_read_kb":35602,"num_write":683,"num_write_kb":24689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":22193143,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"173'568","reported_seq":2739,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107780+0000","last_change":"2024-09-12T05:23:08.892915+0000","last_active":"2024-09-12T05:23:39.107780+0000","last_peered":"2024-09-12T05:23:39.107780+0000","last_clean":"2024-09-12T05:23:39.107780+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:23:39.107780+0000","last_undegraded":"2024-09-12T05:23:39.107780+0000","last_fullsized":"2024-09-12T05:23:39.107780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:36.311832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002006543,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":2948,"num_read_kb":4414,"num_write":610,"num_write_kb":2188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"172'904","reported_seq":3485,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110717+0000","last_change":"2024-09-12T05:23:09.006738+0000","last_active":"2024-09-12T05:23:39.110717+0000","last_peered":"2024-09-12T05:23:39.110717+0000","last_clean":"2024-09-12T05:23:39.110717+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:23:39.110717+0000","last_undegraded":"2024-09-12T05:23:39.110717+0000","last_fullsized":"2024-09-12T05:23:39.110717+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:24.153867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037362760000000002,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":5009,"num_read_kb":21353,"num_write":1061,"num_write_kb":9448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"166'486","reported_seq":5111,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110776+0000","last_change":"2024-09-12T05:23:09.007825+0000","last_active":"2024-09-12T05:23:39.110776+0000","last_peered":"2024-09-12T05:23:39.110776+0000","last_clean":"2024-09-12T05:23:39.110776+0000","last_became_active":"2024-09-12T05:22:23.848062+0000","last_became_peered":"2024-09-12T05:22:23.848062+0000","last_unstale":"2024-09-12T05:23:39.110776+0000","last_undegraded":"2024-09-12T05:23:39.110776+0000","last_fullsized":"2024-09-12T05:23:39.110776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:15.695305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045086240000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5071,"num_read_kb":16406,"num_write":417,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":6526540,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"179'1802","reported_seq":4650,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111610+0000","last_change":"2024-09-12T05:23:21.320885+0000","last_active":"2024-09-12T05:23:39.111610+0000","last_peered":"2024-09-12T05:23:39.111610+0000","last_clean":"2024-09-12T05:23:39.111610+0000","last_became_active":"2024-09-12T05:23:21.071081+0000","last_became_peered":"2024-09-12T05:23:21.071081+0000","last_unstale":"2024-09-12T05:23:39.111610+0000","last_undegraded":"2024-09-12T05:23:39.111610+0000","last_fullsized":"2024-09-12T05:23:39.111610+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.752691+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.074865914000000006,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":10272,"num_read_kb":16192,"num_write":3031,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"172'764","reported_seq":6213,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868057+0000","last_change":"2024-09-12T05:23:09.006532+0000","last_active":"2024-09-12T05:23:39.868057+0000","last_peered":"2024-09-12T05:23:39.868057+0000","last_clean":"2024-09-12T05:23:39.868057+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:23:39.868057+0000","last_undegraded":"2024-09-12T05:23:39.868057+0000","last_fullsized":"2024-09-12T05:23:39.868057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:19.123843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052823210000000004,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7010,"num_read_kb":29483,"num_write":891,"num_write_kb":11124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"172'527","reported_seq":2206,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868215+0000","last_change":"2024-09-12T05:23:09.007104+0000","last_active":"2024-09-12T05:23:39.868215+0000","last_peered":"2024-09-12T05:23:39.868215+0000","last_clean":"2024-09-12T05:23:39.868215+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:23:39.868215+0000","last_undegraded":"2024-09-12T05:23:39.868215+0000","last_fullsized":"2024-09-12T05:23:39.868215+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.855353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053945199999999999,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":2302,"num_read_kb":6600,"num_write":563,"num_write_kb":4788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"165'378","reported_seq":3931,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868228+0000","last_change":"2024-09-12T05:23:09.008317+0000","last_active":"2024-09-12T05:23:39.868228+0000","last_peered":"2024-09-12T05:23:39.868228+0000","last_clean":"2024-09-12T05:23:39.868228+0000","last_became_active":"2024-09-12T05:22:54.769137+0000","last_became_peered":"2024-09-12T05:22:54.769137+0000","last_unstale":"2024-09-12T05:23:39.868228+0000","last_undegraded":"2024-09-12T05:23:39.868228+0000","last_fullsized":"2024-09-12T05:23:39.868228+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:48.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062235559999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3060,"num_read_kb":10629,"num_write":327,"num_write_kb":8973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":227,"num_bytes_recovered":1802832,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"166'501","reported_seq":3371,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110697+0000","last_change":"2024-09-12T05:23:09.005232+0000","last_active":"2024-09-12T05:23:39.110697+0000","last_peered":"2024-09-12T05:23:39.110697+0000","last_clean":"2024-09-12T05:23:39.110697+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:23:39.110697+0000","last_undegraded":"2024-09-12T05:23:39.110697+0000","last_fullsized":"2024-09-12T05:23:39.110697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:08.625788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025783249999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":3230,"num_read_kb":18134,"num_write":544,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"172'454","reported_seq":3074,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867582+0000","last_change":"2024-09-12T05:23:09.002032+0000","last_active":"2024-09-12T05:23:39.867582+0000","last_peered":"2024-09-12T05:23:39.867582+0000","last_clean":"2024-09-12T05:23:39.867582+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:23:39.867582+0000","last_undegraded":"2024-09-12T05:23:39.867582+0000","last_fullsized":"2024-09-12T05:23:39.867582+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:39.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019782329999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3005,"num_read_kb":39119,"num_write":453,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'408","reported_seq":2186,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107755+0000","last_change":"2024-09-12T05:23:27.159232+0000","last_active":"2024-09-12T05:23:39.107755+0000","last_peered":"2024-09-12T05:23:39.107755+0000","last_clean":"2024-09-12T05:23:39.107755+0000","last_became_active":"2024-09-12T05:23:27.157078+0000","last_became_peered":"2024-09-12T05:23:27.157078+0000","last_unstale":"2024-09-12T05:23:39.107755+0000","last_undegraded":"2024-09-12T05:23:39.107755+0000","last_fullsized":"2024-09-12T05:23:39.107755+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:13.706853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022490409999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2054,"num_read_kb":36836,"num_write":418,"num_write_kb":29183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"172'576","reported_seq":4135,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867878+0000","last_change":"2024-09-12T05:23:09.003554+0000","last_active":"2024-09-12T05:23:39.867878+0000","last_peered":"2024-09-12T05:23:39.867878+0000","last_clean":"2024-09-12T05:23:39.867878+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:23:39.867878+0000","last_undegraded":"2024-09-12T05:23:39.867878+0000","last_fullsized":"2024-09-12T05:23:39.867878+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.365681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034044259999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4425,"num_read_kb":19293,"num_write":516,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":935,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":935,"num_whiteouts":931,"num_read":160719,"num_read_kb":930985,"num_write":23755,"num_write_kb":470520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3298,"num_bytes_recovered":149051681,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24428,"internal_metadata":0},"log_size":21004,"ondisk_log_size":21004,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60472,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311368,"statfs":{"total":96636764160,"available":96574840832,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41828,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330012,"statfs":{"total":96636764160,"available":96593932288,"internally_reserved":0,"allocated":2375680,"data_stored":1158828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77932,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293908,"statfs":{"total":96636764160,"available":96556961792,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271764,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43504,"kb_used_data":2324,"kb_used_omap":27,"kb_used_meta":41124,"kb_avail":94328336,"statfs":{"total":96636764160,"available":96592216064,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":42111799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":178,"seq":764504178694,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35440,"kb_used_data":2332,"kb_used_omap":27,"kb_used_meta":33060,"kb_avail":94336400,"statfs":{"total":96636764160,"available":96600473600,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28194,"internal_metadata":33853918},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41848,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329992,"statfs":{"total":96636764160,"available":96593911808,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1164803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56296,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315544,"statfs":{"total":96636764160,"available":96579117056,"internally_reserved":0,"allocated":2969600,"data_stored":1749196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11950,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:23:44.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:23:44.770 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:44.771 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:23:44.788 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-12T05:23:42.962045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":939,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":939,"num_whiteouts":931,"num_read":160785,"num_read_kb":931040,"num_write":23858,"num_write_kb":472150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3302,"num_bytes_recovered":149051719,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21079,"ondisk_log_size":21079,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":413060,"kb_used_data":19784,"kb_used_omap":64,"kb_used_meta":393023,"kb_avail":754561660,"statfs":{"total":773094113280,"available":772671139840,"internally_reserved":0,"allocated":20258816,"data_stored":10475184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65607,"internal_metadata":402456505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001788"},"pg_stats":[{"pgid":"3.1f","version":"173'486","reported_seq":9172,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108147+0000","last_change":"2024-09-12T05:23:08.894836+0000","last_active":"2024-09-12T05:23:39.108147+0000","last_peered":"2024-09-12T05:23:39.108147+0000","last_clean":"2024-09-12T05:23:39.108147+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:23:39.108147+0000","last_undegraded":"2024-09-12T05:23:39.108147+0000","last_fullsized":"2024-09-12T05:23:39.108147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:46.702174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003248342,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9528,"num_read_kb":33880,"num_write":431,"num_write_kb":7991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"179'378","reported_seq":7803,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207394+0000","last_change":"2024-09-12T05:23:21.451138+0000","last_active":"2024-09-12T05:23:40.207394+0000","last_peered":"2024-09-12T05:23:40.207394+0000","last_clean":"2024-09-12T05:23:40.207394+0000","last_became_active":"2024-09-12T05:23:21.054723+0000","last_became_peered":"2024-09-12T05:23:21.054723+0000","last_unstale":"2024-09-12T05:23:40.207394+0000","last_undegraded":"2024-09-12T05:23:40.207394+0000","last_fullsized":"2024-09-12T05:23:40.207394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:36.202472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.11218479200000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":7029,"num_read_kb":84720,"num_write":386,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'786","reported_seq":4147,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112144+0000","last_change":"2024-09-12T05:23:08.884176+0000","last_active":"2024-09-12T05:23:39.112144+0000","last_peered":"2024-09-12T05:23:39.112144+0000","last_clean":"2024-09-12T05:23:39.112144+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:23:39.112144+0000","last_undegraded":"2024-09-12T05:23:39.112144+0000","last_fullsized":"2024-09-12T05:23:39.112144+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:16.886391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772933,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5372,"num_read_kb":9022,"num_write":882,"num_write_kb":5162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'728","reported_seq":5598,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111345+0000","last_change":"2024-09-12T05:23:08.885454+0000","last_active":"2024-09-12T05:23:39.111345+0000","last_peered":"2024-09-12T05:23:39.111345+0000","last_clean":"2024-09-12T05:23:39.111345+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:23:39.111345+0000","last_undegraded":"2024-09-12T05:23:39.111345+0000","last_fullsized":"2024-09-12T05:23:39.111345+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.227991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002840431,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":6419,"num_read_kb":39592,"num_write":787,"num_write_kb":9586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"172'701","reported_seq":4029,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108032+0000","last_change":"2024-09-12T05:23:08.894170+0000","last_active":"2024-09-12T05:23:39.108032+0000","last_peered":"2024-09-12T05:23:39.108032+0000","last_clean":"2024-09-12T05:23:39.108032+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:23:39.108032+0000","last_undegraded":"2024-09-12T05:23:39.108032+0000","last_fullsized":"2024-09-12T05:23:39.108032+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:09.253291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028723139999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":4932,"num_read_kb":38662,"num_write":725,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'441","reported_seq":6261,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848488+0000","last_change":"2024-09-12T05:23:08.921196+0000","last_active":"2024-09-12T05:23:38.848488+0000","last_peered":"2024-09-12T05:23:38.848488+0000","last_clean":"2024-09-12T05:23:38.848488+0000","last_became_active":"2024-09-12T05:23:05.778317+0000","last_became_peered":"2024-09-12T05:23:05.778317+0000","last_unstale":"2024-09-12T05:23:38.848488+0000","last_undegraded":"2024-09-12T05:23:38.848488+0000","last_fullsized":"2024-09-12T05:23:38.848488+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:31.021021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023560629999999998,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5982,"num_read_kb":31159,"num_write":378,"num_write_kb":18476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":278,"num_bytes_recovered":17309726,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"172'466","reported_seq":4426,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866481+0000","last_change":"2024-09-12T05:23:22.198107+0000","last_active":"2024-09-12T05:23:39.866481+0000","last_peered":"2024-09-12T05:23:39.866481+0000","last_clean":"2024-09-12T05:23:39.866481+0000","last_became_active":"2024-09-12T05:23:22.049233+0000","last_became_peered":"2024-09-12T05:23:22.049233+0000","last_unstale":"2024-09-12T05:23:39.866481+0000","last_undegraded":"2024-09-12T05:23:39.866481+0000","last_fullsized":"2024-09-12T05:23:39.866481+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.090281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015759229999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4026,"num_read_kb":33452,"num_write":410,"num_write_kb":5078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":1855629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"179'656","reported_seq":3405,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207255+0000","last_change":"2024-09-12T05:23:21.371061+0000","last_active":"2024-09-12T05:23:40.207255+0000","last_peered":"2024-09-12T05:23:40.207255+0000","last_clean":"2024-09-12T05:23:40.207255+0000","last_became_active":"2024-09-12T05:23:21.054412+0000","last_became_peered":"2024-09-12T05:23:21.054412+0000","last_unstale":"2024-09-12T05:23:40.207255+0000","last_undegraded":"2024-09-12T05:23:40.207255+0000","last_fullsized":"2024-09-12T05:23:40.207255+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:27.068859+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.10278277800000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4940,"num_read_kb":22589,"num_write":590,"num_write_kb":11883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"173'686","reported_seq":2504,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108153+0000","last_change":"2024-09-12T05:23:08.896248+0000","last_active":"2024-09-12T05:23:39.108153+0000","last_peered":"2024-09-12T05:23:39.108153+0000","last_clean":"2024-09-12T05:23:39.108153+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:23:39.108153+0000","last_undegraded":"2024-09-12T05:23:39.108153+0000","last_fullsized":"2024-09-12T05:23:39.108153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:58.298697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042327889999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3367,"num_read_kb":15041,"num_write":820,"num_write_kb":7486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"165'549","reported_seq":6342,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112821+0000","last_change":"2024-09-12T05:23:08.884563+0000","last_active":"2024-09-12T05:23:39.112821+0000","last_peered":"2024-09-12T05:23:39.112821+0000","last_clean":"2024-09-12T05:23:39.112821+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:23:39.112821+0000","last_undegraded":"2024-09-12T05:23:39.112821+0000","last_fullsized":"2024-09-12T05:23:39.112821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:42.147876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00202206,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":6274,"num_read_kb":69645,"num_write":520,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'418","reported_seq":2533,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867909+0000","last_change":"2024-09-12T05:23:24.071340+0000","last_active":"2024-09-12T05:23:39.867909+0000","last_peered":"2024-09-12T05:23:39.867909+0000","last_clean":"2024-09-12T05:23:39.867909+0000","last_became_active":"2024-09-12T05:23:24.069263+0000","last_became_peered":"2024-09-12T05:23:24.069263+0000","last_unstale":"2024-09-12T05:23:39.867909+0000","last_undegraded":"2024-09-12T05:23:39.867909+0000","last_fullsized":"2024-09-12T05:23:39.867909+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:24.354148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041559700000000002,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":1771,"num_read_kb":12775,"num_write":434,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"173'1271","reported_seq":5562,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848790+0000","last_change":"2024-09-12T05:23:08.921139+0000","last_active":"2024-09-12T05:23:38.848790+0000","last_peered":"2024-09-12T05:23:38.848790+0000","last_clean":"2024-09-12T05:23:38.848790+0000","last_became_active":"2024-09-12T05:22:14.756246+0000","last_became_peered":"2024-09-12T05:22:14.756246+0000","last_unstale":"2024-09-12T05:23:38.848790+0000","last_undegraded":"2024-09-12T05:23:38.848790+0000","last_fullsized":"2024-09-12T05:23:38.848790+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:02.371995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001595127,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":8879,"num_read_kb":39076,"num_write":1824,"num_write_kb":25359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":17251748,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":317,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111101+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:23:39.111101+0000","last_peered":"2024-09-12T05:23:39.111101+0000","last_clean":"2024-09-12T05:23:39.111101+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:23:39.111101+0000","last_undegraded":"2024-09-12T05:23:39.111101+0000","last_fullsized":"2024-09-12T05:23:39.111101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"173'802","reported_seq":3301,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107905+0000","last_change":"2024-09-12T05:23:08.896149+0000","last_active":"2024-09-12T05:23:39.107905+0000","last_peered":"2024-09-12T05:23:39.107905+0000","last_clean":"2024-09-12T05:23:39.107905+0000","last_became_active":"2024-09-12T05:23:06.775134+0000","last_became_peered":"2024-09-12T05:23:06.775134+0000","last_unstale":"2024-09-12T05:23:39.107905+0000","last_undegraded":"2024-09-12T05:23:39.107905+0000","last_fullsized":"2024-09-12T05:23:39.107905+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:00.057042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042806040000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":2732,"num_read_kb":14112,"num_write":849,"num_write_kb":22030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":524386,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866541+0000","last_change":"2024-09-12T05:23:02.831403+0000","last_active":"2024-09-12T05:23:39.866541+0000","last_peered":"2024-09-12T05:23:39.866541+0000","last_clean":"2024-09-12T05:23:39.866541+0000","last_became_active":"2024-09-12T05:23:02.830555+0000","last_became_peered":"2024-09-12T05:23:02.830555+0000","last_unstale":"2024-09-12T05:23:39.866541+0000","last_undegraded":"2024-09-12T05:23:39.866541+0000","last_fullsized":"2024-09-12T05:23:39.866541+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:08.335748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"179'435","reported_seq":3445,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207585+0000","last_change":"2024-09-12T05:23:21.287558+0000","last_active":"2024-09-12T05:23:40.207585+0000","last_peered":"2024-09-12T05:23:40.207585+0000","last_clean":"2024-09-12T05:23:40.207585+0000","last_became_active":"2024-09-12T05:23:21.051627+0000","last_became_peered":"2024-09-12T05:23:21.051627+0000","last_unstale":"2024-09-12T05:23:40.207585+0000","last_undegraded":"2024-09-12T05:23:40.207585+0000","last_fullsized":"2024-09-12T05:23:40.207585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:44.975331+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.114526524,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2848,"num_read_kb":54239,"num_write":458,"num_write_kb":24596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":368,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868205+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:23:39.868205+0000","last_peered":"2024-09-12T05:23:39.868205+0000","last_clean":"2024-09-12T05:23:39.868205+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:23:39.868205+0000","last_undegraded":"2024-09-12T05:23:39.868205+0000","last_fullsized":"2024-09-12T05:23:39.868205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"172'752","reported_seq":4313,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866631+0000","last_change":"2024-09-12T05:23:08.885502+0000","last_active":"2024-09-12T05:23:39.866631+0000","last_peered":"2024-09-12T05:23:39.866631+0000","last_clean":"2024-09-12T05:23:39.866631+0000","last_became_active":"2024-09-12T05:23:06.773505+0000","last_became_peered":"2024-09-12T05:23:06.773505+0000","last_unstale":"2024-09-12T05:23:39.866631+0000","last_undegraded":"2024-09-12T05:23:39.866631+0000","last_fullsized":"2024-09-12T05:23:39.866631+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:15.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024700099999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5270,"num_read_kb":22820,"num_write":798,"num_write_kb":28293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":474,"num_bytes_recovered":12649810,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866460+0000","last_change":"2024-09-12T05:23:02.830895+0000","last_active":"2024-09-12T05:23:39.866460+0000","last_peered":"2024-09-12T05:23:39.866460+0000","last_clean":"2024-09-12T05:23:39.866460+0000","last_became_active":"2024-09-12T05:23:02.829933+0000","last_became_peered":"2024-09-12T05:23:02.829933+0000","last_unstale":"2024-09-12T05:23:39.866460+0000","last_undegraded":"2024-09-12T05:23:39.866460+0000","last_fullsized":"2024-09-12T05:23:39.866460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.164044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"179'485","reported_seq":2864,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112442+0000","last_change":"2024-09-12T05:23:21.221659+0000","last_active":"2024-09-12T05:23:39.112442+0000","last_peered":"2024-09-12T05:23:39.112442+0000","last_clean":"2024-09-12T05:23:39.112442+0000","last_became_active":"2024-09-12T05:23:21.069868+0000","last_became_peered":"2024-09-12T05:23:21.069868+0000","last_unstale":"2024-09-12T05:23:39.112442+0000","last_undegraded":"2024-09-12T05:23:39.112442+0000","last_fullsized":"2024-09-12T05:23:39.112442+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:29.218757+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.078824042999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2610,"num_read_kb":20437,"num_write":595,"num_write_kb":10557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"173'729","reported_seq":5225,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:38.848718+0000","last_change":"2024-09-12T05:23:08.920199+0000","last_active":"2024-09-12T05:23:38.848718+0000","last_peered":"2024-09-12T05:23:38.848718+0000","last_clean":"2024-09-12T05:23:38.848718+0000","last_became_active":"2024-09-12T05:22:14.219295+0000","last_became_peered":"2024-09-12T05:22:14.219295+0000","last_unstale":"2024-09-12T05:23:38.848718+0000","last_undegraded":"2024-09-12T05:23:38.848718+0000","last_fullsized":"2024-09-12T05:23:38.848718+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:08.649145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001330901,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":5192,"num_read_kb":18719,"num_write":679,"num_write_kb":26356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":391,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:23:02.838440+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:23:02.830933+0000","last_became_peered":"2024-09-12T05:23:02.830933+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:59.974404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"172'1022","reported_seq":10699,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866410+0000","last_change":"2024-09-12T05:23:08.884903+0000","last_active":"2024-09-12T05:23:39.866410+0000","last_peered":"2024-09-12T05:23:39.866410+0000","last_clean":"2024-09-12T05:23:39.866410+0000","last_became_active":"2024-09-12T05:23:06.773339+0000","last_became_peered":"2024-09-12T05:23:06.773339+0000","last_unstale":"2024-09-12T05:23:39.866410+0000","last_undegraded":"2024-09-12T05:23:39.866410+0000","last_fullsized":"2024-09-12T05:23:39.866410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1022,"log_dups_size":0,"ondisk_log_size":1022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.213297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002206193,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":11896,"num_read_kb":54588,"num_write":1368,"num_write_kb":21769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":13965694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.864991+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:23:39.864991+0000","last_peered":"2024-09-12T05:23:39.864991+0000","last_clean":"2024-09-12T05:23:39.864991+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:23:39.864991+0000","last_undegraded":"2024-09-12T05:23:39.864991+0000","last_fullsized":"2024-09-12T05:23:39.864991+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'610","reported_seq":2588,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108052+0000","last_change":"2024-09-12T05:23:08.892844+0000","last_active":"2024-09-12T05:23:39.108052+0000","last_peered":"2024-09-12T05:23:39.108052+0000","last_clean":"2024-09-12T05:23:39.108052+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:23:39.108052+0000","last_undegraded":"2024-09-12T05:23:39.108052+0000","last_fullsized":"2024-09-12T05:23:39.108052+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:18.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015778210000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":2646,"num_read_kb":16084,"num_write":734,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":380,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867778+0000","last_change":"2024-09-12T05:23:02.827747+0000","last_active":"2024-09-12T05:23:39.867778+0000","last_peered":"2024-09-12T05:23:39.867778+0000","last_clean":"2024-09-12T05:23:39.867778+0000","last_became_active":"2024-09-12T05:23:02.826853+0000","last_became_peered":"2024-09-12T05:23:02.826853+0000","last_unstale":"2024-09-12T05:23:39.867778+0000","last_undegraded":"2024-09-12T05:23:39.867778+0000","last_fullsized":"2024-09-12T05:23:39.867778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:35.923974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"179'516","reported_seq":3644,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207359+0000","last_change":"2024-09-12T05:23:21.556051+0000","last_active":"2024-09-12T05:23:40.207359+0000","last_peered":"2024-09-12T05:23:40.207359+0000","last_clean":"2024-09-12T05:23:40.207359+0000","last_became_active":"2024-09-12T05:23:21.060573+0000","last_became_peered":"2024-09-12T05:23:21.060573+0000","last_unstale":"2024-09-12T05:23:40.207359+0000","last_undegraded":"2024-09-12T05:23:40.207359+0000","last_fullsized":"2024-09-12T05:23:40.207359+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:56.367076+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.13014315100000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3396,"num_read_kb":46312,"num_write":573,"num_write_kb":32831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":390,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":460,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867568+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:23:39.867568+0000","last_peered":"2024-09-12T05:23:39.867568+0000","last_clean":"2024-09-12T05:23:39.867568+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:23:39.867568+0000","last_undegraded":"2024-09-12T05:23:39.867568+0000","last_fullsized":"2024-09-12T05:23:39.867568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"172'719","reported_seq":5307,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207106+0000","last_change":"2024-09-12T05:23:24.067998+0000","last_active":"2024-09-12T05:23:40.207106+0000","last_peered":"2024-09-12T05:23:40.207106+0000","last_clean":"2024-09-12T05:23:40.207106+0000","last_became_active":"2024-09-12T05:23:24.066068+0000","last_became_peered":"2024-09-12T05:23:24.066068+0000","last_unstale":"2024-09-12T05:23:40.207106+0000","last_undegraded":"2024-09-12T05:23:40.207106+0000","last_fullsized":"2024-09-12T05:23:40.207106+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:53.720206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021121,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7224,"num_read_kb":35602,"num_write":683,"num_write_kb":24689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":22193143,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"173'568","reported_seq":2739,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107780+0000","last_change":"2024-09-12T05:23:08.892915+0000","last_active":"2024-09-12T05:23:39.107780+0000","last_peered":"2024-09-12T05:23:39.107780+0000","last_clean":"2024-09-12T05:23:39.107780+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:23:39.107780+0000","last_undegraded":"2024-09-12T05:23:39.107780+0000","last_fullsized":"2024-09-12T05:23:39.107780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:36.311832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002006543,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":2948,"num_read_kb":4414,"num_write":610,"num_write_kb":2188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"172'904","reported_seq":3485,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110717+0000","last_change":"2024-09-12T05:23:09.006738+0000","last_active":"2024-09-12T05:23:39.110717+0000","last_peered":"2024-09-12T05:23:39.110717+0000","last_clean":"2024-09-12T05:23:39.110717+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:23:39.110717+0000","last_undegraded":"2024-09-12T05:23:39.110717+0000","last_fullsized":"2024-09-12T05:23:39.110717+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:24.153867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037362760000000002,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":5009,"num_read_kb":21353,"num_write":1061,"num_write_kb":9448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"166'486","reported_seq":5111,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110776+0000","last_change":"2024-09-12T05:23:09.007825+0000","last_active":"2024-09-12T05:23:39.110776+0000","last_peered":"2024-09-12T05:23:39.110776+0000","last_clean":"2024-09-12T05:23:39.110776+0000","last_became_active":"2024-09-12T05:22:23.848062+0000","last_became_peered":"2024-09-12T05:22:23.848062+0000","last_unstale":"2024-09-12T05:23:39.110776+0000","last_undegraded":"2024-09-12T05:23:39.110776+0000","last_fullsized":"2024-09-12T05:23:39.110776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:15.695305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045086240000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5071,"num_read_kb":16406,"num_write":417,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":6526540,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"179'1802","reported_seq":4650,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111610+0000","last_change":"2024-09-12T05:23:21.320885+0000","last_active":"2024-09-12T05:23:39.111610+0000","last_peered":"2024-09-12T05:23:39.111610+0000","last_clean":"2024-09-12T05:23:39.111610+0000","last_became_active":"2024-09-12T05:23:21.071081+0000","last_became_peered":"2024-09-12T05:23:21.071081+0000","last_unstale":"2024-09-12T05:23:39.111610+0000","last_undegraded":"2024-09-12T05:23:39.111610+0000","last_fullsized":"2024-09-12T05:23:39.111610+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.752691+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.074865914000000006,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":10272,"num_read_kb":16192,"num_write":3031,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"172'764","reported_seq":6213,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868057+0000","last_change":"2024-09-12T05:23:09.006532+0000","last_active":"2024-09-12T05:23:39.868057+0000","last_peered":"2024-09-12T05:23:39.868057+0000","last_clean":"2024-09-12T05:23:39.868057+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:23:39.868057+0000","last_undegraded":"2024-09-12T05:23:39.868057+0000","last_fullsized":"2024-09-12T05:23:39.868057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:19.123843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052823210000000004,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7010,"num_read_kb":29483,"num_write":891,"num_write_kb":11124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"172'527","reported_seq":2206,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868215+0000","last_change":"2024-09-12T05:23:09.007104+0000","last_active":"2024-09-12T05:23:39.868215+0000","last_peered":"2024-09-12T05:23:39.868215+0000","last_clean":"2024-09-12T05:23:39.868215+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:23:39.868215+0000","last_undegraded":"2024-09-12T05:23:39.868215+0000","last_fullsized":"2024-09-12T05:23:39.868215+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.855353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053945199999999999,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":2302,"num_read_kb":6600,"num_write":563,"num_write_kb":4788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"165'378","reported_seq":3931,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868228+0000","last_change":"2024-09-12T05:23:09.008317+0000","last_active":"2024-09-12T05:23:39.868228+0000","last_peered":"2024-09-12T05:23:39.868228+0000","last_clean":"2024-09-12T05:23:39.868228+0000","last_became_active":"2024-09-12T05:22:54.769137+0000","last_became_peered":"2024-09-12T05:22:54.769137+0000","last_unstale":"2024-09-12T05:23:39.868228+0000","last_undegraded":"2024-09-12T05:23:39.868228+0000","last_fullsized":"2024-09-12T05:23:39.868228+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:48.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062235559999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3060,"num_read_kb":10629,"num_write":327,"num_write_kb":8973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":227,"num_bytes_recovered":1802832,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"166'501","reported_seq":3371,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110697+0000","last_change":"2024-09-12T05:23:09.005232+0000","last_active":"2024-09-12T05:23:39.110697+0000","last_peered":"2024-09-12T05:23:39.110697+0000","last_clean":"2024-09-12T05:23:39.110697+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:23:39.110697+0000","last_undegraded":"2024-09-12T05:23:39.110697+0000","last_fullsized":"2024-09-12T05:23:39.110697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:08.625788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025783249999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":3230,"num_read_kb":18134,"num_write":544,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"172'454","reported_seq":3074,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867582+0000","last_change":"2024-09-12T05:23:09.002032+0000","last_active":"2024-09-12T05:23:39.867582+0000","last_peered":"2024-09-12T05:23:39.867582+0000","last_clean":"2024-09-12T05:23:39.867582+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:23:39.867582+0000","last_undegraded":"2024-09-12T05:23:39.867582+0000","last_fullsized":"2024-09-12T05:23:39.867582+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:39.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019782329999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3005,"num_read_kb":39119,"num_write":453,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'408","reported_seq":2186,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107755+0000","last_change":"2024-09-12T05:23:27.159232+0000","last_active":"2024-09-12T05:23:39.107755+0000","last_peered":"2024-09-12T05:23:39.107755+0000","last_clean":"2024-09-12T05:23:39.107755+0000","last_became_active":"2024-09-12T05:23:27.157078+0000","last_became_peered":"2024-09-12T05:23:27.157078+0000","last_unstale":"2024-09-12T05:23:39.107755+0000","last_undegraded":"2024-09-12T05:23:39.107755+0000","last_fullsized":"2024-09-12T05:23:39.107755+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:13.706853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022490409999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2054,"num_read_kb":36836,"num_write":418,"num_write_kb":29183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"172'576","reported_seq":4135,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867878+0000","last_change":"2024-09-12T05:23:09.003554+0000","last_active":"2024-09-12T05:23:39.867878+0000","last_peered":"2024-09-12T05:23:39.867878+0000","last_clean":"2024-09-12T05:23:39.867878+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:23:39.867878+0000","last_undegraded":"2024-09-12T05:23:39.867878+0000","last_fullsized":"2024-09-12T05:23:39.867878+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.365681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034044259999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4425,"num_read_kb":19293,"num_write":516,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":935,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":935,"num_whiteouts":931,"num_read":160719,"num_read_kb":930985,"num_write":23755,"num_write_kb":470520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3298,"num_bytes_recovered":149051681,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24428,"internal_metadata":0},"log_size":21004,"ondisk_log_size":21004,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60472,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311368,"statfs":{"total":96636764160,"available":96574840832,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41828,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330012,"statfs":{"total":96636764160,"available":96593932288,"internally_reserved":0,"allocated":2375680,"data_stored":1158828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77932,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293908,"statfs":{"total":96636764160,"available":96556961792,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271764,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43504,"kb_used_data":2324,"kb_used_omap":27,"kb_used_meta":41124,"kb_avail":94328336,"statfs":{"total":96636764160,"available":96592216064,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":42111799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":178,"seq":764504178694,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35440,"kb_used_data":2332,"kb_used_omap":27,"kb_used_meta":33060,"kb_avail":94336400,"statfs":{"total":96636764160,"available":96600473600,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28194,"internal_metadata":33853918},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41848,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329992,"statfs":{"total":96636764160,"available":96593911808,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1164803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56296,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315544,"statfs":{"total":96636764160,"available":96579117056,"internally_reserved":0,"allocated":2969600,"data_stored":1749196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11950,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:23:44.790 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T05:23:44.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:23:45.092 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:23:45.110 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-12T05:23:44.962687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":939,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":939,"num_whiteouts":931,"num_read":160785,"num_read_kb":931040,"num_write":23858,"num_write_kb":472150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3302,"num_bytes_recovered":149051719,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21079,"ondisk_log_size":21079,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":413064,"kb_used_data":19796,"kb_used_omap":64,"kb_used_meta":393023,"kb_avail":754561656,"statfs":{"total":773094113280,"available":772671135744,"internally_reserved":0,"allocated":20271104,"data_stored":10481121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65607,"internal_metadata":402456505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.129260"},"pg_stats":[{"pgid":"3.1f","version":"173'486","reported_seq":9172,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108147+0000","last_change":"2024-09-12T05:23:08.894836+0000","last_active":"2024-09-12T05:23:39.108147+0000","last_peered":"2024-09-12T05:23:39.108147+0000","last_clean":"2024-09-12T05:23:39.108147+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:23:39.108147+0000","last_undegraded":"2024-09-12T05:23:39.108147+0000","last_fullsized":"2024-09-12T05:23:39.108147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:46.702174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003248342,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9528,"num_read_kb":33880,"num_write":431,"num_write_kb":7991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"179'378","reported_seq":7803,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207394+0000","last_change":"2024-09-12T05:23:21.451138+0000","last_active":"2024-09-12T05:23:40.207394+0000","last_peered":"2024-09-12T05:23:40.207394+0000","last_clean":"2024-09-12T05:23:40.207394+0000","last_became_active":"2024-09-12T05:23:21.054723+0000","last_became_peered":"2024-09-12T05:23:21.054723+0000","last_unstale":"2024-09-12T05:23:40.207394+0000","last_undegraded":"2024-09-12T05:23:40.207394+0000","last_fullsized":"2024-09-12T05:23:40.207394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:36.202472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.11218479200000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":7029,"num_read_kb":84720,"num_write":386,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'786","reported_seq":4147,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112144+0000","last_change":"2024-09-12T05:23:08.884176+0000","last_active":"2024-09-12T05:23:39.112144+0000","last_peered":"2024-09-12T05:23:39.112144+0000","last_clean":"2024-09-12T05:23:39.112144+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:23:39.112144+0000","last_undegraded":"2024-09-12T05:23:39.112144+0000","last_fullsized":"2024-09-12T05:23:39.112144+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:16.886391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772933,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5372,"num_read_kb":9022,"num_write":882,"num_write_kb":5162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'728","reported_seq":5598,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111345+0000","last_change":"2024-09-12T05:23:08.885454+0000","last_active":"2024-09-12T05:23:39.111345+0000","last_peered":"2024-09-12T05:23:39.111345+0000","last_clean":"2024-09-12T05:23:39.111345+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:23:39.111345+0000","last_undegraded":"2024-09-12T05:23:39.111345+0000","last_fullsized":"2024-09-12T05:23:39.111345+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.227991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002840431,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":6419,"num_read_kb":39592,"num_write":787,"num_write_kb":9586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"172'701","reported_seq":4029,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108032+0000","last_change":"2024-09-12T05:23:08.894170+0000","last_active":"2024-09-12T05:23:39.108032+0000","last_peered":"2024-09-12T05:23:39.108032+0000","last_clean":"2024-09-12T05:23:39.108032+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:23:39.108032+0000","last_undegraded":"2024-09-12T05:23:39.108032+0000","last_fullsized":"2024-09-12T05:23:39.108032+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:09.253291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028723139999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":4932,"num_read_kb":38662,"num_write":725,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'441","reported_seq":6263,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.839719+0000","last_change":"2024-09-12T05:23:08.921196+0000","last_active":"2024-09-12T05:23:40.839719+0000","last_peered":"2024-09-12T05:23:40.839719+0000","last_clean":"2024-09-12T05:23:40.839719+0000","last_became_active":"2024-09-12T05:23:05.778317+0000","last_became_peered":"2024-09-12T05:23:05.778317+0000","last_unstale":"2024-09-12T05:23:40.839719+0000","last_undegraded":"2024-09-12T05:23:40.839719+0000","last_fullsized":"2024-09-12T05:23:40.839719+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:31.021021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023560629999999998,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5982,"num_read_kb":31159,"num_write":378,"num_write_kb":18476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":278,"num_bytes_recovered":17309726,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"172'466","reported_seq":4426,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866481+0000","last_change":"2024-09-12T05:23:22.198107+0000","last_active":"2024-09-12T05:23:39.866481+0000","last_peered":"2024-09-12T05:23:39.866481+0000","last_clean":"2024-09-12T05:23:39.866481+0000","last_became_active":"2024-09-12T05:23:22.049233+0000","last_became_peered":"2024-09-12T05:23:22.049233+0000","last_unstale":"2024-09-12T05:23:39.866481+0000","last_undegraded":"2024-09-12T05:23:39.866481+0000","last_fullsized":"2024-09-12T05:23:39.866481+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.090281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015759229999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4026,"num_read_kb":33452,"num_write":410,"num_write_kb":5078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":1855629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"179'656","reported_seq":3405,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207255+0000","last_change":"2024-09-12T05:23:21.371061+0000","last_active":"2024-09-12T05:23:40.207255+0000","last_peered":"2024-09-12T05:23:40.207255+0000","last_clean":"2024-09-12T05:23:40.207255+0000","last_became_active":"2024-09-12T05:23:21.054412+0000","last_became_peered":"2024-09-12T05:23:21.054412+0000","last_unstale":"2024-09-12T05:23:40.207255+0000","last_undegraded":"2024-09-12T05:23:40.207255+0000","last_fullsized":"2024-09-12T05:23:40.207255+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:27.068859+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.10278277800000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4940,"num_read_kb":22589,"num_write":590,"num_write_kb":11883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"173'686","reported_seq":2504,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108153+0000","last_change":"2024-09-12T05:23:08.896248+0000","last_active":"2024-09-12T05:23:39.108153+0000","last_peered":"2024-09-12T05:23:39.108153+0000","last_clean":"2024-09-12T05:23:39.108153+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:23:39.108153+0000","last_undegraded":"2024-09-12T05:23:39.108153+0000","last_fullsized":"2024-09-12T05:23:39.108153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:58.298697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042327889999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3367,"num_read_kb":15041,"num_write":820,"num_write_kb":7486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"165'549","reported_seq":6342,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112821+0000","last_change":"2024-09-12T05:23:08.884563+0000","last_active":"2024-09-12T05:23:39.112821+0000","last_peered":"2024-09-12T05:23:39.112821+0000","last_clean":"2024-09-12T05:23:39.112821+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:23:39.112821+0000","last_undegraded":"2024-09-12T05:23:39.112821+0000","last_fullsized":"2024-09-12T05:23:39.112821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:42.147876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00202206,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":6274,"num_read_kb":69645,"num_write":520,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'418","reported_seq":2533,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867909+0000","last_change":"2024-09-12T05:23:24.071340+0000","last_active":"2024-09-12T05:23:39.867909+0000","last_peered":"2024-09-12T05:23:39.867909+0000","last_clean":"2024-09-12T05:23:39.867909+0000","last_became_active":"2024-09-12T05:23:24.069263+0000","last_became_peered":"2024-09-12T05:23:24.069263+0000","last_unstale":"2024-09-12T05:23:39.867909+0000","last_undegraded":"2024-09-12T05:23:39.867909+0000","last_fullsized":"2024-09-12T05:23:39.867909+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:24.354148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041559700000000002,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":1771,"num_read_kb":12775,"num_write":434,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"173'1271","reported_seq":5564,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.839929+0000","last_change":"2024-09-12T05:23:08.921139+0000","last_active":"2024-09-12T05:23:40.839929+0000","last_peered":"2024-09-12T05:23:40.839929+0000","last_clean":"2024-09-12T05:23:40.839929+0000","last_became_active":"2024-09-12T05:22:14.756246+0000","last_became_peered":"2024-09-12T05:22:14.756246+0000","last_unstale":"2024-09-12T05:23:40.839929+0000","last_undegraded":"2024-09-12T05:23:40.839929+0000","last_fullsized":"2024-09-12T05:23:40.839929+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:02.371995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001595127,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":8879,"num_read_kb":39076,"num_write":1824,"num_write_kb":25359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":17251748,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":317,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111101+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:23:39.111101+0000","last_peered":"2024-09-12T05:23:39.111101+0000","last_clean":"2024-09-12T05:23:39.111101+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:23:39.111101+0000","last_undegraded":"2024-09-12T05:23:39.111101+0000","last_fullsized":"2024-09-12T05:23:39.111101+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"173'802","reported_seq":3301,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107905+0000","last_change":"2024-09-12T05:23:08.896149+0000","last_active":"2024-09-12T05:23:39.107905+0000","last_peered":"2024-09-12T05:23:39.107905+0000","last_clean":"2024-09-12T05:23:39.107905+0000","last_became_active":"2024-09-12T05:23:06.775134+0000","last_became_peered":"2024-09-12T05:23:06.775134+0000","last_unstale":"2024-09-12T05:23:39.107905+0000","last_undegraded":"2024-09-12T05:23:39.107905+0000","last_fullsized":"2024-09-12T05:23:39.107905+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:00.057042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042806040000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":2732,"num_read_kb":14112,"num_write":849,"num_write_kb":22030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":524386,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866541+0000","last_change":"2024-09-12T05:23:02.831403+0000","last_active":"2024-09-12T05:23:39.866541+0000","last_peered":"2024-09-12T05:23:39.866541+0000","last_clean":"2024-09-12T05:23:39.866541+0000","last_became_active":"2024-09-12T05:23:02.830555+0000","last_became_peered":"2024-09-12T05:23:02.830555+0000","last_unstale":"2024-09-12T05:23:39.866541+0000","last_undegraded":"2024-09-12T05:23:39.866541+0000","last_fullsized":"2024-09-12T05:23:39.866541+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:08.335748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"179'435","reported_seq":3445,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207585+0000","last_change":"2024-09-12T05:23:21.287558+0000","last_active":"2024-09-12T05:23:40.207585+0000","last_peered":"2024-09-12T05:23:40.207585+0000","last_clean":"2024-09-12T05:23:40.207585+0000","last_became_active":"2024-09-12T05:23:21.051627+0000","last_became_peered":"2024-09-12T05:23:21.051627+0000","last_unstale":"2024-09-12T05:23:40.207585+0000","last_undegraded":"2024-09-12T05:23:40.207585+0000","last_fullsized":"2024-09-12T05:23:40.207585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:44.975331+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.114526524,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2848,"num_read_kb":54239,"num_write":458,"num_write_kb":24596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":368,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868205+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:23:39.868205+0000","last_peered":"2024-09-12T05:23:39.868205+0000","last_clean":"2024-09-12T05:23:39.868205+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:23:39.868205+0000","last_undegraded":"2024-09-12T05:23:39.868205+0000","last_fullsized":"2024-09-12T05:23:39.868205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"172'752","reported_seq":4313,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866631+0000","last_change":"2024-09-12T05:23:08.885502+0000","last_active":"2024-09-12T05:23:39.866631+0000","last_peered":"2024-09-12T05:23:39.866631+0000","last_clean":"2024-09-12T05:23:39.866631+0000","last_became_active":"2024-09-12T05:23:06.773505+0000","last_became_peered":"2024-09-12T05:23:06.773505+0000","last_unstale":"2024-09-12T05:23:39.866631+0000","last_undegraded":"2024-09-12T05:23:39.866631+0000","last_fullsized":"2024-09-12T05:23:39.866631+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:15.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024700099999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5270,"num_read_kb":22820,"num_write":798,"num_write_kb":28293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":474,"num_bytes_recovered":12649810,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866460+0000","last_change":"2024-09-12T05:23:02.830895+0000","last_active":"2024-09-12T05:23:39.866460+0000","last_peered":"2024-09-12T05:23:39.866460+0000","last_clean":"2024-09-12T05:23:39.866460+0000","last_became_active":"2024-09-12T05:23:02.829933+0000","last_became_peered":"2024-09-12T05:23:02.829933+0000","last_unstale":"2024-09-12T05:23:39.866460+0000","last_undegraded":"2024-09-12T05:23:39.866460+0000","last_fullsized":"2024-09-12T05:23:39.866460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.164044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"179'485","reported_seq":2864,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.112442+0000","last_change":"2024-09-12T05:23:21.221659+0000","last_active":"2024-09-12T05:23:39.112442+0000","last_peered":"2024-09-12T05:23:39.112442+0000","last_clean":"2024-09-12T05:23:39.112442+0000","last_became_active":"2024-09-12T05:23:21.069868+0000","last_became_peered":"2024-09-12T05:23:21.069868+0000","last_unstale":"2024-09-12T05:23:39.112442+0000","last_undegraded":"2024-09-12T05:23:39.112442+0000","last_fullsized":"2024-09-12T05:23:39.112442+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:29.218757+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.078824042999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2610,"num_read_kb":20437,"num_write":595,"num_write_kb":10557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"173'729","reported_seq":5227,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.839926+0000","last_change":"2024-09-12T05:23:08.920199+0000","last_active":"2024-09-12T05:23:40.839926+0000","last_peered":"2024-09-12T05:23:40.839926+0000","last_clean":"2024-09-12T05:23:40.839926+0000","last_became_active":"2024-09-12T05:22:14.219295+0000","last_became_peered":"2024-09-12T05:22:14.219295+0000","last_unstale":"2024-09-12T05:23:40.839926+0000","last_undegraded":"2024-09-12T05:23:40.839926+0000","last_fullsized":"2024-09-12T05:23:40.839926+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:08.649145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001330901,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":5192,"num_read_kb":18719,"num_write":679,"num_write_kb":26356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":391,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:23:02.838440+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:23:02.830933+0000","last_became_peered":"2024-09-12T05:23:02.830933+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:59.974404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"172'1022","reported_seq":10699,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866410+0000","last_change":"2024-09-12T05:23:08.884903+0000","last_active":"2024-09-12T05:23:39.866410+0000","last_peered":"2024-09-12T05:23:39.866410+0000","last_clean":"2024-09-12T05:23:39.866410+0000","last_became_active":"2024-09-12T05:23:06.773339+0000","last_became_peered":"2024-09-12T05:23:06.773339+0000","last_unstale":"2024-09-12T05:23:39.866410+0000","last_undegraded":"2024-09-12T05:23:39.866410+0000","last_fullsized":"2024-09-12T05:23:39.866410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1022,"log_dups_size":0,"ondisk_log_size":1022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.213297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002206193,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":11896,"num_read_kb":54588,"num_write":1368,"num_write_kb":21769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":13965694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.864991+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:23:39.864991+0000","last_peered":"2024-09-12T05:23:39.864991+0000","last_clean":"2024-09-12T05:23:39.864991+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:23:39.864991+0000","last_undegraded":"2024-09-12T05:23:39.864991+0000","last_fullsized":"2024-09-12T05:23:39.864991+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'610","reported_seq":2588,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.108052+0000","last_change":"2024-09-12T05:23:08.892844+0000","last_active":"2024-09-12T05:23:39.108052+0000","last_peered":"2024-09-12T05:23:39.108052+0000","last_clean":"2024-09-12T05:23:39.108052+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:23:39.108052+0000","last_undegraded":"2024-09-12T05:23:39.108052+0000","last_fullsized":"2024-09-12T05:23:39.108052+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:18.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015778210000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":2646,"num_read_kb":16084,"num_write":734,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":380,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867778+0000","last_change":"2024-09-12T05:23:02.827747+0000","last_active":"2024-09-12T05:23:39.867778+0000","last_peered":"2024-09-12T05:23:39.867778+0000","last_clean":"2024-09-12T05:23:39.867778+0000","last_became_active":"2024-09-12T05:23:02.826853+0000","last_became_peered":"2024-09-12T05:23:02.826853+0000","last_unstale":"2024-09-12T05:23:39.867778+0000","last_undegraded":"2024-09-12T05:23:39.867778+0000","last_fullsized":"2024-09-12T05:23:39.867778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:35.923974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"179'516","reported_seq":3644,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207359+0000","last_change":"2024-09-12T05:23:21.556051+0000","last_active":"2024-09-12T05:23:40.207359+0000","last_peered":"2024-09-12T05:23:40.207359+0000","last_clean":"2024-09-12T05:23:40.207359+0000","last_became_active":"2024-09-12T05:23:21.060573+0000","last_became_peered":"2024-09-12T05:23:21.060573+0000","last_unstale":"2024-09-12T05:23:40.207359+0000","last_undegraded":"2024-09-12T05:23:40.207359+0000","last_fullsized":"2024-09-12T05:23:40.207359+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:56.367076+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.13014315100000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3396,"num_read_kb":46312,"num_write":573,"num_write_kb":32831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":390,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110997+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:23:39.110997+0000","last_peered":"2024-09-12T05:23:39.110997+0000","last_clean":"2024-09-12T05:23:39.110997+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:23:39.110997+0000","last_undegraded":"2024-09-12T05:23:39.110997+0000","last_fullsized":"2024-09-12T05:23:39.110997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":460,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867568+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:23:39.867568+0000","last_peered":"2024-09-12T05:23:39.867568+0000","last_clean":"2024-09-12T05:23:39.867568+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:23:39.867568+0000","last_undegraded":"2024-09-12T05:23:39.867568+0000","last_fullsized":"2024-09-12T05:23:39.867568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"172'719","reported_seq":5307,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207106+0000","last_change":"2024-09-12T05:23:24.067998+0000","last_active":"2024-09-12T05:23:40.207106+0000","last_peered":"2024-09-12T05:23:40.207106+0000","last_clean":"2024-09-12T05:23:40.207106+0000","last_became_active":"2024-09-12T05:23:24.066068+0000","last_became_peered":"2024-09-12T05:23:24.066068+0000","last_unstale":"2024-09-12T05:23:40.207106+0000","last_undegraded":"2024-09-12T05:23:40.207106+0000","last_fullsized":"2024-09-12T05:23:40.207106+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:53.720206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021121,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7224,"num_read_kb":35602,"num_write":683,"num_write_kb":24689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":22193143,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"173'568","reported_seq":2739,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107780+0000","last_change":"2024-09-12T05:23:08.892915+0000","last_active":"2024-09-12T05:23:39.107780+0000","last_peered":"2024-09-12T05:23:39.107780+0000","last_clean":"2024-09-12T05:23:39.107780+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:23:39.107780+0000","last_undegraded":"2024-09-12T05:23:39.107780+0000","last_fullsized":"2024-09-12T05:23:39.107780+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:36.311832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002006543,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":2948,"num_read_kb":4414,"num_write":610,"num_write_kb":2188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"172'904","reported_seq":3485,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110717+0000","last_change":"2024-09-12T05:23:09.006738+0000","last_active":"2024-09-12T05:23:39.110717+0000","last_peered":"2024-09-12T05:23:39.110717+0000","last_clean":"2024-09-12T05:23:39.110717+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:23:39.110717+0000","last_undegraded":"2024-09-12T05:23:39.110717+0000","last_fullsized":"2024-09-12T05:23:39.110717+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:24.153867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037362760000000002,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":5009,"num_read_kb":21353,"num_write":1061,"num_write_kb":9448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"166'486","reported_seq":5111,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110776+0000","last_change":"2024-09-12T05:23:09.007825+0000","last_active":"2024-09-12T05:23:39.110776+0000","last_peered":"2024-09-12T05:23:39.110776+0000","last_clean":"2024-09-12T05:23:39.110776+0000","last_became_active":"2024-09-12T05:22:23.848062+0000","last_became_peered":"2024-09-12T05:22:23.848062+0000","last_unstale":"2024-09-12T05:23:39.110776+0000","last_undegraded":"2024-09-12T05:23:39.110776+0000","last_fullsized":"2024-09-12T05:23:39.110776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:15.695305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045086240000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5071,"num_read_kb":16406,"num_write":417,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":6526540,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"179'1802","reported_seq":4650,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.111610+0000","last_change":"2024-09-12T05:23:21.320885+0000","last_active":"2024-09-12T05:23:39.111610+0000","last_peered":"2024-09-12T05:23:39.111610+0000","last_clean":"2024-09-12T05:23:39.111610+0000","last_became_active":"2024-09-12T05:23:21.071081+0000","last_became_peered":"2024-09-12T05:23:21.071081+0000","last_unstale":"2024-09-12T05:23:39.111610+0000","last_undegraded":"2024-09-12T05:23:39.111610+0000","last_fullsized":"2024-09-12T05:23:39.111610+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.752691+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.074865914000000006,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":10272,"num_read_kb":16192,"num_write":3031,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"172'764","reported_seq":6213,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868057+0000","last_change":"2024-09-12T05:23:09.006532+0000","last_active":"2024-09-12T05:23:39.868057+0000","last_peered":"2024-09-12T05:23:39.868057+0000","last_clean":"2024-09-12T05:23:39.868057+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:23:39.868057+0000","last_undegraded":"2024-09-12T05:23:39.868057+0000","last_fullsized":"2024-09-12T05:23:39.868057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:19.123843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052823210000000004,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7010,"num_read_kb":29483,"num_write":891,"num_write_kb":11124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"172'527","reported_seq":2206,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868215+0000","last_change":"2024-09-12T05:23:09.007104+0000","last_active":"2024-09-12T05:23:39.868215+0000","last_peered":"2024-09-12T05:23:39.868215+0000","last_clean":"2024-09-12T05:23:39.868215+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:23:39.868215+0000","last_undegraded":"2024-09-12T05:23:39.868215+0000","last_fullsized":"2024-09-12T05:23:39.868215+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.855353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053945199999999999,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":2302,"num_read_kb":6600,"num_write":563,"num_write_kb":4788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"165'378","reported_seq":3931,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868228+0000","last_change":"2024-09-12T05:23:09.008317+0000","last_active":"2024-09-12T05:23:39.868228+0000","last_peered":"2024-09-12T05:23:39.868228+0000","last_clean":"2024-09-12T05:23:39.868228+0000","last_became_active":"2024-09-12T05:22:54.769137+0000","last_became_peered":"2024-09-12T05:22:54.769137+0000","last_unstale":"2024-09-12T05:23:39.868228+0000","last_undegraded":"2024-09-12T05:23:39.868228+0000","last_fullsized":"2024-09-12T05:23:39.868228+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:48.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062235559999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3060,"num_read_kb":10629,"num_write":327,"num_write_kb":8973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":227,"num_bytes_recovered":1802832,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"166'501","reported_seq":3371,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.110697+0000","last_change":"2024-09-12T05:23:09.005232+0000","last_active":"2024-09-12T05:23:39.110697+0000","last_peered":"2024-09-12T05:23:39.110697+0000","last_clean":"2024-09-12T05:23:39.110697+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:23:39.110697+0000","last_undegraded":"2024-09-12T05:23:39.110697+0000","last_fullsized":"2024-09-12T05:23:39.110697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:08.625788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025783249999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":3230,"num_read_kb":18134,"num_write":544,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"172'454","reported_seq":3074,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867582+0000","last_change":"2024-09-12T05:23:09.002032+0000","last_active":"2024-09-12T05:23:39.867582+0000","last_peered":"2024-09-12T05:23:39.867582+0000","last_clean":"2024-09-12T05:23:39.867582+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:23:39.867582+0000","last_undegraded":"2024-09-12T05:23:39.867582+0000","last_fullsized":"2024-09-12T05:23:39.867582+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:39.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019782329999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3005,"num_read_kb":39119,"num_write":453,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'408","reported_seq":2186,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.107755+0000","last_change":"2024-09-12T05:23:27.159232+0000","last_active":"2024-09-12T05:23:39.107755+0000","last_peered":"2024-09-12T05:23:39.107755+0000","last_clean":"2024-09-12T05:23:39.107755+0000","last_became_active":"2024-09-12T05:23:27.157078+0000","last_became_peered":"2024-09-12T05:23:27.157078+0000","last_unstale":"2024-09-12T05:23:39.107755+0000","last_undegraded":"2024-09-12T05:23:39.107755+0000","last_fullsized":"2024-09-12T05:23:39.107755+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:13.706853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022490409999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2054,"num_read_kb":36836,"num_write":418,"num_write_kb":29183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"172'576","reported_seq":4135,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867878+0000","last_change":"2024-09-12T05:23:09.003554+0000","last_active":"2024-09-12T05:23:39.867878+0000","last_peered":"2024-09-12T05:23:39.867878+0000","last_clean":"2024-09-12T05:23:39.867878+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:23:39.867878+0000","last_undegraded":"2024-09-12T05:23:39.867878+0000","last_fullsized":"2024-09-12T05:23:39.867878+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.365681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034044259999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4425,"num_read_kb":19293,"num_write":516,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":935,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":935,"num_whiteouts":931,"num_read":160719,"num_read_kb":930985,"num_write":23755,"num_write_kb":470520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3298,"num_bytes_recovered":149051681,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24428,"internal_metadata":0},"log_size":21004,"ondisk_log_size":21004,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60472,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311368,"statfs":{"total":96636764160,"available":96574840832,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41828,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330012,"statfs":{"total":96636764160,"available":96593932288,"internally_reserved":0,"allocated":2375680,"data_stored":1158828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77932,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293908,"statfs":{"total":96636764160,"available":96556961792,"internally_reserved":0,"allocated":2379776,"data_stored":1158847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271765,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43508,"kb_used_data":2336,"kb_used_omap":27,"kb_used_meta":41124,"kb_avail":94328332,"statfs":{"total":96636764160,"available":96592211968,"internally_reserved":0,"allocated":2392064,"data_stored":1164784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":42111799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":178,"seq":764504178695,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35440,"kb_used_data":2332,"kb_used_omap":27,"kb_used_meta":33060,"kb_avail":94336400,"statfs":{"total":96636764160,"available":96600473600,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28194,"internal_metadata":33853918},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41848,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329992,"statfs":{"total":96636764160,"available":96593911808,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1164803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56296,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315544,"statfs":{"total":96636764160,"available":96579117056,"internally_reserved":0,"allocated":2969600,"data_stored":1749196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11950,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:23:45.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T05:23:45.418 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:45.418 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":198,"fsid":"68a6e7bb-cbcb-48c0-a793-81ba84559d97","created":"2024-09-12T05:19:39.984405+0000","modified":"2024-09-12T05:23:39.851451+0000","last_up_change":"2024-09-12T05:23:20.017803+0000","last_in_change":"2024-09-12T05:23:01.800319+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T05:19:52.945109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T05:19:58.280650+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-12T05:20:08.800004+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":46,"snap_epoch":173,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c94de5b-39f6-4915-ba6c-e8cccd9102af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6817","nonce":3837229352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6819","nonce":3837229352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6823","nonce":3837229352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3837229352},{"type":"v1","addr":"172.21.15.59:6821","nonce":3837229352}]},"public_addr":"172.21.15.59:6817/3837229352","cluster_addr":"172.21.15.59:6819/3837229352","heartbeat_back_addr":"172.21.15.59:6823/3837229352","heartbeat_front_addr":"172.21.15.59:6821/3837229352","state":["exists","up"]},{"osd":1,"uuid":"42bc191c-bc62-4ba4-a60c-609e883f33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6801","nonce":1576154773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6803","nonce":1576154773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6807","nonce":1576154773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1576154773},{"type":"v1","addr":"172.21.15.59:6805","nonce":1576154773}]},"public_addr":"172.21.15.59:6801/1576154773","cluster_addr":"172.21.15.59:6803/1576154773","heartbeat_back_addr":"172.21.15.59:6807/1576154773","heartbeat_front_addr":"172.21.15.59:6805/1576154773","state":["exists","up"]},{"osd":2,"uuid":"0ce3483f-c255-4b55-bc06-cd54783301c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6825","nonce":3725088694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6827","nonce":3725088694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6831","nonce":3725088694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3725088694},{"type":"v1","addr":"172.21.15.59:6829","nonce":3725088694}]},"public_addr":"172.21.15.59:6825/3725088694","cluster_addr":"172.21.15.59:6827/3725088694","heartbeat_back_addr":"172.21.15.59:6831/3725088694","heartbeat_front_addr":"172.21.15.59:6829/3725088694","state":["exists","up"]},{"osd":3,"uuid":"0b8c307c-b876-4aa3-82a6-f5e63033e353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":129,"up_from":178,"up_thru":181,"down_at":130,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6809","nonce":1430015273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6811","nonce":1430015273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6815","nonce":1430015273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1430015273},{"type":"v1","addr":"172.21.15.59:6813","nonce":1430015273}]},"public_addr":"172.21.15.59:6809/1430015273","cluster_addr":"172.21.15.59:6811/1430015273","heartbeat_back_addr":"172.21.15.59:6815/1430015273","heartbeat_front_addr":"172.21.15.59:6813/1430015273","state":["exists","up"]},{"osd":4,"uuid":"592feb7f-d1f9-420a-9fef-7110c6ac9882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":58,"up_from":114,"up_thru":169,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6825","nonce":1662122460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6827","nonce":1662122460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6831","nonce":1662122460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1662122460},{"type":"v1","addr":"172.21.15.194:6829","nonce":1662122460}]},"public_addr":"172.21.15.194:6825/1662122460","cluster_addr":"172.21.15.194:6827/1662122460","heartbeat_back_addr":"172.21.15.194:6831/1662122460","heartbeat_front_addr":"172.21.15.194:6829/1662122460","state":["exists","up"]},{"osd":5,"uuid":"fb43b395-e414-42b5-8c6c-4cd0926662c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6801","nonce":1911143418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6803","nonce":1911143418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6807","nonce":1911143418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1911143418},{"type":"v1","addr":"172.21.15.194:6805","nonce":1911143418}]},"public_addr":"172.21.15.194:6801/1911143418","cluster_addr":"172.21.15.194:6803/1911143418","heartbeat_back_addr":"172.21.15.194:6807/1911143418","heartbeat_front_addr":"172.21.15.194:6805/1911143418","state":["exists","up"]},{"osd":6,"uuid":"fd8d0fb3-58c5-43dc-bdce-6505505e3491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6817","nonce":90490456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6819","nonce":90490456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6823","nonce":90490456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":90490456},{"type":"v1","addr":"172.21.15.194:6821","nonce":90490456}]},"public_addr":"172.21.15.194:6817/90490456","cluster_addr":"172.21.15.194:6819/90490456","heartbeat_back_addr":"172.21.15.194:6823/90490456","heartbeat_front_addr":"172.21.15.194:6821/90490456","state":["exists","up"]},{"osd":7,"uuid":"dd5da5cd-7d54-4812-b630-23ccf2c82c8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6809","nonce":2109956055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6811","nonce":2109956055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6815","nonce":2109956055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2109956055},{"type":"v1","addr":"172.21.15.194:6813","nonce":2109956055}]},"public_addr":"172.21.15.194:6809/2109956055","cluster_addr":"172.21.15.194:6811/2109956055","heartbeat_back_addr":"172.21.15.194:6815/2109956055","heartbeat_front_addr":"172.21.15.194:6813/2109956055","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.291372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.699928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.078333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.878139+0000","dead_epoch":130},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.129610+0000","dead_epoch":60},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.515195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:49.266450+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T05:19:48.961964+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.9","osds":[0,2]}],"pg_upmap_items":[{"pgid":"2.1","mappings":[{"from":3,"to":6}]},{"pgid":"2.4","mappings":[{"from":0,"to":4}]},{"pgid":"3.b","mappings":[{"from":0,"to":7},{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T05:23:46.439 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T05:23:46.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T05:23:46.598 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:46.598 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T05:23:46.598 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:46.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T05:23:46.921 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T05:23:46.940 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T05:23:46.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T05:23:47.093 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:47.093 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T05:23:47.093 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:47.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T05:23:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T05:23:47.418 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T05:23:47.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T05:23:47.560 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:47.560 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T05:23:47.560 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:47.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T05:23:47.880 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T05:23:47.900 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T05:23:47.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T05:23:48.056 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:48.057 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T05:23:48.057 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:48.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T05:23:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T05:23:48.394 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T05:23:48.394 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T05:23:48.551 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:48.551 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T05:23:48.551 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:48.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T05:23:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T05:23:48.897 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T05:23:48.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T05:23:49.060 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:49.060 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T05:23:49.060 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:49.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T05:23:49.375 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T05:23:49.395 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T05:23:49.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T05:23:49.546 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:49.546 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T05:23:49.547 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:49.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T05:23:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T05:23:49.887 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T05:23:49.887 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T05:23:50.039 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-12T05:23:50.039 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T05:23:50.039 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-12T05:23:50.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T05:23:50.365 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T05:23:50.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:23:50.707 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:23:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:23:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-12T05:23:48.963809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":939,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":939,"num_whiteouts":931,"num_read":160785,"num_read_kb":931040,"num_write":23858,"num_write_kb":472150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3302,"num_bytes_recovered":149051719,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21120,"ondisk_log_size":21120,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":413096,"kb_used_data":19832,"kb_used_omap":64,"kb_used_meta":393023,"kb_avail":754561624,"statfs":{"total":773094113280,"available":772671102976,"internally_reserved":0,"allocated":20307968,"data_stored":10498932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65607,"internal_metadata":402456505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003020"},"pg_stats":[{"pgid":"3.1f","version":"173'486","reported_seq":9174,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.583798+0000","last_change":"2024-09-12T05:23:08.894836+0000","last_active":"2024-09-12T05:23:42.583798+0000","last_peered":"2024-09-12T05:23:42.583798+0000","last_clean":"2024-09-12T05:23:42.583798+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:23:42.583798+0000","last_undegraded":"2024-09-12T05:23:42.583798+0000","last_fullsized":"2024-09-12T05:23:42.583798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:46.702174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003248342,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9528,"num_read_kb":33880,"num_write":431,"num_write_kb":7991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"179'378","reported_seq":7803,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207394+0000","last_change":"2024-09-12T05:23:21.451138+0000","last_active":"2024-09-12T05:23:40.207394+0000","last_peered":"2024-09-12T05:23:40.207394+0000","last_clean":"2024-09-12T05:23:40.207394+0000","last_became_active":"2024-09-12T05:23:21.054723+0000","last_became_peered":"2024-09-12T05:23:21.054723+0000","last_unstale":"2024-09-12T05:23:40.207394+0000","last_undegraded":"2024-09-12T05:23:40.207394+0000","last_fullsized":"2024-09-12T05:23:40.207394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:36.202472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.11218479200000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":7029,"num_read_kb":84720,"num_write":386,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'786","reported_seq":4149,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.586640+0000","last_change":"2024-09-12T05:23:08.884176+0000","last_active":"2024-09-12T05:23:42.586640+0000","last_peered":"2024-09-12T05:23:42.586640+0000","last_clean":"2024-09-12T05:23:42.586640+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:23:42.586640+0000","last_undegraded":"2024-09-12T05:23:42.586640+0000","last_fullsized":"2024-09-12T05:23:42.586640+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:16.886391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772933,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5372,"num_read_kb":9022,"num_write":882,"num_write_kb":5162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'728","reported_seq":5600,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.586803+0000","last_change":"2024-09-12T05:23:08.885454+0000","last_active":"2024-09-12T05:23:42.586803+0000","last_peered":"2024-09-12T05:23:42.586803+0000","last_clean":"2024-09-12T05:23:42.586803+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:23:42.586803+0000","last_undegraded":"2024-09-12T05:23:42.586803+0000","last_fullsized":"2024-09-12T05:23:42.586803+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.227991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002840431,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":6419,"num_read_kb":39592,"num_write":787,"num_write_kb":9586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"172'701","reported_seq":4031,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.583936+0000","last_change":"2024-09-12T05:23:08.894170+0000","last_active":"2024-09-12T05:23:42.583936+0000","last_peered":"2024-09-12T05:23:42.583936+0000","last_clean":"2024-09-12T05:23:42.583936+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:23:42.583936+0000","last_undegraded":"2024-09-12T05:23:42.583936+0000","last_fullsized":"2024-09-12T05:23:42.583936+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:09.253291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028723139999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":4932,"num_read_kb":38662,"num_write":725,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'441","reported_seq":6263,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.839719+0000","last_change":"2024-09-12T05:23:08.921196+0000","last_active":"2024-09-12T05:23:40.839719+0000","last_peered":"2024-09-12T05:23:40.839719+0000","last_clean":"2024-09-12T05:23:40.839719+0000","last_became_active":"2024-09-12T05:23:05.778317+0000","last_became_peered":"2024-09-12T05:23:05.778317+0000","last_unstale":"2024-09-12T05:23:40.839719+0000","last_undegraded":"2024-09-12T05:23:40.839719+0000","last_fullsized":"2024-09-12T05:23:40.839719+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:31.021021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023560629999999998,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5982,"num_read_kb":31159,"num_write":378,"num_write_kb":18476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":278,"num_bytes_recovered":17309726,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"172'466","reported_seq":4426,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866481+0000","last_change":"2024-09-12T05:23:22.198107+0000","last_active":"2024-09-12T05:23:39.866481+0000","last_peered":"2024-09-12T05:23:39.866481+0000","last_clean":"2024-09-12T05:23:39.866481+0000","last_became_active":"2024-09-12T05:23:22.049233+0000","last_became_peered":"2024-09-12T05:23:22.049233+0000","last_unstale":"2024-09-12T05:23:39.866481+0000","last_undegraded":"2024-09-12T05:23:39.866481+0000","last_fullsized":"2024-09-12T05:23:39.866481+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.090281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015759229999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4026,"num_read_kb":33452,"num_write":410,"num_write_kb":5078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":1855629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"179'656","reported_seq":3405,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207255+0000","last_change":"2024-09-12T05:23:21.371061+0000","last_active":"2024-09-12T05:23:40.207255+0000","last_peered":"2024-09-12T05:23:40.207255+0000","last_clean":"2024-09-12T05:23:40.207255+0000","last_became_active":"2024-09-12T05:23:21.054412+0000","last_became_peered":"2024-09-12T05:23:21.054412+0000","last_unstale":"2024-09-12T05:23:40.207255+0000","last_undegraded":"2024-09-12T05:23:40.207255+0000","last_fullsized":"2024-09-12T05:23:40.207255+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:27.068859+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.10278277800000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4940,"num_read_kb":22589,"num_write":590,"num_write_kb":11883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"173'686","reported_seq":2506,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.583916+0000","last_change":"2024-09-12T05:23:08.896248+0000","last_active":"2024-09-12T05:23:42.583916+0000","last_peered":"2024-09-12T05:23:42.583916+0000","last_clean":"2024-09-12T05:23:42.583916+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:23:42.583916+0000","last_undegraded":"2024-09-12T05:23:42.583916+0000","last_fullsized":"2024-09-12T05:23:42.583916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:58.298697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042327889999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3367,"num_read_kb":15041,"num_write":820,"num_write_kb":7486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"165'549","reported_seq":6344,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.587122+0000","last_change":"2024-09-12T05:23:08.884563+0000","last_active":"2024-09-12T05:23:42.587122+0000","last_peered":"2024-09-12T05:23:42.587122+0000","last_clean":"2024-09-12T05:23:42.587122+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:23:42.587122+0000","last_undegraded":"2024-09-12T05:23:42.587122+0000","last_fullsized":"2024-09-12T05:23:42.587122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:42.147876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00202206,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":6274,"num_read_kb":69645,"num_write":520,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'418","reported_seq":2533,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867909+0000","last_change":"2024-09-12T05:23:24.071340+0000","last_active":"2024-09-12T05:23:39.867909+0000","last_peered":"2024-09-12T05:23:39.867909+0000","last_clean":"2024-09-12T05:23:39.867909+0000","last_became_active":"2024-09-12T05:23:24.069263+0000","last_became_peered":"2024-09-12T05:23:24.069263+0000","last_unstale":"2024-09-12T05:23:39.867909+0000","last_undegraded":"2024-09-12T05:23:39.867909+0000","last_fullsized":"2024-09-12T05:23:39.867909+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:24.354148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041559700000000002,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":1771,"num_read_kb":12775,"num_write":434,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"173'1271","reported_seq":5564,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.839929+0000","last_change":"2024-09-12T05:23:08.921139+0000","last_active":"2024-09-12T05:23:40.839929+0000","last_peered":"2024-09-12T05:23:40.839929+0000","last_clean":"2024-09-12T05:23:40.839929+0000","last_became_active":"2024-09-12T05:22:14.756246+0000","last_became_peered":"2024-09-12T05:22:14.756246+0000","last_unstale":"2024-09-12T05:23:40.839929+0000","last_undegraded":"2024-09-12T05:23:40.839929+0000","last_fullsized":"2024-09-12T05:23:40.839929+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:02.371995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001595127,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":8879,"num_read_kb":39076,"num_write":1824,"num_write_kb":25359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":17251748,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":319,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.588293+0000","last_change":"2024-09-12T05:20:33.987517+0000","last_active":"2024-09-12T05:23:42.588293+0000","last_peered":"2024-09-12T05:23:42.588293+0000","last_clean":"2024-09-12T05:23:42.588293+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:23:42.588293+0000","last_undegraded":"2024-09-12T05:23:42.588293+0000","last_fullsized":"2024-09-12T05:23:42.588293+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:09.366910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"198'843","reported_seq":3353,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:47.036948+0000","last_change":"2024-09-12T05:23:47.036948+0000","last_active":"2024-09-12T05:23:47.036948+0000","last_peered":"2024-09-12T05:23:47.036948+0000","last_clean":"2024-09-12T05:23:47.036948+0000","last_became_active":"2024-09-12T05:23:06.775134+0000","last_became_peered":"2024-09-12T05:23:06.775134+0000","last_unstale":"2024-09-12T05:23:47.036948+0000","last_undegraded":"2024-09-12T05:23:47.036948+0000","last_fullsized":"2024-09-12T05:23:47.036948+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'843","last_scrub_stamp":"2024-09-12T05:23:47.036827+0000","last_deep_scrub":"198'843","last_deep_scrub_stamp":"2024-09-12T05:23:47.036827+0000","last_clean_scrub_stamp":"2024-09-12T05:23:47.036827+0000","objects_scrubbed":41,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.693620+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0042806040000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":2732,"num_read_kb":14112,"num_write":849,"num_write_kb":22030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":524386,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866541+0000","last_change":"2024-09-12T05:23:02.831403+0000","last_active":"2024-09-12T05:23:39.866541+0000","last_peered":"2024-09-12T05:23:39.866541+0000","last_clean":"2024-09-12T05:23:39.866541+0000","last_became_active":"2024-09-12T05:23:02.830555+0000","last_became_peered":"2024-09-12T05:23:02.830555+0000","last_unstale":"2024-09-12T05:23:39.866541+0000","last_undegraded":"2024-09-12T05:23:39.866541+0000","last_fullsized":"2024-09-12T05:23:39.866541+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:08.335748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"179'435","reported_seq":3445,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207585+0000","last_change":"2024-09-12T05:23:21.287558+0000","last_active":"2024-09-12T05:23:40.207585+0000","last_peered":"2024-09-12T05:23:40.207585+0000","last_clean":"2024-09-12T05:23:40.207585+0000","last_became_active":"2024-09-12T05:23:21.051627+0000","last_became_peered":"2024-09-12T05:23:21.051627+0000","last_unstale":"2024-09-12T05:23:40.207585+0000","last_undegraded":"2024-09-12T05:23:40.207585+0000","last_fullsized":"2024-09-12T05:23:40.207585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:44.975331+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.114526524,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2848,"num_read_kb":54239,"num_write":458,"num_write_kb":24596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":368,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868205+0000","last_change":"2024-09-12T05:20:02.152847+0000","last_active":"2024-09-12T05:23:39.868205+0000","last_peered":"2024-09-12T05:23:39.868205+0000","last_clean":"2024-09-12T05:23:39.868205+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:23:39.868205+0000","last_undegraded":"2024-09-12T05:23:39.868205+0000","last_fullsized":"2024-09-12T05:23:39.868205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:45.182434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"172'752","reported_seq":4313,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866631+0000","last_change":"2024-09-12T05:23:08.885502+0000","last_active":"2024-09-12T05:23:39.866631+0000","last_peered":"2024-09-12T05:23:39.866631+0000","last_clean":"2024-09-12T05:23:39.866631+0000","last_became_active":"2024-09-12T05:23:06.773505+0000","last_became_peered":"2024-09-12T05:23:06.773505+0000","last_unstale":"2024-09-12T05:23:39.866631+0000","last_undegraded":"2024-09-12T05:23:39.866631+0000","last_fullsized":"2024-09-12T05:23:39.866631+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:15.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024700099999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5270,"num_read_kb":22820,"num_write":798,"num_write_kb":28293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":474,"num_bytes_recovered":12649810,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866460+0000","last_change":"2024-09-12T05:23:02.830895+0000","last_active":"2024-09-12T05:23:39.866460+0000","last_peered":"2024-09-12T05:23:39.866460+0000","last_clean":"2024-09-12T05:23:39.866460+0000","last_became_active":"2024-09-12T05:23:02.829933+0000","last_became_peered":"2024-09-12T05:23:02.829933+0000","last_unstale":"2024-09-12T05:23:39.866460+0000","last_undegraded":"2024-09-12T05:23:39.866460+0000","last_fullsized":"2024-09-12T05:23:39.866460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.164044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"179'485","reported_seq":2866,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.587179+0000","last_change":"2024-09-12T05:23:21.221659+0000","last_active":"2024-09-12T05:23:42.587179+0000","last_peered":"2024-09-12T05:23:42.587179+0000","last_clean":"2024-09-12T05:23:42.587179+0000","last_became_active":"2024-09-12T05:23:21.069868+0000","last_became_peered":"2024-09-12T05:23:21.069868+0000","last_unstale":"2024-09-12T05:23:42.587179+0000","last_undegraded":"2024-09-12T05:23:42.587179+0000","last_fullsized":"2024-09-12T05:23:42.587179+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:29.218757+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.078824042999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2610,"num_read_kb":20437,"num_write":595,"num_write_kb":10557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"173'729","reported_seq":5227,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.839926+0000","last_change":"2024-09-12T05:23:08.920199+0000","last_active":"2024-09-12T05:23:40.839926+0000","last_peered":"2024-09-12T05:23:40.839926+0000","last_clean":"2024-09-12T05:23:40.839926+0000","last_became_active":"2024-09-12T05:22:14.219295+0000","last_became_peered":"2024-09-12T05:22:14.219295+0000","last_unstale":"2024-09-12T05:23:40.839926+0000","last_undegraded":"2024-09-12T05:23:40.839926+0000","last_fullsized":"2024-09-12T05:23:40.839926+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:08.649145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001330901,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":5192,"num_read_kb":18719,"num_write":679,"num_write_kb":26356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":393,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.586750+0000","last_change":"2024-09-12T05:23:02.838440+0000","last_active":"2024-09-12T05:23:42.586750+0000","last_peered":"2024-09-12T05:23:42.586750+0000","last_clean":"2024-09-12T05:23:42.586750+0000","last_became_active":"2024-09-12T05:23:02.830933+0000","last_became_peered":"2024-09-12T05:23:02.830933+0000","last_unstale":"2024-09-12T05:23:42.586750+0000","last_undegraded":"2024-09-12T05:23:42.586750+0000","last_fullsized":"2024-09-12T05:23:42.586750+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:59.974404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"172'1022","reported_seq":10699,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.866410+0000","last_change":"2024-09-12T05:23:08.884903+0000","last_active":"2024-09-12T05:23:39.866410+0000","last_peered":"2024-09-12T05:23:39.866410+0000","last_clean":"2024-09-12T05:23:39.866410+0000","last_became_active":"2024-09-12T05:23:06.773339+0000","last_became_peered":"2024-09-12T05:23:06.773339+0000","last_unstale":"2024-09-12T05:23:39.866410+0000","last_undegraded":"2024-09-12T05:23:39.866410+0000","last_fullsized":"2024-09-12T05:23:39.866410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1022,"log_dups_size":0,"ondisk_log_size":1022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:45.213297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002206193,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":11896,"num_read_kb":54588,"num_write":1368,"num_write_kb":21769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":13965694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":231,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.865100+0000","last_change":"2024-09-12T05:21:39.753284+0000","last_active":"2024-09-12T05:23:39.865100+0000","last_peered":"2024-09-12T05:23:39.865100+0000","last_clean":"2024-09-12T05:23:39.865100+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:23:39.865100+0000","last_undegraded":"2024-09-12T05:23:39.865100+0000","last_fullsized":"2024-09-12T05:23:39.865100+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.062402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'610","reported_seq":2590,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.584171+0000","last_change":"2024-09-12T05:23:08.892844+0000","last_active":"2024-09-12T05:23:42.584171+0000","last_peered":"2024-09-12T05:23:42.584171+0000","last_clean":"2024-09-12T05:23:42.584171+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:23:42.584171+0000","last_undegraded":"2024-09-12T05:23:42.584171+0000","last_fullsized":"2024-09-12T05:23:42.584171+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:18.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015778210000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":2646,"num_read_kb":16084,"num_write":734,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":380,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867778+0000","last_change":"2024-09-12T05:23:02.827747+0000","last_active":"2024-09-12T05:23:39.867778+0000","last_peered":"2024-09-12T05:23:39.867778+0000","last_clean":"2024-09-12T05:23:39.867778+0000","last_became_active":"2024-09-12T05:23:02.826853+0000","last_became_peered":"2024-09-12T05:23:02.826853+0000","last_unstale":"2024-09-12T05:23:39.867778+0000","last_undegraded":"2024-09-12T05:23:39.867778+0000","last_fullsized":"2024-09-12T05:23:39.867778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:35.923974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"179'516","reported_seq":3644,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207359+0000","last_change":"2024-09-12T05:23:21.556051+0000","last_active":"2024-09-12T05:23:40.207359+0000","last_peered":"2024-09-12T05:23:40.207359+0000","last_clean":"2024-09-12T05:23:40.207359+0000","last_became_active":"2024-09-12T05:23:21.060573+0000","last_became_peered":"2024-09-12T05:23:21.060573+0000","last_unstale":"2024-09-12T05:23:40.207359+0000","last_undegraded":"2024-09-12T05:23:40.207359+0000","last_fullsized":"2024-09-12T05:23:40.207359+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:56.367076+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.13014315100000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3396,"num_read_kb":46312,"num_write":573,"num_write_kb":32831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":392,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.586801+0000","last_change":"2024-09-12T05:21:39.756749+0000","last_active":"2024-09-12T05:23:42.586801+0000","last_peered":"2024-09-12T05:23:42.586801+0000","last_clean":"2024-09-12T05:23:42.586801+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:23:42.586801+0000","last_undegraded":"2024-09-12T05:23:42.586801+0000","last_fullsized":"2024-09-12T05:23:42.586801+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:58.896048+0000","last_clean_scrub_stamp":"2024-09-12T05:19:58.896048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.033050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":460,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867568+0000","last_change":"2024-09-12T05:19:54.986450+0000","last_active":"2024-09-12T05:23:39.867568+0000","last_peered":"2024-09-12T05:23:39.867568+0000","last_clean":"2024-09-12T05:23:39.867568+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:23:39.867568+0000","last_undegraded":"2024-09-12T05:23:39.867568+0000","last_fullsized":"2024-09-12T05:23:39.867568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:19:53.854632+0000","last_clean_scrub_stamp":"2024-09-12T05:19:53.854632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:08.434007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"172'719","reported_seq":5307,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:40.207106+0000","last_change":"2024-09-12T05:23:24.067998+0000","last_active":"2024-09-12T05:23:40.207106+0000","last_peered":"2024-09-12T05:23:40.207106+0000","last_clean":"2024-09-12T05:23:40.207106+0000","last_became_active":"2024-09-12T05:23:24.066068+0000","last_became_peered":"2024-09-12T05:23:24.066068+0000","last_unstale":"2024-09-12T05:23:40.207106+0000","last_undegraded":"2024-09-12T05:23:40.207106+0000","last_fullsized":"2024-09-12T05:23:40.207106+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:53.720206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021121,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7224,"num_read_kb":35602,"num_write":683,"num_write_kb":24689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":22193143,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"173'568","reported_seq":2741,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.584101+0000","last_change":"2024-09-12T05:23:08.892915+0000","last_active":"2024-09-12T05:23:42.584101+0000","last_peered":"2024-09-12T05:23:42.584101+0000","last_clean":"2024-09-12T05:23:42.584101+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:23:42.584101+0000","last_undegraded":"2024-09-12T05:23:42.584101+0000","last_fullsized":"2024-09-12T05:23:42.584101+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:36.311832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002006543,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":2948,"num_read_kb":4414,"num_write":610,"num_write_kb":2188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"172'904","reported_seq":3487,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.588009+0000","last_change":"2024-09-12T05:23:09.006738+0000","last_active":"2024-09-12T05:23:42.588009+0000","last_peered":"2024-09-12T05:23:42.588009+0000","last_clean":"2024-09-12T05:23:42.588009+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:23:42.588009+0000","last_undegraded":"2024-09-12T05:23:42.588009+0000","last_fullsized":"2024-09-12T05:23:42.588009+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:24.153867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037362760000000002,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":5009,"num_read_kb":21353,"num_write":1061,"num_write_kb":9448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"166'486","reported_seq":5113,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.588192+0000","last_change":"2024-09-12T05:23:09.007825+0000","last_active":"2024-09-12T05:23:42.588192+0000","last_peered":"2024-09-12T05:23:42.588192+0000","last_clean":"2024-09-12T05:23:42.588192+0000","last_became_active":"2024-09-12T05:22:23.848062+0000","last_became_peered":"2024-09-12T05:22:23.848062+0000","last_unstale":"2024-09-12T05:23:42.588192+0000","last_undegraded":"2024-09-12T05:23:42.588192+0000","last_fullsized":"2024-09-12T05:23:42.588192+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:15.695305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045086240000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5071,"num_read_kb":16406,"num_write":417,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":6526540,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"179'1802","reported_seq":4652,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.586937+0000","last_change":"2024-09-12T05:23:21.320885+0000","last_active":"2024-09-12T05:23:42.586937+0000","last_peered":"2024-09-12T05:23:42.586937+0000","last_clean":"2024-09-12T05:23:42.586937+0000","last_became_active":"2024-09-12T05:23:21.071081+0000","last_became_peered":"2024-09-12T05:23:21.071081+0000","last_unstale":"2024-09-12T05:23:42.586937+0000","last_undegraded":"2024-09-12T05:23:42.586937+0000","last_fullsized":"2024-09-12T05:23:42.586937+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.752691+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.074865914000000006,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":10272,"num_read_kb":16192,"num_write":3031,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"172'764","reported_seq":6213,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868057+0000","last_change":"2024-09-12T05:23:09.006532+0000","last_active":"2024-09-12T05:23:39.868057+0000","last_peered":"2024-09-12T05:23:39.868057+0000","last_clean":"2024-09-12T05:23:39.868057+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:23:39.868057+0000","last_undegraded":"2024-09-12T05:23:39.868057+0000","last_fullsized":"2024-09-12T05:23:39.868057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:19.123843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052823210000000004,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7010,"num_read_kb":29483,"num_write":891,"num_write_kb":11124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"172'527","reported_seq":2206,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868215+0000","last_change":"2024-09-12T05:23:09.007104+0000","last_active":"2024-09-12T05:23:39.868215+0000","last_peered":"2024-09-12T05:23:39.868215+0000","last_clean":"2024-09-12T05:23:39.868215+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:23:39.868215+0000","last_undegraded":"2024-09-12T05:23:39.868215+0000","last_fullsized":"2024-09-12T05:23:39.868215+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.855353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053945199999999999,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":2302,"num_read_kb":6600,"num_write":563,"num_write_kb":4788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"165'378","reported_seq":3931,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.868228+0000","last_change":"2024-09-12T05:23:09.008317+0000","last_active":"2024-09-12T05:23:39.868228+0000","last_peered":"2024-09-12T05:23:39.868228+0000","last_clean":"2024-09-12T05:23:39.868228+0000","last_became_active":"2024-09-12T05:22:54.769137+0000","last_became_peered":"2024-09-12T05:22:54.769137+0000","last_unstale":"2024-09-12T05:23:39.868228+0000","last_undegraded":"2024-09-12T05:23:39.868228+0000","last_fullsized":"2024-09-12T05:23:39.868228+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:48.486545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062235559999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3060,"num_read_kb":10629,"num_write":327,"num_write_kb":8973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":227,"num_bytes_recovered":1802832,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"166'501","reported_seq":3373,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.588138+0000","last_change":"2024-09-12T05:23:09.005232+0000","last_active":"2024-09-12T05:23:42.588138+0000","last_peered":"2024-09-12T05:23:42.588138+0000","last_clean":"2024-09-12T05:23:42.588138+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:23:42.588138+0000","last_undegraded":"2024-09-12T05:23:42.588138+0000","last_fullsized":"2024-09-12T05:23:42.588138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:08.625788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025783249999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":3230,"num_read_kb":18134,"num_write":544,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"172'454","reported_seq":3074,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867582+0000","last_change":"2024-09-12T05:23:09.002032+0000","last_active":"2024-09-12T05:23:39.867582+0000","last_peered":"2024-09-12T05:23:39.867582+0000","last_clean":"2024-09-12T05:23:39.867582+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:23:39.867582+0000","last_undegraded":"2024-09-12T05:23:39.867582+0000","last_fullsized":"2024-09-12T05:23:39.867582+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:39.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019782329999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3005,"num_read_kb":39119,"num_write":453,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'408","reported_seq":2188,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:42.583784+0000","last_change":"2024-09-12T05:23:27.159232+0000","last_active":"2024-09-12T05:23:42.583784+0000","last_peered":"2024-09-12T05:23:42.583784+0000","last_clean":"2024-09-12T05:23:42.583784+0000","last_became_active":"2024-09-12T05:23:27.157078+0000","last_became_peered":"2024-09-12T05:23:27.157078+0000","last_unstale":"2024-09-12T05:23:42.583784+0000","last_undegraded":"2024-09-12T05:23:42.583784+0000","last_fullsized":"2024-09-12T05:23:42.583784+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:13.706853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022490409999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2054,"num_read_kb":36836,"num_write":418,"num_write_kb":29183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"172'576","reported_seq":4135,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:39.867878+0000","last_change":"2024-09-12T05:23:09.003554+0000","last_active":"2024-09-12T05:23:39.867878+0000","last_peered":"2024-09-12T05:23:39.867878+0000","last_clean":"2024-09-12T05:23:39.867878+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:23:39.867878+0000","last_undegraded":"2024-09-12T05:23:39.867878+0000","last_fullsized":"2024-09-12T05:23:39.867878+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:20:08.968521+0000","last_clean_scrub_stamp":"2024-09-12T05:20:08.968521+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.365681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034044259999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4425,"num_read_kb":19293,"num_write":516,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":935,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":935,"num_whiteouts":931,"num_read":160719,"num_read_kb":930985,"num_write":23755,"num_write_kb":470520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3298,"num_bytes_recovered":149051681,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24428,"internal_metadata":0},"log_size":21045,"ondisk_log_size":21045,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60472,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311368,"statfs":{"total":96636764160,"available":96574840832,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41840,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330000,"statfs":{"total":96636764160,"available":96593920000,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542195,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77940,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293900,"statfs":{"total":96636764160,"available":96556953600,"internally_reserved":0,"allocated":2392064,"data_stored":1164784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271765,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43508,"kb_used_data":2336,"kb_used_omap":27,"kb_used_meta":41124,"kb_avail":94328332,"statfs":{"total":96636764160,"available":96592211968,"internally_reserved":0,"allocated":2392064,"data_stored":1164784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":42111799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":178,"seq":764504178695,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35440,"kb_used_data":2332,"kb_used_omap":27,"kb_used_meta":33060,"kb_avail":94336400,"statfs":{"total":96636764160,"available":96600473600,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28194,"internal_metadata":33853918},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41848,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329992,"statfs":{"total":96636764160,"available":96593911808,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2396160,"data_stored":1164803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56308,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315532,"statfs":{"total":96636764160,"available":96579104768,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11950,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:23:50.734 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.734 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.735 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T05:19:58.896048+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T05:19:58.896048+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T05:19:58.896048+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T05:19:58.896048+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.736 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T05:19:58.896048+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T05:19:58.896048+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T05:19:58.896048+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T05:19:58.896048+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T05:19:53.854632+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=19, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.737 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.738 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T05:20:08.968521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=5, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T05:23:50.739 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T05:24:10.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T05:24:11.060 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-12T05:24:11.061 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-12T05:24:11.078 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-12T05:24:10.971287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":939,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":939,"num_whiteouts":931,"num_read":160785,"num_read_kb":931040,"num_write":23858,"num_write_kb":472150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3302,"num_bytes_recovered":149051719,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22018,"ondisk_log_size":22018,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417208,"kb_used_data":19832,"kb_used_omap":64,"kb_used_meta":397183,"kb_avail":754557512,"statfs":{"total":773094113280,"available":772666892288,"internally_reserved":0,"allocated":20307968,"data_stored":10498932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65607,"internal_metadata":406716345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004019"},"pg_stats":[{"pgid":"3.1f","version":"198'516","reported_seq":9213,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:52.983958+0000","last_change":"2024-09-12T05:23:52.983958+0000","last_active":"2024-09-12T05:23:52.983958+0000","last_peered":"2024-09-12T05:23:52.983958+0000","last_clean":"2024-09-12T05:23:52.983958+0000","last_became_active":"2024-09-12T05:20:09.742503+0000","last_became_peered":"2024-09-12T05:20:09.742503+0000","last_unstale":"2024-09-12T05:23:52.983958+0000","last_undegraded":"2024-09-12T05:23:52.983958+0000","last_fullsized":"2024-09-12T05:23:52.983958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'516","last_scrub_stamp":"2024-09-12T05:23:52.983700+0000","last_deep_scrub":"198'516","last_deep_scrub_stamp":"2024-09-12T05:23:52.983700+0000","last_clean_scrub_stamp":"2024-09-12T05:23:52.983700+0000","objects_scrubbed":30,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:19.903701+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.003248342,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9528,"num_read_kb":33880,"num_write":431,"num_write_kb":7991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"198'404","reported_seq":7838,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:49.748615+0000","last_change":"2024-09-12T05:23:49.748615+0000","last_active":"2024-09-12T05:23:49.748615+0000","last_peered":"2024-09-12T05:23:49.748615+0000","last_clean":"2024-09-12T05:23:49.748615+0000","last_became_active":"2024-09-12T05:23:21.054723+0000","last_became_peered":"2024-09-12T05:23:21.054723+0000","last_unstale":"2024-09-12T05:23:49.748615+0000","last_undegraded":"2024-09-12T05:23:49.748615+0000","last_fullsized":"2024-09-12T05:23:49.748615+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'404","last_scrub_stamp":"2024-09-12T05:23:49.748500+0000","last_deep_scrub":"198'404","last_deep_scrub_stamp":"2024-09-12T05:23:49.748500+0000","last_clean_scrub_stamp":"2024-09-12T05:23:49.748500+0000","objects_scrubbed":26,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:08.513667+0000","scrub_duration":31,"objects_trimmed":24,"snaptrim_duration":0.11218479200000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":7029,"num_read_kb":84720,"num_write":386,"num_write_kb":14323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3884934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"198'814","reported_seq":4186,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:56.035127+0000","last_change":"2024-09-12T05:23:56.035127+0000","last_active":"2024-09-12T05:23:56.035127+0000","last_peered":"2024-09-12T05:23:56.035127+0000","last_clean":"2024-09-12T05:23:56.035127+0000","last_became_active":"2024-09-12T05:22:14.220709+0000","last_became_peered":"2024-09-12T05:22:14.220709+0000","last_unstale":"2024-09-12T05:23:56.035127+0000","last_undegraded":"2024-09-12T05:23:56.035127+0000","last_fullsized":"2024-09-12T05:23:56.035127+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'814","last_scrub_stamp":"2024-09-12T05:23:56.034930+0000","last_deep_scrub":"198'814","last_deep_scrub_stamp":"2024-09-12T05:23:56.034930+0000","last_clean_scrub_stamp":"2024-09-12T05:23:56.034930+0000","objects_scrubbed":28,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:23.186887+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.001772933,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5372,"num_read_kb":9022,"num_write":882,"num_write_kb":5162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":1971070,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"198'759","reported_seq":5640,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:55.063224+0000","last_change":"2024-09-12T05:23:55.063224+0000","last_active":"2024-09-12T05:23:55.063224+0000","last_peered":"2024-09-12T05:23:55.063224+0000","last_clean":"2024-09-12T05:23:55.063224+0000","last_became_active":"2024-09-12T05:22:14.760460+0000","last_became_peered":"2024-09-12T05:22:14.760460+0000","last_unstale":"2024-09-12T05:23:55.063224+0000","last_undegraded":"2024-09-12T05:23:55.063224+0000","last_fullsized":"2024-09-12T05:23:55.063224+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'759","last_scrub_stamp":"2024-09-12T05:23:55.063003+0000","last_deep_scrub":"198'759","last_deep_scrub_stamp":"2024-09-12T05:23:55.063003+0000","last_clean_scrub_stamp":"2024-09-12T05:23:55.063003+0000","objects_scrubbed":31,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:33.597286+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.002840431,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":6419,"num_read_kb":39592,"num_write":787,"num_write_kb":9586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":4443458,"num_keys_recovered":109,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"198'737","reported_seq":4076,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:52.036105+0000","last_change":"2024-09-12T05:23:52.036105+0000","last_active":"2024-09-12T05:23:52.036105+0000","last_peered":"2024-09-12T05:23:52.036105+0000","last_clean":"2024-09-12T05:23:52.036105+0000","last_became_active":"2024-09-12T05:22:14.758926+0000","last_became_peered":"2024-09-12T05:22:14.758926+0000","last_unstale":"2024-09-12T05:23:52.036105+0000","last_undegraded":"2024-09-12T05:23:52.036105+0000","last_fullsized":"2024-09-12T05:23:52.036105+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'737","last_scrub_stamp":"2024-09-12T05:23:52.035911+0000","last_deep_scrub":"198'737","last_deep_scrub_stamp":"2024-09-12T05:23:52.035911+0000","last_clean_scrub_stamp":"2024-09-12T05:23:52.035911+0000","objects_scrubbed":36,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:33:52.981096+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0028723139999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":4932,"num_read_kb":38662,"num_write":725,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":19018297,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'473","reported_seq":6304,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:49.975928+0000","last_change":"2024-09-12T05:23:49.975928+0000","last_active":"2024-09-12T05:23:49.975928+0000","last_peered":"2024-09-12T05:23:49.975928+0000","last_clean":"2024-09-12T05:23:49.975928+0000","last_became_active":"2024-09-12T05:23:05.778317+0000","last_became_peered":"2024-09-12T05:23:05.778317+0000","last_unstale":"2024-09-12T05:23:49.975928+0000","last_undegraded":"2024-09-12T05:23:49.975928+0000","last_fullsized":"2024-09-12T05:23:49.975928+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'473","last_scrub_stamp":"2024-09-12T05:23:49.975845+0000","last_deep_scrub":"198'473","last_deep_scrub_stamp":"2024-09-12T05:23:49.975845+0000","last_clean_scrub_stamp":"2024-09-12T05:23:49.975845+0000","objects_scrubbed":32,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:51.321283+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0023560629999999998,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5982,"num_read_kb":31159,"num_write":378,"num_write_kb":18476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":278,"num_bytes_recovered":17309726,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"198'499","reported_seq":4468,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:51.750115+0000","last_change":"2024-09-12T05:23:51.750115+0000","last_active":"2024-09-12T05:23:51.750115+0000","last_peered":"2024-09-12T05:23:51.750115+0000","last_clean":"2024-09-12T05:23:51.750115+0000","last_became_active":"2024-09-12T05:23:22.049233+0000","last_became_peered":"2024-09-12T05:23:22.049233+0000","last_unstale":"2024-09-12T05:23:51.750115+0000","last_undegraded":"2024-09-12T05:23:51.750115+0000","last_fullsized":"2024-09-12T05:23:51.750115+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'499","last_scrub_stamp":"2024-09-12T05:23:51.749799+0000","last_deep_scrub":"198'499","last_deep_scrub_stamp":"2024-09-12T05:23:51.749799+0000","last_clean_scrub_stamp":"2024-09-12T05:23:51.749799+0000","objects_scrubbed":33,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:53.812247+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0015759229999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4026,"num_read_kb":33452,"num_write":410,"num_write_kb":5078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":1855629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"198'685","reported_seq":3443,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:52.827868+0000","last_change":"2024-09-12T05:23:52.827868+0000","last_active":"2024-09-12T05:23:52.827868+0000","last_peered":"2024-09-12T05:23:52.827868+0000","last_clean":"2024-09-12T05:23:52.827868+0000","last_became_active":"2024-09-12T05:23:21.054412+0000","last_became_peered":"2024-09-12T05:23:21.054412+0000","last_unstale":"2024-09-12T05:23:52.827868+0000","last_undegraded":"2024-09-12T05:23:52.827868+0000","last_fullsized":"2024-09-12T05:23:52.827868+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'685","last_scrub_stamp":"2024-09-12T05:23:52.827683+0000","last_deep_scrub":"198'685","last_deep_scrub_stamp":"2024-09-12T05:23:52.827683+0000","last_clean_scrub_stamp":"2024-09-12T05:23:52.827683+0000","objects_scrubbed":29,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:19.840974+0000","scrub_duration":55,"objects_trimmed":26,"snaptrim_duration":0.10278277800000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4940,"num_read_kb":22589,"num_write":590,"num_write_kb":11883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"198'714","reported_seq":2543,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:50.015433+0000","last_change":"2024-09-12T05:23:50.015433+0000","last_active":"2024-09-12T05:23:50.015433+0000","last_peered":"2024-09-12T05:23:50.015433+0000","last_clean":"2024-09-12T05:23:50.015433+0000","last_became_active":"2024-09-12T05:20:09.736820+0000","last_became_peered":"2024-09-12T05:20:09.736820+0000","last_unstale":"2024-09-12T05:23:50.015433+0000","last_undegraded":"2024-09-12T05:23:50.015433+0000","last_fullsized":"2024-09-12T05:23:50.015433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'714","last_scrub_stamp":"2024-09-12T05:23:50.015262+0000","last_deep_scrub":"198'714","last_deep_scrub_stamp":"2024-09-12T05:23:50.015262+0000","last_clean_scrub_stamp":"2024-09-12T05:23:50.015262+0000","objects_scrubbed":28,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:38.125468+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.0042327889999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3367,"num_read_kb":15041,"num_write":820,"num_write_kb":7486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"198'580","reported_seq":6384,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:54.098208+0000","last_change":"2024-09-12T05:23:54.098208+0000","last_active":"2024-09-12T05:23:54.098208+0000","last_peered":"2024-09-12T05:23:54.098208+0000","last_clean":"2024-09-12T05:23:54.098208+0000","last_became_active":"2024-09-12T05:20:09.746083+0000","last_became_peered":"2024-09-12T05:20:09.746083+0000","last_unstale":"2024-09-12T05:23:54.098208+0000","last_undegraded":"2024-09-12T05:23:54.098208+0000","last_fullsized":"2024-09-12T05:23:54.098208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'580","last_scrub_stamp":"2024-09-12T05:23:54.098013+0000","last_deep_scrub":"198'580","last_deep_scrub_stamp":"2024-09-12T05:23:54.098013+0000","last_clean_scrub_stamp":"2024-09-12T05:23:54.098013+0000","objects_scrubbed":31,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:52.717621+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.00202206,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":6274,"num_read_kb":69645,"num_write":520,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"198'441","reported_seq":2564,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:58.557300+0000","last_change":"2024-09-12T05:23:58.557300+0000","last_active":"2024-09-12T05:23:58.557300+0000","last_peered":"2024-09-12T05:23:58.557300+0000","last_clean":"2024-09-12T05:23:58.557300+0000","last_became_active":"2024-09-12T05:23:24.069263+0000","last_became_peered":"2024-09-12T05:23:24.069263+0000","last_unstale":"2024-09-12T05:23:58.557300+0000","last_undegraded":"2024-09-12T05:23:58.557300+0000","last_fullsized":"2024-09-12T05:23:58.557300+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'441","last_scrub_stamp":"2024-09-12T05:23:58.557067+0000","last_deep_scrub":"198'441","last_deep_scrub_stamp":"2024-09-12T05:23:58.557067+0000","last_clean_scrub_stamp":"2024-09-12T05:23:58.557067+0000","objects_scrubbed":23,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:49:04.265681+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0041559700000000002,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":1771,"num_read_kb":12775,"num_write":434,"num_write_kb":10569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5316575,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"198'1306","reported_seq":5608,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:51.027668+0000","last_change":"2024-09-12T05:23:51.027668+0000","last_active":"2024-09-12T05:23:51.027668+0000","last_peered":"2024-09-12T05:23:51.027668+0000","last_clean":"2024-09-12T05:23:51.027668+0000","last_became_active":"2024-09-12T05:22:14.756246+0000","last_became_peered":"2024-09-12T05:22:14.756246+0000","last_unstale":"2024-09-12T05:23:51.027668+0000","last_undegraded":"2024-09-12T05:23:51.027668+0000","last_fullsized":"2024-09-12T05:23:51.027668+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'1306","last_scrub_stamp":"2024-09-12T05:23:51.027435+0000","last_deep_scrub":"198'1306","last_deep_scrub_stamp":"2024-09-12T05:23:51.027435+0000","last_clean_scrub_stamp":"2024-09-12T05:23:51.027435+0000","objects_scrubbed":35,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:55.938318+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0.001595127,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":8879,"num_read_kb":39076,"num_write":1824,"num_write_kb":25359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":17251748,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":327,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:50.237302+0000","last_change":"2024-09-12T05:23:50.237302+0000","last_active":"2024-09-12T05:23:50.237302+0000","last_peered":"2024-09-12T05:23:50.237302+0000","last_clean":"2024-09-12T05:23:50.237302+0000","last_became_active":"2024-09-12T05:20:33.986665+0000","last_became_peered":"2024-09-12T05:20:33.986665+0000","last_unstale":"2024-09-12T05:23:50.237302+0000","last_undegraded":"2024-09-12T05:23:50.237302+0000","last_fullsized":"2024-09-12T05:23:50.237302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:23:50.237138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:23:50.237138+0000","last_clean_scrub_stamp":"2024-09-12T05:23:50.237138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:26.810724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"198'843","reported_seq":3353,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:47.036948+0000","last_change":"2024-09-12T05:23:47.036948+0000","last_active":"2024-09-12T05:23:47.036948+0000","last_peered":"2024-09-12T05:23:47.036948+0000","last_clean":"2024-09-12T05:23:47.036948+0000","last_became_active":"2024-09-12T05:23:06.775134+0000","last_became_peered":"2024-09-12T05:23:06.775134+0000","last_unstale":"2024-09-12T05:23:47.036948+0000","last_undegraded":"2024-09-12T05:23:47.036948+0000","last_fullsized":"2024-09-12T05:23:47.036948+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'843","last_scrub_stamp":"2024-09-12T05:23:47.036827+0000","last_deep_scrub":"198'843","last_deep_scrub_stamp":"2024-09-12T05:23:47.036827+0000","last_clean_scrub_stamp":"2024-09-12T05:23:47.036827+0000","objects_scrubbed":41,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.693620+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0042806040000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":2732,"num_read_kb":14112,"num_write":849,"num_write_kb":22030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":524386,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:48.706737+0000","last_change":"2024-09-12T05:23:48.706737+0000","last_active":"2024-09-12T05:23:48.706737+0000","last_peered":"2024-09-12T05:23:48.706737+0000","last_clean":"2024-09-12T05:23:48.706737+0000","last_became_active":"2024-09-12T05:23:02.830555+0000","last_became_peered":"2024-09-12T05:23:02.830555+0000","last_unstale":"2024-09-12T05:23:48.706737+0000","last_undegraded":"2024-09-12T05:23:48.706737+0000","last_fullsized":"2024-09-12T05:23:48.706737+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:23:48.706657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:23:48.706657+0000","last_clean_scrub_stamp":"2024-09-12T05:23:48.706657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:50.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019190850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"198'457","reported_seq":3475,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:48.762711+0000","last_change":"2024-09-12T05:23:48.762711+0000","last_active":"2024-09-12T05:23:48.762711+0000","last_peered":"2024-09-12T05:23:48.762711+0000","last_clean":"2024-09-12T05:23:48.762711+0000","last_became_active":"2024-09-12T05:23:21.051627+0000","last_became_peered":"2024-09-12T05:23:21.051627+0000","last_unstale":"2024-09-12T05:23:48.762711+0000","last_undegraded":"2024-09-12T05:23:48.762711+0000","last_fullsized":"2024-09-12T05:23:48.762711+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'457","last_scrub_stamp":"2024-09-12T05:23:48.762582+0000","last_deep_scrub":"198'457","last_deep_scrub_stamp":"2024-09-12T05:23:48.762582+0000","last_clean_scrub_stamp":"2024-09-12T05:23:48.762582+0000","objects_scrubbed":22,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:17.915447+0000","scrub_duration":31,"objects_trimmed":22,"snaptrim_duration":0.114526524,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2848,"num_read_kb":54239,"num_write":458,"num_write_kb":24596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":376,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:52.554948+0000","last_change":"2024-09-12T05:23:52.554948+0000","last_active":"2024-09-12T05:23:52.554948+0000","last_peered":"2024-09-12T05:23:52.554948+0000","last_clean":"2024-09-12T05:23:52.554948+0000","last_became_active":"2024-09-12T05:19:59.918562+0000","last_became_peered":"2024-09-12T05:19:59.918562+0000","last_unstale":"2024-09-12T05:23:52.554948+0000","last_undegraded":"2024-09-12T05:23:52.554948+0000","last_fullsized":"2024-09-12T05:23:52.554948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:23:52.554709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:23:52.554709+0000","last_clean_scrub_stamp":"2024-09-12T05:23:52.554709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:32.111517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009770060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"198'781","reported_seq":4351,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:50.756046+0000","last_change":"2024-09-12T05:23:50.756046+0000","last_active":"2024-09-12T05:23:50.756046+0000","last_peered":"2024-09-12T05:23:50.756046+0000","last_clean":"2024-09-12T05:23:50.756046+0000","last_became_active":"2024-09-12T05:23:06.773505+0000","last_became_peered":"2024-09-12T05:23:06.773505+0000","last_unstale":"2024-09-12T05:23:50.756046+0000","last_undegraded":"2024-09-12T05:23:50.756046+0000","last_fullsized":"2024-09-12T05:23:50.756046+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'781","last_scrub_stamp":"2024-09-12T05:23:50.755974+0000","last_deep_scrub":"198'781","last_deep_scrub_stamp":"2024-09-12T05:23:50.755974+0000","last_clean_scrub_stamp":"2024-09-12T05:23:50.755974+0000","objects_scrubbed":29,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:31.782666+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0024700099999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5270,"num_read_kb":22820,"num_write":798,"num_write_kb":28293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":474,"num_bytes_recovered":12649810,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:47.717871+0000","last_change":"2024-09-12T05:23:47.717871+0000","last_active":"2024-09-12T05:23:47.717871+0000","last_peered":"2024-09-12T05:23:47.717871+0000","last_clean":"2024-09-12T05:23:47.717871+0000","last_became_active":"2024-09-12T05:23:02.829933+0000","last_became_peered":"2024-09-12T05:23:02.829933+0000","last_unstale":"2024-09-12T05:23:47.717871+0000","last_undegraded":"2024-09-12T05:23:47.717871+0000","last_fullsized":"2024-09-12T05:23:47.717871+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:23:47.717795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:23:47.717795+0000","last_clean_scrub_stamp":"2024-09-12T05:23:47.717795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:21.915427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018267559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'507","reported_seq":2896,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:51.031387+0000","last_change":"2024-09-12T05:23:51.031387+0000","last_active":"2024-09-12T05:23:51.031387+0000","last_peered":"2024-09-12T05:23:51.031387+0000","last_clean":"2024-09-12T05:23:51.031387+0000","last_became_active":"2024-09-12T05:23:21.069868+0000","last_became_peered":"2024-09-12T05:23:21.069868+0000","last_unstale":"2024-09-12T05:23:51.031387+0000","last_undegraded":"2024-09-12T05:23:51.031387+0000","last_fullsized":"2024-09-12T05:23:51.031387+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'507","last_scrub_stamp":"2024-09-12T05:23:51.031135+0000","last_deep_scrub":"198'507","last_deep_scrub_stamp":"2024-09-12T05:23:51.031135+0000","last_clean_scrub_stamp":"2024-09-12T05:23:51.031135+0000","objects_scrubbed":22,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:13.308504+0000","scrub_duration":35,"objects_trimmed":10,"snaptrim_duration":0.078824042999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":2610,"num_read_kb":20437,"num_write":595,"num_write_kb":10557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"198'770","reported_seq":5277,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:48.967783+0000","last_change":"2024-09-12T05:23:48.967783+0000","last_active":"2024-09-12T05:23:48.967783+0000","last_peered":"2024-09-12T05:23:48.967783+0000","last_clean":"2024-09-12T05:23:48.967783+0000","last_became_active":"2024-09-12T05:22:14.219295+0000","last_became_peered":"2024-09-12T05:22:14.219295+0000","last_unstale":"2024-09-12T05:23:48.967783+0000","last_undegraded":"2024-09-12T05:23:48.967783+0000","last_fullsized":"2024-09-12T05:23:48.967783+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'770","last_scrub_stamp":"2024-09-12T05:23:48.967584+0000","last_deep_scrub":"198'770","last_deep_scrub_stamp":"2024-09-12T05:23:48.967584+0000","last_clean_scrub_stamp":"2024-09-12T05:23:48.967584+0000","objects_scrubbed":41,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:51.390401+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.001330901,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":5192,"num_read_kb":18719,"num_write":679,"num_write_kb":26356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":5246358,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"198'3","reported_seq":402,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:49.963970+0000","last_change":"2024-09-12T05:23:49.963970+0000","last_active":"2024-09-12T05:23:49.963970+0000","last_peered":"2024-09-12T05:23:49.963970+0000","last_clean":"2024-09-12T05:23:49.963970+0000","last_became_active":"2024-09-12T05:23:02.830933+0000","last_became_peered":"2024-09-12T05:23:02.830933+0000","last_unstale":"2024-09-12T05:23:49.963970+0000","last_undegraded":"2024-09-12T05:23:49.963970+0000","last_fullsized":"2024-09-12T05:23:49.963970+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'3","last_scrub_stamp":"2024-09-12T05:23:49.963740+0000","last_deep_scrub":"198'3","last_deep_scrub_stamp":"2024-09-12T05:23:49.963740+0000","last_clean_scrub_stamp":"2024-09-12T05:23:49.963740+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:36.867428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012875670000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"198'1049","reported_seq":10735,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:49.776308+0000","last_change":"2024-09-12T05:23:49.776308+0000","last_active":"2024-09-12T05:23:49.776308+0000","last_peered":"2024-09-12T05:23:49.776308+0000","last_clean":"2024-09-12T05:23:49.776308+0000","last_became_active":"2024-09-12T05:23:06.773339+0000","last_became_peered":"2024-09-12T05:23:06.773339+0000","last_unstale":"2024-09-12T05:23:49.776308+0000","last_undegraded":"2024-09-12T05:23:49.776308+0000","last_fullsized":"2024-09-12T05:23:49.776308+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'1049","last_scrub_stamp":"2024-09-12T05:23:49.776199+0000","last_deep_scrub":"198'1049","last_deep_scrub_stamp":"2024-09-12T05:23:49.776199+0000","last_clean_scrub_stamp":"2024-09-12T05:23:49.776199+0000","objects_scrubbed":27,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:15:34.598993+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.002206193,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":11896,"num_read_kb":54588,"num_write":1368,"num_write_kb":21769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":13965694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":239,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:48.685788+0000","last_change":"2024-09-12T05:23:48.685788+0000","last_active":"2024-09-12T05:23:48.685788+0000","last_peered":"2024-09-12T05:23:48.685788+0000","last_clean":"2024-09-12T05:23:48.685788+0000","last_became_active":"2024-09-12T05:21:39.752490+0000","last_became_peered":"2024-09-12T05:21:39.752490+0000","last_unstale":"2024-09-12T05:23:48.685788+0000","last_undegraded":"2024-09-12T05:23:48.685788+0000","last_fullsized":"2024-09-12T05:23:48.685788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:23:48.685703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:23:48.685703+0000","last_clean_scrub_stamp":"2024-09-12T05:23:48.685703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:30.747832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"198'642","reported_seq":2631,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:48.061550+0000","last_change":"2024-09-12T05:23:48.061550+0000","last_active":"2024-09-12T05:23:48.061550+0000","last_peered":"2024-09-12T05:23:48.061550+0000","last_clean":"2024-09-12T05:23:48.061550+0000","last_became_active":"2024-09-12T05:22:14.758930+0000","last_became_peered":"2024-09-12T05:22:14.758930+0000","last_unstale":"2024-09-12T05:23:48.061550+0000","last_undegraded":"2024-09-12T05:23:48.061550+0000","last_fullsized":"2024-09-12T05:23:48.061550+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'642","last_scrub_stamp":"2024-09-12T05:23:48.061453+0000","last_deep_scrub":"198'642","last_deep_scrub_stamp":"2024-09-12T05:23:48.061453+0000","last_clean_scrub_stamp":"2024-09-12T05:23:48.061453+0000","objects_scrubbed":32,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:27.233197+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0015778210000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":2646,"num_read_kb":16084,"num_write":734,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1689635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":389,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:51.547586+0000","last_change":"2024-09-12T05:23:51.547462+0000","last_active":"2024-09-12T05:23:51.547586+0000","last_peered":"2024-09-12T05:23:51.547586+0000","last_clean":"2024-09-12T05:23:51.547586+0000","last_became_active":"2024-09-12T05:23:02.826853+0000","last_became_peered":"2024-09-12T05:23:02.826853+0000","last_unstale":"2024-09-12T05:23:51.547586+0000","last_undegraded":"2024-09-12T05:23:51.547586+0000","last_fullsized":"2024-09-12T05:23:51.547586+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T05:23:51.547266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T05:23:51.547266+0000","last_clean_scrub_stamp":"2024-09-12T05:23:51.547266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:32.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098919200000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"198'544","reported_seq":3681,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:51.776592+0000","last_change":"2024-09-12T05:23:51.776592+0000","last_active":"2024-09-12T05:23:51.776592+0000","last_peered":"2024-09-12T05:23:51.776592+0000","last_clean":"2024-09-12T05:23:51.776592+0000","last_became_active":"2024-09-12T05:23:21.060573+0000","last_became_peered":"2024-09-12T05:23:21.060573+0000","last_unstale":"2024-09-12T05:23:51.776592+0000","last_undegraded":"2024-09-12T05:23:51.776592+0000","last_fullsized":"2024-09-12T05:23:51.776592+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'544","last_scrub_stamp":"2024-09-12T05:23:51.776404+0000","last_deep_scrub":"198'544","last_deep_scrub_stamp":"2024-09-12T05:23:51.776404+0000","last_clean_scrub_stamp":"2024-09-12T05:23:51.776404+0000","objects_scrubbed":28,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:50.597724+0000","scrub_duration":55,"objects_trimmed":26,"snaptrim_duration":0.13014315100000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3396,"num_read_kb":46312,"num_write":573,"num_write_kb":32831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"198'2","reported_seq":401,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:52.046970+0000","last_change":"2024-09-12T05:23:52.046970+0000","last_active":"2024-09-12T05:23:52.046970+0000","last_peered":"2024-09-12T05:23:52.046970+0000","last_clean":"2024-09-12T05:23:52.046970+0000","last_became_active":"2024-09-12T05:21:39.749979+0000","last_became_peered":"2024-09-12T05:21:39.749979+0000","last_unstale":"2024-09-12T05:23:52.046970+0000","last_undegraded":"2024-09-12T05:23:52.046970+0000","last_fullsized":"2024-09-12T05:23:52.046970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'2","last_scrub_stamp":"2024-09-12T05:23:52.046788+0000","last_deep_scrub":"198'2","last_deep_scrub_stamp":"2024-09-12T05:23:52.046788+0000","last_clean_scrub_stamp":"2024-09-12T05:23:52.046788+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:15.134865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014277230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"198'74","reported_seq":471,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:50.527497+0000","last_change":"2024-09-12T05:23:50.527361+0000","last_active":"2024-09-12T05:23:50.527497+0000","last_peered":"2024-09-12T05:23:50.527497+0000","last_clean":"2024-09-12T05:23:50.527497+0000","last_became_active":"2024-09-12T05:19:54.984348+0000","last_became_peered":"2024-09-12T05:19:54.984348+0000","last_unstale":"2024-09-12T05:23:50.527497+0000","last_undegraded":"2024-09-12T05:23:50.527497+0000","last_fullsized":"2024-09-12T05:23:50.527497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'74","last_scrub_stamp":"2024-09-12T05:23:50.527135+0000","last_deep_scrub":"198'74","last_deep_scrub_stamp":"2024-09-12T05:23:50.527135+0000","last_clean_scrub_stamp":"2024-09-12T05:23:50.527135+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:59.818947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"198'749","reported_seq":5346,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:50.752724+0000","last_change":"2024-09-12T05:23:50.752724+0000","last_active":"2024-09-12T05:23:50.752724+0000","last_peered":"2024-09-12T05:23:50.752724+0000","last_clean":"2024-09-12T05:23:50.752724+0000","last_became_active":"2024-09-12T05:23:24.066068+0000","last_became_peered":"2024-09-12T05:23:24.066068+0000","last_unstale":"2024-09-12T05:23:50.752724+0000","last_undegraded":"2024-09-12T05:23:50.752724+0000","last_fullsized":"2024-09-12T05:23:50.752724+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'749","last_scrub_stamp":"2024-09-12T05:23:50.752594+0000","last_deep_scrub":"198'749","last_deep_scrub_stamp":"2024-09-12T05:23:50.752594+0000","last_clean_scrub_stamp":"2024-09-12T05:23:50.752594+0000","objects_scrubbed":30,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:32:11.513257+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0021121,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7224,"num_read_kb":35602,"num_write":683,"num_write_kb":24689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":22193143,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"198'606","reported_seq":2788,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:49.050486+0000","last_change":"2024-09-12T05:23:49.050486+0000","last_active":"2024-09-12T05:23:49.050486+0000","last_peered":"2024-09-12T05:23:49.050486+0000","last_clean":"2024-09-12T05:23:49.050486+0000","last_became_active":"2024-09-12T05:22:03.128735+0000","last_became_peered":"2024-09-12T05:22:03.128735+0000","last_unstale":"2024-09-12T05:23:49.050486+0000","last_undegraded":"2024-09-12T05:23:49.050486+0000","last_fullsized":"2024-09-12T05:23:49.050486+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'606","last_scrub_stamp":"2024-09-12T05:23:49.050397+0000","last_deep_scrub":"198'606","last_deep_scrub_stamp":"2024-09-12T05:23:49.050397+0000","last_clean_scrub_stamp":"2024-09-12T05:23:49.050397+0000","objects_scrubbed":38,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:43.674247+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.002006543,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":2948,"num_read_kb":4414,"num_write":610,"num_write_kb":2188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":1479071,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"198'928","reported_seq":3519,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:51.286134+0000","last_change":"2024-09-12T05:23:51.286134+0000","last_active":"2024-09-12T05:23:51.286134+0000","last_peered":"2024-09-12T05:23:51.286134+0000","last_clean":"2024-09-12T05:23:51.286134+0000","last_became_active":"2024-09-12T05:22:14.230759+0000","last_became_peered":"2024-09-12T05:22:14.230759+0000","last_unstale":"2024-09-12T05:23:51.286134+0000","last_undegraded":"2024-09-12T05:23:51.286134+0000","last_fullsized":"2024-09-12T05:23:51.286134+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'928","last_scrub_stamp":"2024-09-12T05:23:51.285884+0000","last_deep_scrub":"198'928","last_deep_scrub_stamp":"2024-09-12T05:23:51.285884+0000","last_clean_scrub_stamp":"2024-09-12T05:23:51.285884+0000","objects_scrubbed":24,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:57.270210+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0037362760000000002,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":5009,"num_read_kb":21353,"num_write":1061,"num_write_kb":9448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":5908596,"num_keys_recovered":51,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"198'514","reported_seq":5150,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:52.273917+0000","last_change":"2024-09-12T05:23:52.273917+0000","last_active":"2024-09-12T05:23:52.273917+0000","last_peered":"2024-09-12T05:23:52.273917+0000","last_clean":"2024-09-12T05:23:52.273917+0000","last_became_active":"2024-09-12T05:22:23.848062+0000","last_became_peered":"2024-09-12T05:22:23.848062+0000","last_unstale":"2024-09-12T05:23:52.273917+0000","last_undegraded":"2024-09-12T05:23:52.273917+0000","last_fullsized":"2024-09-12T05:23:52.273917+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'514","last_scrub_stamp":"2024-09-12T05:23:52.273687+0000","last_deep_scrub":"198'514","last_deep_scrub_stamp":"2024-09-12T05:23:52.273687+0000","last_clean_scrub_stamp":"2024-09-12T05:23:52.273687+0000","objects_scrubbed":28,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:20.330938+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0045086240000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5071,"num_read_kb":16406,"num_write":417,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":6526540,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"198'1835","reported_seq":4694,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:53.150643+0000","last_change":"2024-09-12T05:23:53.150643+0000","last_active":"2024-09-12T05:23:53.150643+0000","last_peered":"2024-09-12T05:23:53.150643+0000","last_clean":"2024-09-12T05:23:53.150643+0000","last_became_active":"2024-09-12T05:23:21.071081+0000","last_became_peered":"2024-09-12T05:23:21.071081+0000","last_unstale":"2024-09-12T05:23:53.150643+0000","last_undegraded":"2024-09-12T05:23:53.150643+0000","last_fullsized":"2024-09-12T05:23:53.150643+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'1835","last_scrub_stamp":"2024-09-12T05:23:53.150455+0000","last_deep_scrub":"198'1835","last_deep_scrub_stamp":"2024-09-12T05:23:53.150455+0000","last_clean_scrub_stamp":"2024-09-12T05:23:53.150455+0000","objects_scrubbed":33,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:04.295128+0000","scrub_duration":75,"objects_trimmed":12,"snaptrim_duration":0.074865914000000006,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":10272,"num_read_kb":16192,"num_write":3031,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"198'791","reported_seq":6249,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:57.583780+0000","last_change":"2024-09-12T05:23:57.583780+0000","last_active":"2024-09-12T05:23:57.583780+0000","last_peered":"2024-09-12T05:23:57.583780+0000","last_clean":"2024-09-12T05:23:57.583780+0000","last_became_active":"2024-09-12T05:20:09.754040+0000","last_became_peered":"2024-09-12T05:20:09.754040+0000","last_unstale":"2024-09-12T05:23:57.583780+0000","last_undegraded":"2024-09-12T05:23:57.583780+0000","last_fullsized":"2024-09-12T05:23:57.583780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'791","last_scrub_stamp":"2024-09-12T05:23:57.583596+0000","last_deep_scrub":"198'791","last_deep_scrub_stamp":"2024-09-12T05:23:57.583596+0000","last_clean_scrub_stamp":"2024-09-12T05:23:57.583596+0000","objects_scrubbed":27,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:32.426659+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0052823210000000004,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7010,"num_read_kb":29483,"num_write":891,"num_write_kb":11124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"198'554","reported_seq":2242,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:54.638907+0000","last_change":"2024-09-12T05:23:54.638907+0000","last_active":"2024-09-12T05:23:54.638907+0000","last_peered":"2024-09-12T05:23:54.638907+0000","last_clean":"2024-09-12T05:23:54.638907+0000","last_became_active":"2024-09-12T05:22:14.756367+0000","last_became_peered":"2024-09-12T05:22:14.756367+0000","last_unstale":"2024-09-12T05:23:54.638907+0000","last_undegraded":"2024-09-12T05:23:54.638907+0000","last_fullsized":"2024-09-12T05:23:54.638907+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'554","last_scrub_stamp":"2024-09-12T05:23:54.638710+0000","last_deep_scrub":"198'554","last_deep_scrub_stamp":"2024-09-12T05:23:54.638710+0000","last_clean_scrub_stamp":"2024-09-12T05:23:54.638710+0000","objects_scrubbed":27,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:14:45.664946+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0053945199999999999,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":2302,"num_read_kb":6600,"num_write":563,"num_write_kb":4788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":355709,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"198'397","reported_seq":3958,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:53.574100+0000","last_change":"2024-09-12T05:23:53.574100+0000","last_active":"2024-09-12T05:23:53.574100+0000","last_peered":"2024-09-12T05:23:53.574100+0000","last_clean":"2024-09-12T05:23:53.574100+0000","last_became_active":"2024-09-12T05:22:54.769137+0000","last_became_peered":"2024-09-12T05:22:54.769137+0000","last_unstale":"2024-09-12T05:23:53.574100+0000","last_undegraded":"2024-09-12T05:23:53.574100+0000","last_fullsized":"2024-09-12T05:23:53.574100+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'397","last_scrub_stamp":"2024-09-12T05:23:53.573870+0000","last_deep_scrub":"198'397","last_deep_scrub_stamp":"2024-09-12T05:23:53.573870+0000","last_clean_scrub_stamp":"2024-09-12T05:23:53.573870+0000","objects_scrubbed":19,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:48.237393+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0062235559999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3060,"num_read_kb":10629,"num_write":327,"num_write_kb":8973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":227,"num_bytes_recovered":1802832,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"198'524","reported_seq":3404,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:53.276080+0000","last_change":"2024-09-12T05:23:53.276080+0000","last_active":"2024-09-12T05:23:53.276080+0000","last_peered":"2024-09-12T05:23:53.276080+0000","last_clean":"2024-09-12T05:23:53.276080+0000","last_became_active":"2024-09-12T05:20:33.937675+0000","last_became_peered":"2024-09-12T05:20:33.937675+0000","last_unstale":"2024-09-12T05:23:53.276080+0000","last_undegraded":"2024-09-12T05:23:53.276080+0000","last_fullsized":"2024-09-12T05:23:53.276080+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'524","last_scrub_stamp":"2024-09-12T05:23:53.275842+0000","last_deep_scrub":"198'524","last_deep_scrub_stamp":"2024-09-12T05:23:53.275842+0000","last_clean_scrub_stamp":"2024-09-12T05:23:53.275842+0000","objects_scrubbed":23,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:30.589982+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0025783249999999998,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":3230,"num_read_kb":18134,"num_write":544,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1638620,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"198'482","reported_seq":3111,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:55.640931+0000","last_change":"2024-09-12T05:23:55.640931+0000","last_active":"2024-09-12T05:23:55.640931+0000","last_peered":"2024-09-12T05:23:55.640931+0000","last_clean":"2024-09-12T05:23:55.640931+0000","last_became_active":"2024-09-12T05:22:14.228772+0000","last_became_peered":"2024-09-12T05:22:14.228772+0000","last_unstale":"2024-09-12T05:23:55.640931+0000","last_undegraded":"2024-09-12T05:23:55.640931+0000","last_fullsized":"2024-09-12T05:23:55.640931+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'482","last_scrub_stamp":"2024-09-12T05:23:55.640718+0000","last_deep_scrub":"198'482","last_deep_scrub_stamp":"2024-09-12T05:23:55.640718+0000","last_clean_scrub_stamp":"2024-09-12T05:23:55.640718+0000","objects_scrubbed":28,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:02.036458+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0019782329999999998,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":3005,"num_read_kb":39119,"num_write":453,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":485663,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"198'433","reported_seq":2222,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:51.045917+0000","last_change":"2024-09-12T05:23:51.045917+0000","last_active":"2024-09-12T05:23:51.045917+0000","last_peered":"2024-09-12T05:23:51.045917+0000","last_clean":"2024-09-12T05:23:51.045917+0000","last_became_active":"2024-09-12T05:23:27.157078+0000","last_became_peered":"2024-09-12T05:23:27.157078+0000","last_unstale":"2024-09-12T05:23:51.045917+0000","last_undegraded":"2024-09-12T05:23:51.045917+0000","last_fullsized":"2024-09-12T05:23:51.045917+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'433","last_scrub_stamp":"2024-09-12T05:23:51.045747+0000","last_deep_scrub":"198'433","last_deep_scrub_stamp":"2024-09-12T05:23:51.045747+0000","last_clean_scrub_stamp":"2024-09-12T05:23:51.045747+0000","objects_scrubbed":25,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:19.305793+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0022490409999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2054,"num_read_kb":36836,"num_write":418,"num_write_kb":29183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"198'605","reported_seq":4173,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-12T05:23:56.613538+0000","last_change":"2024-09-12T05:23:56.613538+0000","last_active":"2024-09-12T05:23:56.613538+0000","last_peered":"2024-09-12T05:23:56.613538+0000","last_clean":"2024-09-12T05:23:56.613538+0000","last_became_active":"2024-09-12T05:22:15.776142+0000","last_became_peered":"2024-09-12T05:22:15.776142+0000","last_unstale":"2024-09-12T05:23:56.613538+0000","last_undegraded":"2024-09-12T05:23:56.613538+0000","last_fullsized":"2024-09-12T05:23:56.613538+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'605","last_scrub_stamp":"2024-09-12T05:23:56.613282+0000","last_deep_scrub":"198'605","last_deep_scrub_stamp":"2024-09-12T05:23:56.613282+0000","last_clean_scrub_stamp":"2024-09-12T05:23:56.613282+0000","objects_scrubbed":29,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:04:21.882259+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0034044259999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4425,"num_read_kb":19293,"num_write":516,"num_write_kb":6949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3534187,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":935,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":935,"num_whiteouts":931,"num_read":160719,"num_read_kb":930985,"num_write":23755,"num_write_kb":470520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3298,"num_bytes_recovered":149051681,"num_keys_recovered":362,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24428,"internal_metadata":0},"log_size":21939,"ondisk_log_size":21939,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542200,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60464,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311376,"statfs":{"total":96636764160,"available":96574849024,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542198,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41836,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330004,"statfs":{"total":96636764160,"available":96593924096,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542199,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77936,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293904,"statfs":{"total":96636764160,"available":96556957696,"internally_reserved":0,"allocated":2392064,"data_stored":1164784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":114,"seq":489626271770,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43504,"kb_used_data":2336,"kb_used_omap":27,"kb_used_meta":41124,"kb_avail":94328336,"statfs":{"total":96636764160,"available":96592216064,"internally_reserved":0,"allocated":2392064,"data_stored":1164784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27849,"internal_metadata":42111799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":178,"seq":764504178700,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":2332,"kb_used_omap":27,"kb_used_meta":33060,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28194,"internal_metadata":33853918},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41836,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330004,"statfs":{"total":96636764160,"available":96593924096,"internally_reserved":0,"allocated":2387968,"data_stored":1164765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55732,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316108,"statfs":{"total":96636764160,"available":96579694592,"internally_reserved":0,"allocated":2396160,"data_stored":1164803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60464,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311376,"statfs":{"total":96636764160,"available":96574849024,"internally_reserved":0,"allocated":2981888,"data_stored":1755133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11950,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12478,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T05:24:11.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T05:24:11.407 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T05:24:11.408 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T05:24:11.408 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T05:24:11.408 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:17.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T05:24:17.510 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T05:24:17.510 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T05:24:17.510 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:17.578 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T05:24:17.578 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T05:24:17.578 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:17.662 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T05:24:17.662 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T05:24:17.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:17.736 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T05:24:17.736 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T05:24:17.736 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:17.805 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T05:24:17.805 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T05:24:17.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:17.886 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T05:24:17.886 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T05:24:17.886 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:17.967 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T05:24:17.967 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T05:24:17.968 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:22.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T05:24:22.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T05:24:24.069 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T05:24:24.069 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T05:24:24.069 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T05:24:24.069 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:24.099 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T05:24:24.099 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T05:24:24.099 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:24.130 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T05:24:24.130 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T05:24:24.131 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T05:24:24.131 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:24.157 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T05:24:24.157 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T05:24:24.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:24.221 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T05:24:24.221 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T05:24:24.221 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T05:24:24.238 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T05:24:24.238 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T05:24:24.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T05:24:24.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:24:24.283 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T05:24:24.556 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:24:24.557 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T05:24:24.839 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:24:24.839 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T05:24:25.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:24:25.000 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T05:24:25.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:24:25.160 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T05:24:25.406 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:24:25.407 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T05:24:25.577 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:24:25.578 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T05:24:25.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:24:25.784 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T05:24:26.017 INFO:tasks.ceph:Archiving mon data... 2024-09-12T05:24:26.018 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/data/mon.a.tgz 2024-09-12T05:24:26.018 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-09-12T05:24:26.024 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.NODr6YwqoK 2024-09-12T05:24:26.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NODr6YwqoK 2024-09-12T05:24:26.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.NODr6YwqoK 2024-09-12T05:24:26.249 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.NODr6YwqoK is 456KB 2024-09-12T05:24:26.310 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.NODr6YwqoK 2024-09-12T05:24:26.316 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/data/mon.c.tgz 2024-09-12T05:24:26.316 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-09-12T05:24:26.365 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.HEaxoMiBrE 2024-09-12T05:24:26.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.HEaxoMiBrE 2024-09-12T05:24:26.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.HEaxoMiBrE 2024-09-12T05:24:26.641 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.HEaxoMiBrE is 632KB 2024-09-12T05:24:26.707 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.HEaxoMiBrE 2024-09-12T05:24:26.713 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/data/mon.b.tgz 2024-09-12T05:24:26.713 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-12T05:24:26.719 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.PKsEZr3x4L 2024-09-12T05:24:26.719 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.PKsEZr3x4L 2024-09-12T05:24:26.912 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.PKsEZr3x4L 2024-09-12T05:24:26.976 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.PKsEZr3x4L is 632KB 2024-09-12T05:24:27.037 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.PKsEZr3x4L 2024-09-12T05:24:27.043 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T05:24:27.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T05:24:27.045 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T05:24:27.106 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T05:24:27.148 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T05:24:27.148 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T05:24:27.150 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/remote/smithi059/crash 2024-09-12T05:24:27.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T05:24:27.165 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/remote/smithi194/crash 2024-09-12T05:24:27.166 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T05:24:27.203 INFO:tasks.ceph:Compressing logs... 2024-09-12T05:24:27.203 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T05:24:27.209 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T05:24:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44371.log 2024-09-12T05:24:27.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2024-09-12T05:24:27.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2024-09-12T05:24:27.229 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44371.log.gz 2024-09-12T05:24:27.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31460.log 2024-09-12T05:24:27.229 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2024-09-12T05:24:27.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2024-09-12T05:24:27.229 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2024-09-12T05:24:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31460.log.gz 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32462.log 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33772.log 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34385.log: /var/log/ceph/ceph-client.admin.32462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33243.log 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32462.log.gz 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33772.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33772.log.gz 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31583.log 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33243.log.gz 2024-09-12T05:24:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43954.log 2024-09-12T05:24:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43324.log 2024-09-12T05:24:27.235 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31583.log.gz 2024-09-12T05:24:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2024-09-12T05:24:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35100.log 2024-09-12T05:24:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32775.log 2024-09-12T05:24:27.235 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43324.log.gz 2024-09-12T05:24:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35100.log.gz 2024-09-12T05:24:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35943.log 2024-09-12T05:24:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32775.log.gz 2024-09-12T05:24:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33577.log 2024-09-12T05:24:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42888.log 2024-09-12T05:24:27.236 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35943.log.gz 2024-09-12T05:24:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33577.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.38559.log 2024-09-12T05:24:27.236 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33577.log.gz 2024-09-12T05:24:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42888.log.gz 2024-09-12T05:24:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34290.log 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35338.log 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/objectstore_tool.38559.log: /var/log/ceph/ceph-client.admin.34290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34290.log.gz 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41143.log 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35338.log.gz 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41886.log 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41143.log.gz 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32025.log 2024-09-12T05:24:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41886.log.gz 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34472.log 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37525.log 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32025.log.gz 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34472.log: 94.8% -- replaced with /var/log/ceph/objectstore_tool.38559.log.gz 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34472.log.gz 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31634.log 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37525.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37525.log.gz -5 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31634.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.31634.log.gz -- 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr: /var/log/ceph/ceph-client.admin.33535.log 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36634.log 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33535.log.gz 2024-09-12T05:24:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32363.log 2024-09-12T05:24:27.242 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42940.log 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36634.log: /var/log/ceph/ceph-client.admin.32363.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.38363.log 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32363.log.gz 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36634.log.gz 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42940.log.gz 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/objectstore_tool.38363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36747.log 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43736.log 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2024-09-12T05:24:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36747.log.gz 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43736.log: 94.8% -- replaced with /var/log/ceph/objectstore_tool.38363.log.gz 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43736.log.gz 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44501.log 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31834.log 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44501.log.gz 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41273.log 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31834.log.gz 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32452.log 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39841.log 2024-09-12T05:24:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41273.log.gz 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.32452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43517.log 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.0.32452.log.gz 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31630.log 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39841.log.gz 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36307.log 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43517.log.gz 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31630.log.gz 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32041.log 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36307.log.gz 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32041.log.gz 2024-09-12T05:24:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43764.log 2024-09-12T05:24:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31557.log 2024-09-12T05:24:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz 2024-09-12T05:24:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43764.log.gz 2024-09-12T05:24:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32888.log 2024-09-12T05:24:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32612.log 2024-09-12T05:24:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31557.log.gz 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32888.log.gz 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31837.log 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40520.log 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32612.log.gz 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31837.log.gz 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35591.log 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40520.log.gz 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40887.log 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34225.log 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35591.log.gz 2024-09-12T05:24:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40887.log.gz 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32044.log 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44449.log 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34225.log.gz 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32044.log.gz 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41192.log 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44449.log.gz 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32073.log 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32233.log 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41192.log.gz 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32654.log 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32073.log.gz 2024-09-12T05:24:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32233.log.gz 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41605.log 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40713.log 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32654.log.gz 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41605.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41605.log.gz -5 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40713.log.gz 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34679.log 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gz 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38322.log 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2024-09-12T05:24:27.263 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34679.log.gz 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32259.log 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38322.log.gz 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43787.log 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43787.log.gzgzip 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35388.log 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32029.log 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35388.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 0.0% 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35388.log.gz 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33086.log 2024-09-12T05:24:27.264 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32029.log.gz 2024-09-12T05:24:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35907.log 2024-09-12T05:24:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41243.log 2024-09-12T05:24:27.265 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33086.log.gz 2024-09-12T05:24:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32979.log 2024-09-12T05:24:27.265 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35907.log.gz 2024-09-12T05:24:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37197.log 2024-09-12T05:24:27.277 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41243.log.gz 2024-09-12T05:24:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43096.log 2024-09-12T05:24:27.277 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32979.log.gz 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34001.log 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37197.log.gz 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37036.log 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43096.log.gz 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40450.log 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34001.log.gz 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44163.log 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37036.log.gz 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44423.log 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40450.log.gz 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43122.log 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44163.log.gz 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33020.log 2024-09-12T05:24:27.278 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44423.log.gz 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41658.log 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43122.log.gz 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33020.log.gz 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38059.log 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41658.log.gz 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37797.log 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32463.log 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38059.log.gz 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37797.log.gz 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32045.log 2024-09-12T05:24:27.279 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32463.log.gz 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43332.log 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35759.log 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32045.log.gz 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43252.log 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43332.log.gz 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41579.log 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35759.log.gz 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42805.log 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43252.log.gz 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34761.log 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41579.log.gz 2024-09-12T05:24:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42805.log: -- /var/log/ceph/ceph-client.admin.35857.log 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42805.log.gz 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44058.log 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34761.log.gz 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43327.log 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35857.log.gz 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31833.log 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44058.log.gz 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36891.log 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43327.log.gz 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35019.log 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31833.log.gz 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36891.log.gz 2024-09-12T05:24:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36232.log 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35019.log.gz 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44137.log 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26390.log 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36232.log.gz 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40798.log 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44137.log.gz 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.26390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35883.log 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26390.log.gz 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 0.0% 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40798.log.gz 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36087.log 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35883.log.gz 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2024-09-12T05:24:27.282 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2024-09-12T05:24:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44215.log 2024-09-12T05:24:27.283 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36087.log.gz 2024-09-12T05:24:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37606.log 2024-09-12T05:24:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2024-09-12T05:24:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-09-12T05:24:27.290 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44215.log.gz 2024-09-12T05:24:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43070.log 2024-09-12T05:24:27.290 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37606.log.gz 2024-09-12T05:24:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36031.log 2024-09-12T05:24:27.290 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 2024-09-12T05:24:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32285.log 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43070.log.gz 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44319.log 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36031.log.gz 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43330.log 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32285.log.gz 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44319.log.gz 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43330.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43330.log.gz 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36503.log 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35683.log 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34654.log 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36503.log.gz 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31485.log 2024-09-12T05:24:27.291 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35683.log.gz 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34654.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34654.log.gz 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32419.log 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31485.log.gz 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41107.log 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35163.log 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32419.log.gz 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41107.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41939.log 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41107.log.gz 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38175.log 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35163.log.gz 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43326.log 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41939.log.gz 2024-09-12T05:24:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38175.log.gz 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.38776.log 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35566.log 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34037.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43326.log.gz 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/objectstore_tool.38776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34134.log 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34821.log 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35566.log.gz 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34134.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35052.log 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34821.log.gz 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37006.log 2024-09-12T05:24:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32465.log 2024-09-12T05:24:27.294 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35052.log.gz 2024-09-12T05:24:27.305 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26299.log 2024-09-12T05:24:27.305 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31765.log 2024-09-12T05:24:27.305 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26299.log.gz 2024-09-12T05:24:27.305 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26371.log 2024-09-12T05:24:27.305 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26419.log 2024-09-12T05:24:27.305 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/objectstore_tool.31765.log: /var/log/ceph/ceph-client.admin.26371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26371.log.gz 2024-09-12T05:24:27.305 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T05:24:27.305 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26419.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26419.log.gz 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26323.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31961.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.31765.log.gz 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26323.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26323.log.gz 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/objectstore_tool.31961.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26467.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26347.log 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26467.log.gz 2024-09-12T05:24:27.306 INFO:teuthology.orchestra.run.smithi194.stderr: 94.8% -- replaced with /var/log/ceph/objectstore_tool.31961.log.gz 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.32937.log 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26395.log 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26347.log.gz 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/objectstore_tool.32937.log: /var/log/ceph/ceph-client.admin.26395.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26395.log.gz 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26443.log 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.32157.log 2024-09-12T05:24:27.307 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26443.log.gz 2024-09-12T05:24:27.309 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/objectstore_tool.32157.log: 95.1% -- replaced with /var/log/ceph/objectstore_tool.32937.log.gz 2024-09-12T05:24:27.315 INFO:teuthology.orchestra.run.smithi194.stderr: 95.2% -- replaced with /var/log/ceph/objectstore_tool.32157.log.gz 2024-09-12T05:24:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35989.log 2024-09-12T05:24:27.326 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37006.log.gz 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32465.log.gz 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42914.log 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36222.log 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35989.log.gz 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34539.log 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42914.log.gz 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36222.log.gz 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43321.log 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43512.log 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34539.log: /var/log/ceph/ceph-client.admin.43321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34539.log.gz 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43321.log.gz 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44475.log 2024-09-12T05:24:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31636.log 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43512.log.gz 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr: 95.0%/var/log/ceph/ceph-client.admin.44475.log: -- replaced with /var/log/ceph/objectstore_tool.38776.log.gz 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44475.log.gz 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41722.log 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34918.log 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31636.log: /var/log/ceph/ceph-client.admin.41722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38225.log 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31636.log.gz 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41722.log.gz 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34918.log.gz 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35511.log 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38225.log.gz 2024-09-12T05:24:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43148.log 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33192.log 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35511.log.gz 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33316.log 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43148.log: /var/log/ceph/ceph-client.admin.33192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36577.log 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43148.log.gz 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33192.log.gz/var/log/ceph/ceph-client.admin.33316.log: 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33316.log.gz 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33878.log 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36577.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44577.log 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36577.log.gz 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40596.log 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33878.log.gz 2024-09-12T05:24:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32916.log 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44577.log: /var/log/ceph/ceph-client.admin.40596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36358.log 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44577.log.gz 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40596.log.gz 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32916.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32916.log.gz 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40495.log 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36358.log: /var/log/ceph/ceph.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36358.log.gz 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37424.log 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40620.log 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40495.log: /var/log/ceph/ceph-client.admin.37424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40495.log.gz 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37424.log.gz 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40746.log 2024-09-12T05:24:27.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33874.log 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40620.log.gz 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40746.log.gz 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21448.log 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41374.log 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33874.log.gz 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.tmp-client.admin.21448.log: 0.0% 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.21448.log.gz 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41374.log.gz 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44111.log 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36831.log 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43980.log 2024-09-12T05:24:27.331 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44111.log.gz 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36831.log.gz 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37040.log 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33718.log 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43980.log.gz 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31826.log 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37040.log.gz 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37159.log 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33718.log.gz 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31844.log 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31826.log.gz 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37159.log.gz 2024-09-12T05:24:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44397.log 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32043.log 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31844.log.gz 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41775.log 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44397.log.gz 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36790.log 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43533.log/var/log/ceph/ceph-client.admin.41775.log: 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32043.log.gz 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41775.log.gz 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36790.log.gz 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31435.log 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34601.log 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43533.log: /var/log/ceph/ceph-client.admin.31435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38780.log 2024-09-12T05:24:27.333 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43533.log.gz 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31435.log.gz 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34601.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.34601.log.gz --verbose 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr: -- /var/log/ceph/ceph-client.admin.37870.log 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40980.log 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38780.log: /var/log/ceph/ceph-client.admin.37870.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38780.log.gz 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37870.log.gz 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33623.log 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40980.log.gz 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33816.log 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.33623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43174.log 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33623.log.gz 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33816.log.gz 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log 2024-09-12T05:24:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32070.log 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43174.log.gz 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41913.log 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41463.log 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32070.log.gz 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41913.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31626.log 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41913.log.gz 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41463.log.gz 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26488.log 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31626.log: /var/log/ceph/ceph-client.admin.43331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31626.log.gz 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2024-09-12T05:24:27.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35679.log 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41848.log 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.26488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26488.log.gz 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35679.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41689.log 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41848.log.gz 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34175.log 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31845.log 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41689.log.gz 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34175.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31845.log.gz 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43200.log 2024-09-12T05:24:27.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2024-09-12T05:24:27.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36111.log 2024-09-12T05:24:27.342 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43200.log.gz 2024-09-12T05:24:27.342 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41413.log 2024-09-12T05:24:27.342 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35811.log 2024-09-12T05:24:27.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36111.log.gz 2024-09-12T05:24:27.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41413.log.gz 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36469.log 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35811.log.gz 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35461.log 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33161.log 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36469.log.gz 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35461.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37267.log 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33161.log.gz 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43538.log 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37267.log.gz 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33353.log 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43538.log.gz 2024-09-12T05:24:27.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34971.log 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33353.log.gz 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43540.log 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.39638.log 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr: 93.7%/var/log/ceph/ceph-client.admin.43540.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43540.log.gz 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37903.log 2024-09-12T05:24:27.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/objectstore_tool.39638.log: /var/log/ceph/ceph-client.admin.39602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2024-09-12T05:24:27.345 INFO:teuthology.orchestra.run.smithi059.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.39638.log.gz 2024-09-12T05:24:27.345 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43720.log 2024-09-12T05:24:27.345 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36443.log 2024-09-12T05:24:27.346 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37903.log: /var/log/ceph/ceph-client.admin.43720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37903.log.gz 2024-09-12T05:24:27.346 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43720.log.gz 2024-09-12T05:24:27.346 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43278.log 2024-09-12T05:24:27.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37967.log 2024-09-12T05:24:27.347 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36443.log: /var/log/ceph/ceph-client.admin.43278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36443.log.gz 2024-09-12T05:24:27.347 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43278.log.gz 2024-09-12T05:24:27.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37098.log 2024-09-12T05:24:27.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42966.log 2024-09-12T05:24:27.348 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37967.log: /var/log/ceph/ceph-client.admin.37098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37967.log.gz 2024-09-12T05:24:27.348 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37098.log.gz 2024-09-12T05:24:27.348 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37899.log 2024-09-12T05:24:27.348 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2024-09-12T05:24:27.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42966.log: /var/log/ceph/ceph-client.admin.37899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42966.log.gz 2024-09-12T05:24:27.350 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37899.log.gz 2024-09-12T05:24:27.350 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42862.log 2024-09-12T05:24:27.350 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38773.log 2024-09-12T05:24:27.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2024-09-12T05:24:27.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42862.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37759.log 2024-09-12T05:24:27.350 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38773.log.gz 2024-09-12T05:24:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40932.log 2024-09-12T05:24:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43539.log 2024-09-12T05:24:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37759.log.gz 2024-09-12T05:24:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40932.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41006.log 2024-09-12T05:24:27.352 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43539.log.gz 2024-09-12T05:24:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44084.log 2024-09-12T05:24:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31505.log 2024-09-12T05:24:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41006.log.gz 2024-09-12T05:24:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44084.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34867.log 2024-09-12T05:24:27.354 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44084.log.gz 2024-09-12T05:24:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31505.log.gz 2024-09-12T05:24:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37718.log 2024-09-12T05:24:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37449.log 2024-09-12T05:24:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34867.log.gz 2024-09-12T05:24:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37718.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38268.log 2024-09-12T05:24:27.356 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37718.log.gz 2024-09-12T05:24:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37449.log.gz 2024-09-12T05:24:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43728.log 2024-09-12T05:24:27.357 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33411.log 2024-09-12T05:24:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38268.log: /var/log/ceph/ceph-client.admin.43728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38268.log.gz 2024-09-12T05:24:27.358 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43728.log.gz 2024-09-12T05:24:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33941.log 2024-09-12T05:24:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31531.log 2024-09-12T05:24:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33411.log: /var/log/ceph/ceph-client.admin.33941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33411.log.gz 2024-09-12T05:24:27.359 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33941.log.gz 2024-09-12T05:24:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32823.log 2024-09-12T05:24:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31637.log 2024-09-12T05:24:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31531.log: /var/log/ceph/ceph-client.admin.32823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31531.log.gz 2024-09-12T05:24:27.361 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32823.log.gz 2024-09-12T05:24:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44553.log 2024-09-12T05:24:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2024-09-12T05:24:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31637.log.gz 2024-09-12T05:24:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44553.log.gz 2024-09-12T05:24:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41035.log 2024-09-12T05:24:27.362 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T05:24:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2024-09-12T05:24:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41818.log 2024-09-12T05:24:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41631.log 2024-09-12T05:24:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41035.log.gz 2024-09-12T05:24:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41818.log.gz 2024-09-12T05:24:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31623.log 2024-09-12T05:24:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41631.log.gz 2024-09-12T05:24:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33967.log 2024-09-12T05:24:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31817.log 2024-09-12T05:24:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31623.log.gz 2024-09-12T05:24:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33967.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31631.log 2024-09-12T05:24:27.365 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33967.log.gz 2024-09-12T05:24:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31817.log.gz 2024-09-12T05:24:27.367 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32311.log 2024-09-12T05:24:27.367 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36404.log 2024-09-12T05:24:27.367 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31631.log.gz 2024-09-12T05:24:27.367 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32311.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40660.log 2024-09-12T05:24:27.367 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.367 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36404.log.gz 2024-09-12T05:24:27.368 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42992.log 2024-09-12T05:24:27.368 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26243.log 2024-09-12T05:24:27.368 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40660.log.gz 2024-09-12T05:24:27.369 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42992.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43329.log 2024-09-12T05:24:27.369 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.370 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.26243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26243.log.gz 2024-09-12T05:24:27.370 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37664.log 2024-09-12T05:24:27.370 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44527.log 2024-09-12T05:24:27.370 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43329.log: /var/log/ceph/ceph-client.admin.37664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43329.log.gz 2024-09-12T05:24:27.370 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37664.log.gz 2024-09-12T05:24:27.370 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31635.log 2024-09-12T05:24:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43226.log 2024-09-12T05:24:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44527.log.gz 2024-09-12T05:24:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31635.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34393.log 2024-09-12T05:24:27.372 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43226.log.gz 2024-09-12T05:24:27.373 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41324.log 2024-09-12T05:24:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32771.log 2024-09-12T05:24:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34393.log.gz 2024-09-12T05:24:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41324.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-09-12T05:24:27.374 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.374 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32771.log.gz 2024-09-12T05:24:27.375 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31831.log 2024-09-12T05:24:27.375 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41439.log 2024-09-12T05:24:27.375 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-09-12T05:24:27.376 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31831.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33135.log 2024-09-12T05:24:27.376 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.376 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41439.log.gz 2024-09-12T05:24:27.376 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33510.log 2024-09-12T05:24:27.376 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33135.log.gz 2024-09-12T05:24:27.377 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38031.log 2024-09-12T05:24:27.377 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40840.log 2024-09-12T05:24:27.377 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33510.log.gz 2024-09-12T05:24:27.378 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38031.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31373.log 2024-09-12T05:24:27.378 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.379 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40840.log.gz 2024-09-12T05:24:27.379 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43520.log 2024-09-12T05:24:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37311.log 2024-09-12T05:24:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31373.log.gz 2024-09-12T05:24:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43520.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37529.log 2024-09-12T05:24:27.380 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37311.log.gz 2024-09-12T05:24:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32702.log 2024-09-12T05:24:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35287.log 2024-09-12T05:24:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37529.log.gz 2024-09-12T05:24:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32702.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36638.log 2024-09-12T05:24:27.382 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35287.log.gz 2024-09-12T05:24:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38134.log 2024-09-12T05:24:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34088.log 2024-09-12T05:24:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36638.log.gz 2024-09-12T05:24:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38134.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34315.log 2024-09-12T05:24:27.384 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34088.log.gz 2024-09-12T05:24:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2024-09-12T05:24:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37353.log 2024-09-12T05:24:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34315.log: /var/log/ceph/ceph-client.admin.44345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34315.log.gz 2024-09-12T05:24:27.386 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2024-09-12T05:24:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32337.log 2024-09-12T05:24:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34498.log 2024-09-12T05:24:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37353.log: /var/log/ceph/ceph-client.admin.32337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37353.log.gz 2024-09-12T05:24:27.387 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32337.log.gz 2024-09-12T05:24:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36971.log 2024-09-12T05:24:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35424.log 2024-09-12T05:24:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34498.log: /var/log/ceph/ceph-client.admin.36971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34498.log.gz 2024-09-12T05:24:27.388 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36971.log.gz 2024-09-12T05:24:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33415.log 2024-09-12T05:24:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35201.log 2024-09-12T05:24:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33415.log: /var/log/ceph/ceph-client.admin.35424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35424.log.gz 2024-09-12T05:24:27.389 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33415.log.gz 2024-09-12T05:24:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42836.log 2024-09-12T05:24:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35201.log.gz/var/log/ceph/ceph-client.admin.42836.log: 2024-09-12T05:24:27.390 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42836.log.gz 2024-09-12T05:24:27.532 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T05:24:27.539 INFO:teuthology.orchestra.run.smithi059.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T05:24:27.642 INFO:teuthology.orchestra.run.smithi059.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T05:24:27.900 INFO:teuthology.orchestra.run.smithi059.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T05:24:27.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T05:24:28.265 INFO:teuthology.orchestra.run.smithi194.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T05:24:29.386 INFO:teuthology.orchestra.run.smithi194.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T05:24:30.063 INFO:teuthology.orchestra.run.smithi059.stderr: 95.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T05:24:30.110 INFO:teuthology.orchestra.run.smithi194.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T05:24:30.149 INFO:teuthology.orchestra.run.smithi059.stderr: 95.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T05:24:30.199 INFO:teuthology.orchestra.run.smithi194.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T05:24:30.202 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-12T05:24:30.202 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m2.941s 2024-09-12T05:24:30.202 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m8.738s 2024-09-12T05:24:30.202 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m0.395s 2024-09-12T05:24:30.454 INFO:teuthology.orchestra.run.smithi059.stderr: 95.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T05:24:30.455 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-12T05:24:30.455 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m3.243s 2024-09-12T05:24:30.456 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m9.992s 2024-09-12T05:24:30.456 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.478s 2024-09-12T05:24:30.456 INFO:tasks.ceph:Archiving logs... 2024-09-12T05:24:30.456 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/remote/smithi059/log 2024-09-12T05:24:30.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T05:24:31.679 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/remote/smithi194/log 2024-09-12T05:24:31.680 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T05:24:32.642 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T05:24:32.651 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T05:24:32.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T05:24:32.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T05:24:32.747 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T05:24:32.772 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T05:24:32.773 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T05:24:32.775 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T05:24:32.787 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T05:24:32.787 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2024-09-12T05:24:32.787 INFO:teuthology.orchestra.run.smithi059.stdout:+hv01.front.sepi 67.205.162.81 3 u 39 64 177 0.096 -2.031 1.073 2024-09-12T05:24:32.787 INFO:teuthology.orchestra.run.smithi059.stdout:+hv02.front.sepi 96.245.170.99 3 u 43 64 177 0.078 +1.604 1.470 2024-09-12T05:24:32.787 INFO:teuthology.orchestra.run.smithi059.stdout:*hv03.front.sepi 74.6.168.72 3 u 48 64 177 0.094 -1.771 1.512 2024-09-12T05:24:32.787 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:24:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T05:24:32.789 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-09-12T05:24:32.789 INFO:teuthology.orchestra.run.smithi194.stdout:*hv01.front.sepi 67.205.162.81 3 u 41 64 177 0.105 -0.279 0.930 2024-09-12T05:24:32.789 INFO:teuthology.orchestra.run.smithi194.stdout:+hv02.front.sepi 96.245.170.99 3 u 42 64 177 0.084 +1.709 0.740 2024-09-12T05:24:32.789 INFO:teuthology.orchestra.run.smithi194.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 177 0.083 -2.823 1.112 2024-09-12T05:24:32.789 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T05:24:32.790 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T05:24:32.801 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T05:24:32.801 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T05:24:32.834 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T05:24:32.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T05:24:32.900 INFO:teuthology.task.internal:Duration was 904.570110 seconds 2024-09-12T05:24:32.901 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T05:24:32.934 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T05:24:32.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T05:24:32.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T05:24:32.974 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T05:24:32.974 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-09-12T05:24:32.974 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T05:24:33.025 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T05:24:33.025 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T05:24:33.037 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T05:24:33.037 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T05:24:33.073 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T05:24:33.107 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T05:24:33.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T05:24:33.145 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T05:24:33.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T05:24:33.231 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T05:24:33.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T05:24:33.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T05:24:33.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T05:24:33.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T05:24:33.290 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T05:24:33.298 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-09-12T05:24:33.304 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-12T05:24:33.325 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T05:24:33.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:24:33.356 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T05:24:33.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T05:24:33.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T05:24:33.381 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T05:24:33.382 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/remote/smithi059 2024-09-12T05:24:33.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T05:24:33.427 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dis-2024-09-12_04:46:10-rbd-wip-dis-testing-distro-default-smithi/7902301/remote/smithi194 2024-09-12T05:24:33.427 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T05:24:33.448 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T05:24:33.448 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T05:24:33.466 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T05:24:33.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T05:24:33.503 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T05:24:33.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T05:24:33.527 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T05:24:33.527 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T05:24:33.529 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T05:24:33.533 INFO:teuthology.orchestra.run.smithi059.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 05:24 /home/ubuntu/cephtest 2024-09-12T05:24:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: 658459 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 05:24 /home/ubuntu/cephtest 2024-09-12T05:24:33.541 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T05:24:33.560 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T05:24:33.629 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} duration: 904.5701098442078 flavor: default owner: scheduled_dis@teuthology success: true 2024-09-12T05:24:33.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T05:24:33.714 INFO:teuthology.run:pass